-- Logs begin at Thu 2022-08-04 21:13:57 UTC, end at Thu 2022-08-04 22:49:52 UTC. -- Aug 04 22:11:16.097368 dv-cinder-852211-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 04 22:11:16.105201 dv-cinder-852211-1-smb devstack@keystone.service[80269]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 22:11:16 2022] *** Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: nodename: dv-cinder-852211-1-smb Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: machine: x86_64 Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: clock source: unix Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: pcre jit disabled Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: detected number of CPU cores: 4 Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: current working directory: / Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: detected binary path: /usr/bin/uwsgi-core Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: your processes number limit is 47680 Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: your memory page size is 4096 bytes Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: detected max file descriptor number: 2048 Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: lock engine: pthread robust mutexes Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: thunder lock: enabled Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 04 22:11:16.109283 dv-cinder-852211-1-smb devstack@keystone.service[80269]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 22:11:16.148171 dv-cinder-852211-1-smb devstack@keystone.service[80269]: Python main interpreter initialized at 0x562fc72459c0 Aug 04 22:11:16.148171 dv-cinder-852211-1-smb devstack@keystone.service[80269]: python threads support enabled Aug 04 22:11:16.148171 dv-cinder-852211-1-smb devstack@keystone.service[80269]: your server socket listen backlog is limited to 100 connections Aug 04 22:11:16.148171 dv-cinder-852211-1-smb devstack@keystone.service[80269]: your mercy for graceful operations on workers is 90 seconds Aug 04 22:11:16.148566 dv-cinder-852211-1-smb devstack@keystone.service[80269]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 22:11:16.148642 dv-cinder-852211-1-smb devstack@keystone.service[80269]: *** Operational MODE: preforking *** Aug 04 22:11:16.148874 dv-cinder-852211-1-smb devstack@keystone.service[80269]: *** uWSGI is running in multiple interpreter mode *** Aug 04 22:11:16.148874 dv-cinder-852211-1-smb devstack@keystone.service[80269]: spawned uWSGI master process (pid: 80269) Aug 04 22:11:16.149082 dv-cinder-852211-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 04 22:11:16.153188 dv-cinder-852211-1-smb devstack@keystone.service[80269]: spawned uWSGI worker 1 (pid: 80284, cores: 1) Aug 04 22:11:16.153188 dv-cinder-852211-1-smb devstack@keystone.service[80269]: spawned uWSGI worker 2 (pid: 80285, cores: 1) Aug 04 22:11:16.153188 dv-cinder-852211-1-smb devstack@keystone.service[80269]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 22:11:21.642881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 22:11:21.642881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: from cryptography.utils import int_from_bytes Aug 04 22:11:21.643668 dv-cinder-852211-1-smb devstack@keystone.service[80285]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 22:11:21.643668 dv-cinder-852211-1-smb devstack@keystone.service[80285]: from cryptography.utils import int_from_bytes Aug 04 22:11:21.646188 dv-cinder-852211-1-smb devstack@keystone.service[80284]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 22:11:21.646188 dv-cinder-852211-1-smb devstack@keystone.service[80284]: from cryptography.utils import int_from_bytes Aug 04 22:11:21.646669 dv-cinder-852211-1-smb devstack@keystone.service[80284]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 22:11:21.646669 dv-cinder-852211-1-smb devstack@keystone.service[80284]: from cryptography.utils import int_from_bytes Aug 04 22:11:21.692553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 22:11:21.692762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 22:11:21.692927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] command line args: [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 22:11:21.693202 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 22:11:21.693379 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ================================================================================ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 22:11:21.693533 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 22:11:21.693621 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] admin_token = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.693735 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 22:11:21.693865 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] config_dir = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.693942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] command line args: [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 22:11:21.694054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.694186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 22:11:21.694271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] config_source = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.694354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ================================================================================ {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 22:11:21.694994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] debug = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.695129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.695427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] admin_token = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.695427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] config_dir = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.695626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.695724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.695825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.695927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] config_source = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.696022 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.696124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] debug = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.696124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.696339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.696446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.696546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.696653 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.696756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_config_append = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.696756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.696950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.697046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_dir = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.697145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.697249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_file = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.697351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] list_limit = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.697451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.697557 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] log_config_append = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.697642 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.697775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.697775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] log_dir = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.697969 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.698045 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] log_file = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.698160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.698238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.698359 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.698359 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.698543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.698621 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.698739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.698815 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.698939 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.698939 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.699132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.699214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.699292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.699414 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.699505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.699577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.699946 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.700063 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.700144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.700259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.700341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.700451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.700558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.700689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.700936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.701028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.701178 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.701267 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] publish_errors = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.701425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.701510 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.701653 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.701830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.701935 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.702076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.702172 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] publish_errors = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.702307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.702486 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.702568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] standard_threads = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.702718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.702807 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.702887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.703007 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.703127 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.703213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.703352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_journal = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.703434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.703513 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_json = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.703591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] standard_threads = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.703664 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_stderr = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.703796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.703882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_syslog = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.704038 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.704121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.704194 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.704288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.704373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] use_journal = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.704522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.704608 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] use_json = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.704681 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] use_stderr = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.704777 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.704861 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] use_syslog = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.705012 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.705100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 22:11:21.705257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.705336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.705492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.705571 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.705736 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.705826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.705968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.706047 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.706209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.706287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.706470 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.706562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.706719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.706797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.706950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.707028 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.707193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.707278 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.707426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.707504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.707670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.708018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.708018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.708170 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.708233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.708299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.708358 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.708420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.708581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.708752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.708829 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.708900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.709047 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.709126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.709296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.709388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.709544 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.709621 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.709787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.709866 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.710069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.710954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.711047 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.711120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.711197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.711275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.711346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.711426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.711546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.711626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.711778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.711855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.712008 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.712089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.712239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.712323 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.712469 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.712555 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.712712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.712791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.712955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.713039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.713184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.713260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.713415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.713496 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.713649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.713727 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.713883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.713967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.714117 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.714198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.714346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.714465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.714602 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.714681 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.714841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.714917 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.715047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.715128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.715317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.715401 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.715510 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.715592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.715741 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.715825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.715969 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.716061 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.716195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.716284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.716430 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.716509 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.716658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.716735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.716895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.716975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.717122 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.717199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.717355 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.717432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.717589 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.717668 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.717825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.717950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.718063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.718192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.718302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.718439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.718549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.718645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.718766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.718872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.719003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.719118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.719243 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.719406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.719509 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.719593 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.719719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.719818 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.719947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.720072 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.720168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.720237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.720401 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.720531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.720627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.720709 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.720895 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.720982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.721122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.721242 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.721362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.721455 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.721584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.721671 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.721818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.721905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.722052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.722132 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.722286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.722362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.722556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.722658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.722789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.722868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.723023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.723098 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.723258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.723423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.723534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.723622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.723755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.723919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.724073 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.724208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.724348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.724478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.724603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.724732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.724732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.724980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.725109 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.725233 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.725367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.725495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.725622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.725759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.725886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.726013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.726013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.726263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.726390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.726651 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.726777 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.726907 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.727033 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.727161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.727288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.727424 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.727560 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.727705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.727833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.727962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.728098 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.728228 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.728364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.728500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.728628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.728761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.728890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.729017 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.729144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.729290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.729415 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.729544 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.729670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.729797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.729940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.730069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.730196 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.external = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.730324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.730479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.730606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.730745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.730874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.731011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.731141 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.731267 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.password = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.731428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] auth.external = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.731565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.token = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.731705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.731841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.731978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.732113 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.732241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.732369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.732497 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] auth.password = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.732635 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.732766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] auth.token = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.732893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.733021 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.733147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.733277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.733422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.733570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.733649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.733722 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.733795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.733867 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.733948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.734030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.734104 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.734176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.734248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.734321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] credential.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.734400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.734507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.734581 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.734654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.734726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.734798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.734882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.734958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.735031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.735104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.735176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.735248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.735327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.735402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.735474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.735546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.735619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.735699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.735781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.735856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.735933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.736007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.736079 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.736151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.736230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.736334 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.736416 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.736574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.736654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.736841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.736984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.737116 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.737245 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.737373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.737501 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.737631 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.737773 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.737910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.738039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.738039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.738279 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.738279 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.738557 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.738557 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.738819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.738819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.739067 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.739195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.739330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.739459 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.739586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.739717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.739845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.740048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.740178 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.740305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.740444 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.740573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.740702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.740840 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.740969 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.741096 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.741223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.741856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.741985 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.742120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.742248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.742377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.742531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.742660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.742797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.742938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.743066 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.743195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.743322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.743451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.743577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.743711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.743796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.743925 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.744048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.744177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.744305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.744453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.744582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.744710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.744839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.744968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.745096 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.745233 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.745362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.745491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.745619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.745747 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.745887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.746023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.746159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.746298 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.746442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.746568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.746694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.746835 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.746967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.747093 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.747230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.747361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.747491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.747647 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.747777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.747902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.748042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.748174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.748302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.748460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.748585 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.748710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.748839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.748970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.749100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.749194 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.749314 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.749439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.749565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.749690 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.749829 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.749968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.750099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.750236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.750362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.750541 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.750670 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.750810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.750810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.751051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.751180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.751310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.751437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.751572 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.751711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.751839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.751967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.752094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.752222 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.752360 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.752495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.752625 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.752751 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.752877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.753004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.753141 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.753270 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.753408 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.753538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.753665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.753799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.753929 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.754055 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.754182 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.754309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.754451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.754590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.754717 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.754843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.754977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.755103 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.755239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.755374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.755502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.755628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.755753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.755878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.756004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.756137 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.756263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.756389 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.756516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.756641 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.756767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.756767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.757637 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.757767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.757900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.758026 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.758152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.758287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.758459 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.758587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.758718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.758847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.758975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.759114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.759245 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.759383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.759511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.759641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.759768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.759903 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.760031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.760160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.760288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.760416 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.760542 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.760542 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.760794 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.760928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.761057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.761198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.761329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.761464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.761593 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.761721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.761849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.761976 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.762104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.762239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.762369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.762518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.762649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.762779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.762909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.763057 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.763187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.763317 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.763447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.763576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.763705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.763842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.763969 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.764094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.764219 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.764345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.764470 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.764603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.764739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.764866 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.764992 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.765117 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.765243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.765376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.765502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.765627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] role.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.765753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.765878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] role.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.765878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.766188 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.766316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.766461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.766598 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.766731 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.766857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.766994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.767126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.767257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.767257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] role.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.767509 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.767641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] role.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.767778 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.767913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.768037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.768167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.768297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.768297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.768561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.768692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.768822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.768953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.769078 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.769217 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.769348 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.769479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.769609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.769609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.769855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.769992 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.770138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.770269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.770399 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.770555 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.770685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.770823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.770953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.771080 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.771211 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.771338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.771465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.771465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.771714 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.771714 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.771964 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.772093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.772222 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.772222 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.772470 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.772630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.772760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.772890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.773019 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.773154 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.773285 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.773413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.773549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.773678 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.773813 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.773941 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.774071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.774199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.774327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.774473 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.774607 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.774734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.774859 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.774986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.775111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.775236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.775379 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.775506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.775632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.775758 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.775883 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.776010 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.776143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.776277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.776403 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.776530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.776655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.776780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.776913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.777051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.777186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.777311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.777437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.777563 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.777697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.777824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.777953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.778080 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.778205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.778330 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.778510 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.778638 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.778768 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.778905 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.779034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.779163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.779298 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.779427 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.779563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.779563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.779816 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.779943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.780072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.780200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.780336 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.780466 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.780594 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.780732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.780860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.780860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.781107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.781237 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.781364 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.connection = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.781500 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.781636 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.781766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.781893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.782033 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.782163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.782291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.782437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.782573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.782705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.782844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.782973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.783101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.783229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.783358 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.783487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.783625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.783754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.783883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.784009 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.784135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.784274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.784410 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 22:11:21.784538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.784538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.784538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.784538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.784538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.784538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.784538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 22:11:21.784538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 22:11:21.807534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.807763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.807990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.808451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.808688 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.809080 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.816234 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.817250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.846211 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.846463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.847326 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.847561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.898479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.898784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.948595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.948827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.949557 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:21.950044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.013950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.014167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.014306 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.014472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.014606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.014772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.014909 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.015043 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.015175 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.015304 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.015436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.015577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.039005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.039245 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.039459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.039680 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.039866 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.040004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.040139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.040271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.040403 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.040543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.040543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.040795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.040924 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.041123 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.051285 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.051830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.064064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.064295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.064430 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.064565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.064710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.064847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.064980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.065113 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.065249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.065249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.065515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.065648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.065780 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80284) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.065914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 04 22:11:22.082351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.082539 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.082675 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 22:11:22.082807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 22:11:22.082942 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.083076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.083233 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 22:11:22.083375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 04 22:11:22.083508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.083642 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.083773 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.083913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.084046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.084178 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.084309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.084441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.094197 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.094361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.094524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.094658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.094791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.094923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.095067 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.095202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.102460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.102612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.107123 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.107278 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.107426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.107562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.107694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.107827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.107959 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.108099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.108230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.108360 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.108490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.108662 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.108805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.108951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.109090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.109220 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.109356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.109494 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.109625 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.109757 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.109889 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.110019 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.132757 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.133254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.134241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.134553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.134767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.135048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.139199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.139477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.139758 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.139924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.140098 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.140382 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.146463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.146748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.147168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.147460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.151425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.151710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.151991 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.152121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.152280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.152410 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.152571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.152720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.152850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.152978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.153106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.153243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.153372 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.153499 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.153699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.153972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.169159 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.169437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.169788 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.170066 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.173342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.174112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.176479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.176774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.177247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.177538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.181181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.181943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.184346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.185103 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.187518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.187812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.188097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.188394 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.188523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.188654 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.188784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.188922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.189061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.189239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.189519 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.189806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.205617 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.205898 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.206163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.206461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.206594 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.206811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.207081 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.207361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.213803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.214909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.215376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.215651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.216452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.216742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.218469 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.218755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.219043 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.219322 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.219574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.219705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.219857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.220145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.220429 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.220713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.231041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.231318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.231592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.231868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.232010 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.232156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.232287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.232424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.232555 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.232685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.232813 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.233076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.233356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.233763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.248054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.249330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.251039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.252321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.253973 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.255250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.256460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.258249 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.258471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.258768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.259050 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.259783 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.260076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.260354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.265469 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.266889 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.267061 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.268509 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.269964 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.270255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.270567 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.270841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.271428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.271719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.272005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.272283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.279363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.279657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.279937 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.281007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.281292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.281572 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.286818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.287095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.287371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.287640 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.287906 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.288219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.288434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80284) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 04 22:11:22.288564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.288724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.288867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.289001 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.289134 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.289282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.289414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.289547 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.289685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.289817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.289949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.290092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.290272 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.290430 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.290564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.290703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.290937 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.291209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.291470 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.291734 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.292000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80284) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 04 22:11:22.323919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562fc72459c0 pid: 80285 (default app) Aug 04 22:11:22.325903 dv-cinder-852211-1-smb devstack@keystone.service[80284]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562fc72459c0 pid: 80284 (default app) Aug 04 22:11:22.327449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bcf9a-c71c-491a-8b6c-b669c491e943 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:22.327738 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bcf9a-c71c-491a-8b6c-b669c491e943 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:22.328013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bcf9a-c71c-491a-8b6c-b669c491e943 None None] PATH_INFO: `/v3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:22.332273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Thu Aug 4 22:11:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:29.968129 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d34d9-9fbb-4ae3-8c1c-b7e871913549 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:29.968688 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d34d9-9fbb-4ae3-8c1c-b7e871913549 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:29.968688 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d34d9-9fbb-4ae3-8c1c-b7e871913549 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:29.973110 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:29.978565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58b9bc-5e8e-4de0-a440-d46b9d90d7b4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:29.978957 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58b9bc-5e8e-4de0-a440-d46b9d90d7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:29.979119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58b9bc-5e8e-4de0-a440-d46b9d90d7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:30.049915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: INFO dbcounter [None req-ac58b9bc-5e8e-4de0-a440-d46b9d90d7b4 None None] Registered counter for database keystone Aug 04 22:11:30.069335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG oslo_db.sqlalchemy.engines [None req-ac58b9bc-5e8e-4de0-a440-d46b9d90d7b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:11:30.076387 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writer thread running {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:11:30.259837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG passlib.handlers.bcrypt [None req-ac58b9bc-5e8e-4de0-a440-d46b9d90d7b4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80285) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 22:11:30.260169 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG passlib.handlers.bcrypt [None req-ac58b9bc-5e8e-4de0-a440-d46b9d90d7b4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80285) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 22:11:30.314073 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ac58b9bc-5e8e-4de0-a440-d46b9d90d7b4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:30.315758 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ac58b9bc-5e8e-4de0-a440-d46b9d90d7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:30.445823 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 04 22:11:30.564645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d34d9-9fbb-4ae3-8c1c-b7e871913549 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:30.633856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: INFO dbcounter [None req-dd5d34d9-9fbb-4ae3-8c1c-b7e871913549 None None] Registered counter for database keystone Aug 04 22:11:30.656263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG oslo_db.sqlalchemy.engines [None req-dd5d34d9-9fbb-4ae3-8c1c-b7e871913549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 22:11:30.662762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writer thread running {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 22:11:30.780304 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d34d9-9fbb-4ae3-8c1c-b7e871913549 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:30.784763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704116b-e175-4e9d-88bf-5ce185e2ef5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:30.785404 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704116b-e175-4e9d-88bf-5ce185e2ef5e admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:30.785685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704116b-e175-4e9d-88bf-5ce185e2ef5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:30.785961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704116b-e175-4e9d-88bf-5ce185e2ef5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:30.794551 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704116b-e175-4e9d-88bf-5ce185e2ef5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:30.848832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b704116b-e175-4e9d-88bf-5ce185e2ef5e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 22:11:30.849106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704116b-e175-4e9d-88bf-5ce185e2ef5e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:30.861370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Thu Aug 4 22:11:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:11:30.868621 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58b9bc-5e8e-4de0-a440-d46b9d90d7b4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:30.883018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58b9bc-5e8e-4de0-a440-d46b9d90d7b4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:30.887496 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb4dae-3411-4990-8452-5dbb00818367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:30.888627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb4dae-3411-4990-8452-5dbb00818367 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:30.888918 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb4dae-3411-4990-8452-5dbb00818367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:30.889196 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb4dae-3411-4990-8452-5dbb00818367 admin admin] PATH_INFO: `/v3/projects/0bdfa7558ab048ecad90e7cc85494da9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:30.890760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb4dae-3411-4990-8452-5dbb00818367 admin admin] RBAC: Authorizing `identity:get_project(project_id=0bdfa7558ab048ecad90e7cc85494da9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:30.941977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: WARNING keystone.common.rbac_enforcer.enforcer [None req-78eb4dae-3411-4990-8452-5dbb00818367 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 04 22:11:30.942315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb4dae-3411-4990-8452-5dbb00818367 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:30.947082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Thu Aug 4 22:11:30 2022] GET /identity/v3/projects/0bdfa7558ab048ecad90e7cc85494da9 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:32.912521 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b673a08-b97b-4815-9676-5debc9d29325 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:32.913572 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b673a08-b97b-4815-9676-5debc9d29325 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:32.913572 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b673a08-b97b-4815-9676-5debc9d29325 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:32.917724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:32.923025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2a08f-13bf-4607-823e-00f2fa6d137d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:32.923454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2a08f-13bf-4607-823e-00f2fa6d137d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:32.923617 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2a08f-13bf-4607-823e-00f2fa6d137d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:32.943817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bfa2a08f-13bf-4607-823e-00f2fa6d137d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:32.945328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bfa2a08f-13bf-4607-823e-00f2fa6d137d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:32.953472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 04 22:11:32.975569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b673a08-b97b-4815-9676-5debc9d29325 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:32.987927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b673a08-b97b-4815-9676-5debc9d29325 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:32.992101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e02f5-8292-48f9-91f7-f817bfc93bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:32.992700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e02f5-8292-48f9-91f7-f817bfc93bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:32.992986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e02f5-8292-48f9-91f7-f817bfc93bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:32.993261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e02f5-8292-48f9-91f7-f817bfc93bd5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:33.000853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e02f5-8292-48f9-91f7-f817bfc93bd5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:33.002640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e02f5-8292-48f9-91f7-f817bfc93bd5 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:33.011254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Thu Aug 4 22:11:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:11:33.016277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2a08f-13bf-4607-823e-00f2fa6d137d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:33.025913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2a08f-13bf-4607-823e-00f2fa6d137d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:33.030345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3e20d-f306-4683-a947-fc15793305d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:33.031003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3e20d-f306-4683-a947-fc15793305d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:33.031290 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3e20d-f306-4683-a947-fc15793305d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:33.031567 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3e20d-f306-4683-a947-fc15793305d1 admin admin] PATH_INFO: `/v3/users/8c0fa3378af3402089d42ceacf7a26b5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:33.032934 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3e20d-f306-4683-a947-fc15793305d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=8c0fa3378af3402089d42ceacf7a26b5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:33.034799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3e20d-f306-4683-a947-fc15793305d1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:33.036328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Thu Aug 4 22:11:33 2022] GET /identity/v3/users/8c0fa3378af3402089d42ceacf7a26b5 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:35.086146 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df7255-78e2-4d5d-a79c-84cddc16b22f None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:35.086710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df7255-78e2-4d5d-a79c-84cddc16b22f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:35.086710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df7255-78e2-4d5d-a79c-84cddc16b22f None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:35.088658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:11:35.093647 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc76a2-457f-4dbb-9e79-92b74b6e1e86 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:35.094064 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc76a2-457f-4dbb-9e79-92b74b6e1e86 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:35.094215 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc76a2-457f-4dbb-9e79-92b74b6e1e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:35.113710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e1cc76a2-457f-4dbb-9e79-92b74b6e1e86 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:35.114945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e1cc76a2-457f-4dbb-9e79-92b74b6e1e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:35.128602 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2955e8-9100-47e1-b3f2-17b399bbc104 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:35.128896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2955e8-9100-47e1-b3f2-17b399bbc104 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:35.129176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2955e8-9100-47e1-b3f2-17b399bbc104 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:35.130702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:11:35.135968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3573cac-95bb-4e9a-9964-3871a147ba5f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:35.136257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3573cac-95bb-4e9a-9964-3871a147ba5f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:35.136542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3573cac-95bb-4e9a-9964-3871a147ba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:35.177940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG passlib.handlers.bcrypt [None req-b3573cac-95bb-4e9a-9964-3871a147ba5f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80284) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 04 22:11:35.178370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG passlib.handlers.bcrypt [None req-b3573cac-95bb-4e9a-9964-3871a147ba5f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80284) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 04 22:11:35.194826 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:35.219488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc76a2-457f-4dbb-9e79-92b74b6e1e86 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:35.224719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b3573cac-95bb-4e9a-9964-3871a147ba5f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:35.226352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b3573cac-95bb-4e9a-9964-3871a147ba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:35.243421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:35.323953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc76a2-457f-4dbb-9e79-92b74b6e1e86 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:35.327154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:11:35.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3573cac-95bb-4e9a-9964-3871a147ba5f None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:35.357139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aaebd-5efa-468b-839d-9a7783d982e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:35.357790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aaebd-5efa-468b-839d-9a7783d982e5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:35.358072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aaebd-5efa-468b-839d-9a7783d982e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:35.358352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aaebd-5efa-468b-839d-9a7783d982e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:35.369808 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0aaebd-5efa-468b-839d-9a7783d982e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-9e0aaebd-5efa-468b-839d-9a7783d982e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:11:35.378579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:35.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:35.380482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:35.380482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:35.380482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:35.380482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:35.380482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:11:35.380482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:11:35.380482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:11:35.380482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:11:35.380482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:11:35.380482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:11:35.380482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:11:35.380482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:11:35.380482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:11:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:11:35.386067 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aaebd-5efa-468b-839d-9a7783d982e5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:35.447273 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3573cac-95bb-4e9a-9964-3871a147ba5f None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:35.451823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:35.470355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:35.487907 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27addaa7-3898-404a-85b8-2db95c4c169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:35.488795 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27addaa7-3898-404a-85b8-2db95c4c169f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:35.488900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aaebd-5efa-468b-839d-9a7783d982e5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:35.489087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27addaa7-3898-404a-85b8-2db95c4c169f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:35.489368 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27addaa7-3898-404a-85b8-2db95c4c169f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:35.523327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84913e7d-0a32-48b8-a218-6e34b0bd80f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:35.523939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84913e7d-0a32-48b8-a218-6e34b0bd80f7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:35.524217 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84913e7d-0a32-48b8-a218-6e34b0bd80f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:35.524485 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84913e7d-0a32-48b8-a218-6e34b0bd80f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:35.525195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84913e7d-0a32-48b8-a218-6e34b0bd80f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:35.525497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84913e7d-0a32-48b8-a218-6e34b0bd80f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:35.526927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84913e7d-0a32-48b8-a218-6e34b0bd80f7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:35.538530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:11:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:11:35.543874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84913e7d-0a32-48b8-a218-6e34b0bd80f7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:35.557483 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27addaa7-3898-404a-85b8-2db95c4c169f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:35.559037 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27addaa7-3898-404a-85b8-2db95c4c169f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:35.662170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:11:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 22:11:35.668819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27addaa7-3898-404a-85b8-2db95c4c169f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:35.672065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:35.749053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84913e7d-0a32-48b8-a218-6e34b0bd80f7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:35.770325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27addaa7-3898-404a-85b8-2db95c4c169f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:35.781954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc06a0-8508-4e89-98e0-3bb93fea2667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:35.782633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc06a0-8508-4e89-98e0-3bb93fea2667 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:35.782915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc06a0-8508-4e89-98e0-3bb93fea2667 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:35.783189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc06a0-8508-4e89-98e0-3bb93fea2667 None admin] PATH_INFO: `/v3/users/8c0fa3378af3402089d42ceacf7a26b5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:35.784356 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc06a0-8508-4e89-98e0-3bb93fea2667 None admin] RBAC: Authorizing `identity:get_user(user_id=8c0fa3378af3402089d42ceacf7a26b5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:35.785804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc06a0-8508-4e89-98e0-3bb93fea2667 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:35.787416 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:11:35 2022] GET /identity/v3/users/8c0fa3378af3402089d42ceacf7a26b5 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:11:35.793358 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc06a0-8508-4e89-98e0-3bb93fea2667 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:35.806042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b2210-9601-4316-8b50-a028d278bd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:35.806938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2210-9601-4316-8b50-a028d278bd83 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:35.807216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2210-9601-4316-8b50-a028d278bd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:35.807491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b2210-9601-4316-8b50-a028d278bd83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:35.808312 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:35.825663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b2210-9601-4316-8b50-a028d278bd83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:35.827155 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b2210-9601-4316-8b50-a028d278bd83 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-122b2210-9601-4316-8b50-a028d278bd83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:11:35.844769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:35.845638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:35.846475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:11:35.846475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:11:35.846475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:11:35.846475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:11:35.846475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:11:35.852228 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b2210-9601-4316-8b50-a028d278bd83 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:35.894004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc06a0-8508-4e89-98e0-3bb93fea2667 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:35.906291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:35.928020 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e2f1e-47a8-41b1-a8bb-dff1b3fb18fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:35.928635 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2f1e-47a8-41b1-a8bb-dff1b3fb18fd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:35.929433 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2f1e-47a8-41b1-a8bb-dff1b3fb18fd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:35.929887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2f1e-47a8-41b1-a8bb-dff1b3fb18fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:35.931499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e2f1e-47a8-41b1-a8bb-dff1b3fb18fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:35.932953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e2f1e-47a8-41b1-a8bb-dff1b3fb18fd None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:35.934563 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:11:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:11:35.940243 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e2f1e-47a8-41b1-a8bb-dff1b3fb18fd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:35.950711 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b2210-9601-4316-8b50-a028d278bd83 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:35.984931 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e564630-2ded-4f2a-a16b-5d528634ffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:35.985569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e564630-2ded-4f2a-a16b-5d528634ffe6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:35.985846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e564630-2ded-4f2a-a16b-5d528634ffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:35.986126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e564630-2ded-4f2a-a16b-5d528634ffe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:35.986849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e564630-2ded-4f2a-a16b-5d528634ffe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:35.987160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e564630-2ded-4f2a-a16b-5d528634ffe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:35.988540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e564630-2ded-4f2a-a16b-5d528634ffe6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:36.005488 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:11:36.024522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:36.046042 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e2f1e-47a8-41b1-a8bb-dff1b3fb18fd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:36.081613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1bfb7-667b-4afc-ade6-f7d6bbc98ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:36.082254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1bfb7-667b-4afc-ade6-f7d6bbc98ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:36.082573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1bfb7-667b-4afc-ade6-f7d6bbc98ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:36.082857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1bfb7-667b-4afc-ade6-f7d6bbc98ab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:36.083679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1bfb7-667b-4afc-ade6-f7d6bbc98ab7 None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.domain.id=default, user.id=8c0fa3378af3402089d42ceacf7a26b5) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:36.083995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1bfb7-667b-4afc-ade6-f7d6bbc98ab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:36.086050 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1bfb7-667b-4afc-ade6-f7d6bbc98ab7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:36.093771 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1322 bytes} [Thu Aug 4 22:11:35 2022] GET /identity/v3/role_assignments?user.id=8c0fa3378af3402089d42ceacf7a26b5&scope.domain.id=default&role.id=0053c24ce06147938dbb61657a531c94 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:11:38.329175 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647b56a-f4cf-4e16-811d-4447577ff65d None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:38.329708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647b56a-f4cf-4e16-811d-4447577ff65d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:38.329708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647b56a-f4cf-4e16-811d-4447577ff65d None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:38.331104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:38.336484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bbb3a-9c0b-4e0f-9b70-cf36e0ffd103 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:38.336903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bbb3a-9c0b-4e0f-9b70-cf36e0ffd103 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:38.337071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bbb3a-9c0b-4e0f-9b70-cf36e0ffd103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:38.372566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-552bbb3a-9c0b-4e0f-9b70-cf36e0ffd103 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:38.373760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-552bbb3a-9c0b-4e0f-9b70-cf36e0ffd103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:38.407262 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab776c07-878b-48bd-829b-70fd4ec82fe1 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:38.407555 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab776c07-878b-48bd-829b-70fd4ec82fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:38.407825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab776c07-878b-48bd-829b-70fd4ec82fe1 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:38.409412 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 12/23] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:11:38.415753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eb68b-8956-470a-969e-e03d89670405 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:38.416044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eb68b-8956-470a-969e-e03d89670405 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:38.416326 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0eb68b-8956-470a-969e-e03d89670405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:38.455469 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6e0eb68b-8956-470a-969e-e03d89670405 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:38.456679 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6e0eb68b-8956-470a-969e-e03d89670405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:38.480420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 12/24] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:11:38.517448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bbb3a-9c0b-4e0f-9b70-cf36e0ffd103 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:38.570587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 13/25] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:11:38.609895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0eb68b-8956-470a-969e-e03d89670405 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:38.665442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:38.687864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:38.731199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bbb3a-9c0b-4e0f-9b70-cf36e0ffd103 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:38.760336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0eb68b-8956-470a-969e-e03d89670405 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:38.797976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6653ee-00e4-405f-b65c-90d3a7aac9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:38.798999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6653ee-00e4-405f-b65c-90d3a7aac9fb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:38.799536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6653ee-00e4-405f-b65c-90d3a7aac9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:38.800034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6653ee-00e4-405f-b65c-90d3a7aac9fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:38.811622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6d63-7e0b-4b1e-9d27-b6393fa33cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:38.812280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6d63-7e0b-4b1e-9d27-b6393fa33cca None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:38.812565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6d63-7e0b-4b1e-9d27-b6393fa33cca None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:38.812898 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6d63-7e0b-4b1e-9d27-b6393fa33cca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:38.813257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6653ee-00e4-405f-b65c-90d3a7aac9fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:38.815045 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6653ee-00e4-405f-b65c-90d3a7aac9fb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-3b6653ee-00e4-405f-b65c-90d3a7aac9fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:11:38.831605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:38.832433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:38.833236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:11:38.833236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:11:38.833236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:11:38.833236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:11:38.835371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 14/26] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:11:38.841610 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6653ee-00e4-405f-b65c-90d3a7aac9fb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:38.843295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f6d63-7e0b-4b1e-9d27-b6393fa33cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-100f6d63-7e0b-4b1e-9d27-b6393fa33cca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:11:38.848332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:38.849221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:38.849993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:38.849993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:38.849993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:38.849993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:38.849993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:11:38.849993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:11:38.849993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:11:38.849993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:11:38.849993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:11:38.849993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:11:38.849993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:11:38.849993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:11:38.849993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 13/27] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:11:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:11:38.863755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6d63-7e0b-4b1e-9d27-b6393fa33cca None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:38.983956 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:38.987006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6653ee-00e4-405f-b65c-90d3a7aac9fb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:39.044991 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6d63-7e0b-4b1e-9d27-b6393fa33cca None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:39.096776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c7a90-973a-4049-b752-a6c95bed944e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:39.097438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7a90-973a-4049-b752-a6c95bed944e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:39.097724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7a90-973a-4049-b752-a6c95bed944e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:39.098001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7a90-973a-4049-b752-a6c95bed944e None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:39.098772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c7a90-973a-4049-b752-a6c95bed944e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:39.099090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c7a90-973a-4049-b752-a6c95bed944e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:39.101138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c7a90-973a-4049-b752-a6c95bed944e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:39.102815 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:39.112039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 14/28] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:11:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:39.113349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3098287-998c-4b01-b29a-5c4b1a026613 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:39.113638 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3098287-998c-4b01-b29a-5c4b1a026613 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:39.113967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3098287-998c-4b01-b29a-5c4b1a026613 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:39.118208 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 15/29] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:39.119561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192070a-2d70-4b5c-97c0-09aba5743d9f None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:39.119851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192070a-2d70-4b5c-97c0-09aba5743d9f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:39.120129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192070a-2d70-4b5c-97c0-09aba5743d9f None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:39.121450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:39.122181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192070a-2d70-4b5c-97c0-09aba5743d9f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:39.172579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5018a-1736-4b40-b842-de1275bc9445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:39.173667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5018a-1736-4b40-b842-de1275bc9445 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:39.174177 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5018a-1736-4b40-b842-de1275bc9445 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:39.174700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5018a-1736-4b40-b842-de1275bc9445 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:39.175622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5018a-1736-4b40-b842-de1275bc9445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:39.176130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5018a-1736-4b40-b842-de1275bc9445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:39.177816 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5018a-1736-4b40-b842-de1275bc9445 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:39.196328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 15/31] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:11:39.198220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349903b-aa7c-457e-b085-873a21c75168 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:39.198733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349903b-aa7c-457e-b085-873a21c75168 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:39.199234 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349903b-aa7c-457e-b085-873a21c75168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:39.219938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-f349903b-aa7c-457e-b085-873a21c75168 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:39.221625 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f349903b-aa7c-457e-b085-873a21c75168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:39.242154 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192070a-2d70-4b5c-97c0-09aba5743d9f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:39.277447 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b4434-6586-4e66-ae57-23ba55d33234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:39.278141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b4434-6586-4e66-ae57-23ba55d33234 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:39.278379 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b4434-6586-4e66-ae57-23ba55d33234 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:39.278683 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b4434-6586-4e66-ae57-23ba55d33234 None admin] PATH_INFO: `/v3/users/8c0fa3378af3402089d42ceacf7a26b5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:39.279914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b4434-6586-4e66-ae57-23ba55d33234 None admin] RBAC: Authorizing `identity:get_user(user_id=8c0fa3378af3402089d42ceacf7a26b5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:39.281361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b4434-6586-4e66-ae57-23ba55d33234 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:39.283518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 17/32] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:11:39 2022] GET /identity/v3/users/8c0fa3378af3402089d42ceacf7a26b5 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:39.284460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6746d9-830c-4d98-a13c-631925867064 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:39.284746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6746d9-830c-4d98-a13c-631925867064 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:39.285023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6746d9-830c-4d98-a13c-631925867064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:39.303477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9c6746d9-830c-4d98-a13c-631925867064 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:39.304106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 16/33] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:39.304704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9c6746d9-830c-4d98-a13c-631925867064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:39.305604 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349903b-aa7c-457e-b085-873a21c75168 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:39.385359 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:39.402771 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 18/34] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:39.403516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6746d9-830c-4d98-a13c-631925867064 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:39.423135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:39.436828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349903b-aa7c-457e-b085-873a21c75168 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:39.477614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555e11d-980c-4a8b-a742-d6d18fe722eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:39.478561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555e11d-980c-4a8b-a742-d6d18fe722eb None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:39.479069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555e11d-980c-4a8b-a742-d6d18fe722eb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:39.479649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555e11d-980c-4a8b-a742-d6d18fe722eb None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:39.480856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555e11d-980c-4a8b-a742-d6d18fe722eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:39.482641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555e11d-980c-4a8b-a742-d6d18fe722eb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:39.535149 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6746d9-830c-4d98-a13c-631925867064 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:39.573159 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fa56f-c10d-4398-af30-5433807f9919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:39.574152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa56f-c10d-4398-af30-5433807f9919 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:39.574706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa56f-c10d-4398-af30-5433807f9919 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:39.575449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa56f-c10d-4398-af30-5433807f9919 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:39.576967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fa56f-c10d-4398-af30-5433807f9919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:39.578652 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fa56f-c10d-4398-af30-5433807f9919 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:39.580531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 19/35] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:11:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:39.581480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fa56f-c10d-4398-af30-5433807f9919 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:39.625805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 17/36] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 4 22:11:39 2022] POST /identity/v3/projects => generated 301 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:11:39.626821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555e11d-980c-4a8b-a742-d6d18fe722eb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:39.663209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:39.715483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fa56f-c10d-4398-af30-5433807f9919 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:39.766655 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2b91a-49d7-467f-a668-674d119f4eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:39.767974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b91a-49d7-467f-a668-674d119f4eb9 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:39.768719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b91a-49d7-467f-a668-674d119f4eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:39.769202 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b91a-49d7-467f-a668-674d119f4eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:39.771027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2b91a-49d7-467f-a668-674d119f4eb9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:39.773417 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2b91a-49d7-467f-a668-674d119f4eb9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:39.780075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555e11d-980c-4a8b-a742-d6d18fe722eb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:39.821245 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dd229-2f5e-4f05-859e-b4ca4be1f193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:39.822180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dd229-2f5e-4f05-859e-b4ca4be1f193 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:39.822683 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dd229-2f5e-4f05-859e-b4ca4be1f193 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:39.823141 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dd229-2f5e-4f05-859e-b4ca4be1f193 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:39.824086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11dd229-2f5e-4f05-859e-b4ca4be1f193 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:39.826100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11dd229-2f5e-4f05-859e-b4ca4be1f193 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:39.841088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:39.847797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Aug 4 22:11:39 2022] POST /identity/v3/roles => generated 225 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:11:39.848750 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dd229-2f5e-4f05-859e-b4ca4be1f193 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:39.922777 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 20/38] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Aug 4 22:11:39 2022] POST /identity/v3/roles => generated 219 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:11:39.924615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c275c-6ebe-4538-a92b-412ffacd7af5 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:39.925129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c275c-6ebe-4538-a92b-412ffacd7af5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:39.925623 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c275c-6ebe-4538-a92b-412ffacd7af5 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:39.927216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 21/39] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:39.934218 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345039-6683-4b5a-8c57-31f2a5dc6386 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:39.934904 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345039-6683-4b5a-8c57-31f2a5dc6386 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:39.935384 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345039-6683-4b5a-8c57-31f2a5dc6386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:39.975806 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-12345039-6683-4b5a-8c57-31f2a5dc6386 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:39.977766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-12345039-6683-4b5a-8c57-31f2a5dc6386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:39.992040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dd229-2f5e-4f05-859e-b4ca4be1f193 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:40.037826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66c722-7e4e-4665-a3f9-828e73b77ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:40.039542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66c722-7e4e-4665-a3f9-828e73b77ae9 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:40.039831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66c722-7e4e-4665-a3f9-828e73b77ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:40.040114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66c722-7e4e-4665-a3f9-828e73b77ae9 None admin] PATH_INFO: `/v3/domains/default/users/8c0fa3378af3402089d42ceacf7a26b5/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:40.043644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66c722-7e4e-4665-a3f9-828e73b77ae9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8c0fa3378af3402089d42ceacf7a26b5, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:40.045171 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66c722-7e4e-4665-a3f9-828e73b77ae9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:40.086553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 19/40] 10.222.0.27 () {58 vars in 1361 bytes} [Thu Aug 4 22:11:39 2022] PUT /identity/v3/domains/default/users/8c0fa3378af3402089d42ceacf7a26b5/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:11:40.088352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c7fd-859a-4aea-8852-36adc9293cfd None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:40.088764 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c7fd-859a-4aea-8852-36adc9293cfd None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:40.089065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1c7fd-859a-4aea-8852-36adc9293cfd None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:40.090675 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 20/41] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:40.096915 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d11d79-88fe-4266-8025-cab4c13b3415 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:40.097289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d11d79-88fe-4266-8025-cab4c13b3415 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:40.097640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d11d79-88fe-4266-8025-cab4c13b3415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:40.122281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-09d11d79-88fe-4266-8025-cab4c13b3415 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:40.122281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-09d11d79-88fe-4266-8025-cab4c13b3415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:40.125725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 22/42] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:40.150748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12345039-6683-4b5a-8c57-31f2a5dc6386 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:40.198123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:40.211146 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 21/43] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:11:40.232329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:40.235331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d11d79-88fe-4266-8025-cab4c13b3415 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:40.288779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12345039-6683-4b5a-8c57-31f2a5dc6386 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:40.326893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259bdee-9a1d-46ee-bbc9-fb8cfa77b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:40.327620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259bdee-9a1d-46ee-bbc9-fb8cfa77b7b5 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:40.327918 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259bdee-9a1d-46ee-bbc9-fb8cfa77b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:40.328204 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259bdee-9a1d-46ee-bbc9-fb8cfa77b7b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:40.328933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259bdee-9a1d-46ee-bbc9-fb8cfa77b7b5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:40.330492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259bdee-9a1d-46ee-bbc9-fb8cfa77b7b5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:40.348280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Aug 4 22:11:40 2022] POST /identity/v3/roles => generated 223 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:11:40.361645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d11d79-88fe-4266-8025-cab4c13b3415 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:40.401083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c314e4-544d-4f64-aaba-84d5a8520f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:40.401762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c314e4-544d-4f64-aaba-84d5a8520f38 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:40.402048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c314e4-544d-4f64-aaba-84d5a8520f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:40.402325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c314e4-544d-4f64-aaba-84d5a8520f38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:40.403621 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c314e4-544d-4f64-aaba-84d5a8520f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:40.405196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c314e4-544d-4f64-aaba-84d5a8520f38 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:40.406992 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 22/45] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:11:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:40.413418 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259bdee-9a1d-46ee-bbc9-fb8cfa77b7b5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:40.529444 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259bdee-9a1d-46ee-bbc9-fb8cfa77b7b5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:40.544023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:40.569748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cdd0b-02a6-4517-8c69-465ca4a9440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:40.570381 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cdd0b-02a6-4517-8c69-465ca4a9440b None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:40.570698 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cdd0b-02a6-4517-8c69-465ca4a9440b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:40.570980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cdd0b-02a6-4517-8c69-465ca4a9440b None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:40.571686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cdd0b-02a6-4517-8c69-465ca4a9440b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:40.573168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cdd0b-02a6-4517-8c69-465ca4a9440b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:40.602784 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 4 22:11:40 2022] POST /identity/v3/projects => generated 312 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:11:42.150864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645371f2-2496-45ac-b4ce-0fcc023e9edd None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:42.151409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645371f2-2496-45ac-b4ce-0fcc023e9edd None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:42.151409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645371f2-2496-45ac-b4ce-0fcc023e9edd None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:42.152898 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 23/47] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:42.158201 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c66a9b-4fb5-4479-b09a-1acc98997cc6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:42.158687 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c66a9b-4fb5-4479-b09a-1acc98997cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:42.158876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c66a9b-4fb5-4479-b09a-1acc98997cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:42.176789 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-87c66a9b-4fb5-4479-b09a-1acc98997cc6 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:42.177979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-87c66a9b-4fb5-4479-b09a-1acc98997cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:42.243806 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 25/48] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:42.266607 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645371f2-2496-45ac-b4ce-0fcc023e9edd None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:42.328029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:42.370215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645371f2-2496-45ac-b4ce-0fcc023e9edd None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:42.403190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c04f43-1923-4255-b731-6f7f9eb2d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:42.403761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04f43-1923-4255-b731-6f7f9eb2d196 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:42.404049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04f43-1923-4255-b731-6f7f9eb2d196 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:42.404330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04f43-1923-4255-b731-6f7f9eb2d196 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:42.415942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c04f43-1923-4255-b731-6f7f9eb2d196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-71c04f43-1923-4255-b731-6f7f9eb2d196 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:11:42.422356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:42.423353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:42.424221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:42.424221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:42.424221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:42.424221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:42.424221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:11:42.424221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:11:42.424221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:11:42.424221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:11:42.424221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:11:42.424221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:11:42.424221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:11:42.424221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:11:42.424221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 24/49] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:11:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:11:42.430074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c66a9b-4fb5-4479-b09a-1acc98997cc6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:42.525368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:42.533315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c66a9b-4fb5-4479-b09a-1acc98997cc6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:42.568530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5228261-39f4-4523-a88b-0a47658bced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:42.569188 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5228261-39f4-4523-a88b-0a47658bced9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:42.569479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5228261-39f4-4523-a88b-0a47658bced9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:42.569769 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5228261-39f4-4523-a88b-0a47658bced9 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:42.570518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5228261-39f4-4523-a88b-0a47658bced9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:42.570833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5228261-39f4-4523-a88b-0a47658bced9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:42.572231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5228261-39f4-4523-a88b-0a47658bced9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:42.580998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 26/50] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:11:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:42.586460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c04f43-1923-4255-b731-6f7f9eb2d196 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:42.612767 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b69d1b-6694-4e45-a180-bef2dd454e16 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:42.613082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b69d1b-6694-4e45-a180-bef2dd454e16 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:42.613364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b69d1b-6694-4e45-a180-bef2dd454e16 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:42.614730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 27/51] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:11:42.620091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a06126-3f37-4af9-baf3-9042e3abfacd None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:42.620377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a06126-3f37-4af9-baf3-9042e3abfacd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:42.620652 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a06126-3f37-4af9-baf3-9042e3abfacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:42.638189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f3a06126-3f37-4af9-baf3-9042e3abfacd None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:42.639599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f3a06126-3f37-4af9-baf3-9042e3abfacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:42.686703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c04f43-1923-4255-b731-6f7f9eb2d196 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:42.703973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:42.705627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 28/52] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:11:42.721380 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c54d55-842a-40dd-b049-704a99a5b1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:42.722023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54d55-842a-40dd-b049-704a99a5b1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:42.722307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54d55-842a-40dd-b049-704a99a5b1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:42.722615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54d55-842a-40dd-b049-704a99a5b1c0 None admin] PATH_INFO: `/v3/users/8c0fa3378af3402089d42ceacf7a26b5` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:42.723768 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c54d55-842a-40dd-b049-704a99a5b1c0 None admin] RBAC: Authorizing `identity:get_user(user_id=8c0fa3378af3402089d42ceacf7a26b5)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:42.725215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c54d55-842a-40dd-b049-704a99a5b1c0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:42.727400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 25/53] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:11:42 2022] GET /identity/v3/users/8c0fa3378af3402089d42ceacf7a26b5 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:11:42.729472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a06126-3f37-4af9-baf3-9042e3abfacd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:42.732520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c54d55-842a-40dd-b049-704a99a5b1c0 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:42.820338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:42.836225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a06126-3f37-4af9-baf3-9042e3abfacd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:42.841720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c54d55-842a-40dd-b049-704a99a5b1c0 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:42.869092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be14fa3-c469-4f9a-b991-353952b36f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:42.869735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14fa3-c469-4f9a-b991-353952b36f62 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:42.870014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14fa3-c469-4f9a-b991-353952b36f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:42.870289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14fa3-c469-4f9a-b991-353952b36f62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:42.871455 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be14fa3-c469-4f9a-b991-353952b36f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:42.872902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be14fa3-c469-4f9a-b991-353952b36f62 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:42.874496 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 29/54] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:11:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:42.875317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0b25a-5b41-4d7d-a9c7-3b4c193223eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:42.875998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b25a-5b41-4d7d-a9c7-3b4c193223eb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:42.876289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b25a-5b41-4d7d-a9c7-3b4c193223eb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:42.876574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b25a-5b41-4d7d-a9c7-3b4c193223eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:42.877725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0b25a-5b41-4d7d-a9c7-3b4c193223eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:42.879287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0b25a-5b41-4d7d-a9c7-3b4c193223eb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:42.880087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be14fa3-c469-4f9a-b991-353952b36f62 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:42.880817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 26/55] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:11:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:11:42.886275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0b25a-5b41-4d7d-a9c7-3b4c193223eb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:42.939266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:42.979807 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be14fa3-c469-4f9a-b991-353952b36f62 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:42.983908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0b25a-5b41-4d7d-a9c7-3b4c193223eb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:43.012810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193eaec8-6683-4a4f-a71b-f6909886f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:43.013426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eaec8-6683-4a4f-a71b-f6909886f54e None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:43.013706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eaec8-6683-4a4f-a71b-f6909886f54e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:43.013979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eaec8-6683-4a4f-a71b-f6909886f54e None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:43.014723 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193eaec8-6683-4a4f-a71b-f6909886f54e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:43.016172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193eaec8-6683-4a4f-a71b-f6909886f54e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:43.016288 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814ce3-4a69-4b15-9786-6f89897c9b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:43.016843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814ce3-4a69-4b15-9786-6f89897c9b8a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:43.017131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814ce3-4a69-4b15-9786-6f89897c9b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:43.017413 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814ce3-4a69-4b15-9786-6f89897c9b8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:43.018206 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814ce3-4a69-4b15-9786-6f89897c9b8a None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.domain.id=default, user.id=8c0fa3378af3402089d42ceacf7a26b5) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:43.018560 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814ce3-4a69-4b15-9786-6f89897c9b8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:43.019975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814ce3-4a69-4b15-9786-6f89897c9b8a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:43.029932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 27/56] 10.222.0.27 () {56 vars in 1322 bytes} [Thu Aug 4 22:11:42 2022] GET /identity/v3/role_assignments?user.id=8c0fa3378af3402089d42ceacf7a26b5&scope.domain.id=default&role.id=0053c24ce06147938dbb61657a531c94 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:11:43.042745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 30/57] 10.222.0.27 () {60 vars in 1140 bytes} [Thu Aug 4 22:11:42 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:11:45.025612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345064-6db3-43f3-85f7-b3d285f214b6 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:45.026124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345064-6db3-43f3-85f7-b3d285f214b6 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:45.026206 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345064-6db3-43f3-85f7-b3d285f214b6 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:45.027578 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 28/58] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:45.032753 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43ada6-6eed-4b7b-9b38-7e188a6f405d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:45.033182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43ada6-6eed-4b7b-9b38-7e188a6f405d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:45.033316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43ada6-6eed-4b7b-9b38-7e188a6f405d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:45.046178 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:45.051482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6d43ada6-6eed-4b7b-9b38-7e188a6f405d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:45.053060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6d43ada6-6eed-4b7b-9b38-7e188a6f405d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:45.118199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 31/59] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:45.141974 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3345064-6db3-43f3-85f7-b3d285f214b6 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:45.238590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3345064-6db3-43f3-85f7-b3d285f214b6 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:45.254997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:45.271602 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcd0ab-2ad7-4401-a9fd-d56bf7d75dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:45.272259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd0ab-2ad7-4401-a9fd-d56bf7d75dcb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:45.272544 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd0ab-2ad7-4401-a9fd-d56bf7d75dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:45.272821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd0ab-2ad7-4401-a9fd-d56bf7d75dcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:45.273950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcd0ab-2ad7-4401-a9fd-d56bf7d75dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:45.275431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcd0ab-2ad7-4401-a9fd-d56bf7d75dcb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:45.277027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 29/60] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:11:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:45.282543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43ada6-6eed-4b7b-9b38-7e188a6f405d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:45.385325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43ada6-6eed-4b7b-9b38-7e188a6f405d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:45.418704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6e032-7ebe-4b37-b82c-296630876af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:45.419323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6e032-7ebe-4b37-b82c-296630876af0 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:45.419609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6e032-7ebe-4b37-b82c-296630876af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:45.419889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6e032-7ebe-4b37-b82c-296630876af0 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:45.420583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6e032-7ebe-4b37-b82c-296630876af0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:45.422042 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6e032-7ebe-4b37-b82c-296630876af0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:45.434048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:45.449252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 32/61] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:11:45 2022] POST /identity/v3/users => generated 275 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:11:48.526176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72232ef-719f-4835-89d4-55ac42f56d27 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:48.527189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72232ef-719f-4835-89d4-55ac42f56d27 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:48.527702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72232ef-719f-4835-89d4-55ac42f56d27 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:48.529593 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 30/62] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:48.534616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186788-4ff6-49bd-bfd0-b0d006da49c8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:48.535465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186788-4ff6-49bd-bfd0-b0d006da49c8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:48.535965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a186788-4ff6-49bd-bfd0-b0d006da49c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:48.563443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8a186788-4ff6-49bd-bfd0-b0d006da49c8 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:48.564997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8a186788-4ff6-49bd-bfd0-b0d006da49c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:48.648785 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 33/63] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:48.692417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72232ef-719f-4835-89d4-55ac42f56d27 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:48.741317 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e7f01-f4e6-4272-ba6a-a58baec106f7 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:48.741929 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e7f01-f4e6-4272-ba6a-a58baec106f7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:48.742432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e7f01-f4e6-4272-ba6a-a58baec106f7 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:48.744001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 34/64] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:48.749230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde4eb-27a9-4388-aac8-dece05c0c27f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:48.749847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde4eb-27a9-4388-aac8-dece05c0c27f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:48.750326 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde4eb-27a9-4388-aac8-dece05c0c27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:48.782846 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7dcde4eb-27a9-4388-aac8-dece05c0c27f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:48.784060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7dcde4eb-27a9-4388-aac8-dece05c0c27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:48.837588 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72232ef-719f-4835-89d4-55ac42f56d27 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:48.874280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 35/65] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:11:48.875749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772264d-c400-439e-a91e-55d12b23db54 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:48.876231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772264d-c400-439e-a91e-55d12b23db54 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:48.876712 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772264d-c400-439e-a91e-55d12b23db54 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:48.878219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 36/66] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:48.880944 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aacdd2-e046-4ccf-8c83-54bda9d76d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:48.881875 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aacdd2-e046-4ccf-8c83-54bda9d76d0e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:48.882537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aacdd2-e046-4ccf-8c83-54bda9d76d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:48.883019 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aacdd2-e046-4ccf-8c83-54bda9d76d0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:48.883612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a1dc-ea3f-45c3-918e-b06dd6484d36 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:48.883909 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a1dc-ea3f-45c3-918e-b06dd6484d36 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:48.884191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a1dc-ea3f-45c3-918e-b06dd6484d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:48.895626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aacdd2-e046-4ccf-8c83-54bda9d76d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d8aacdd2-e046-4ccf-8c83-54bda9d76d0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:11:48.901550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:48.902427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:48.903275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:48.903275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:48.903275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:48.903275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:48.903275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:11:48.903275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:11:48.903275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:11:48.903275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:11:48.903275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:11:48.903275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:11:48.903275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:11:48.903275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:11:48.903847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b1f0a1dc-ea3f-45c3-918e-b06dd6484d36 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:48.904685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b1f0a1dc-ea3f-45c3-918e-b06dd6484d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:48.905827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 31/67] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:11:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:11:48.913689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aacdd2-e046-4ccf-8c83-54bda9d76d0e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:48.962613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:48.978167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:48.980926 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 37/68] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:11:48.990742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a1dc-ea3f-45c3-918e-b06dd6484d36 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:49.019902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aacdd2-e046-4ccf-8c83-54bda9d76d0e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:49.059282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32667a8d-6df4-4449-b217-f0dc769d0c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:49.060293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32667a8d-6df4-4449-b217-f0dc769d0c56 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.060784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32667a8d-6df4-4449-b217-f0dc769d0c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.061270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32667a8d-6df4-4449-b217-f0dc769d0c56 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.062276 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32667a8d-6df4-4449-b217-f0dc769d0c56 None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:49.062845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32667a8d-6df4-4449-b217-f0dc769d0c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:49.064450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32667a8d-6df4-4449-b217-f0dc769d0c56 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:49.078162 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 32/69] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:11:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:49.079582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32667a8d-6df4-4449-b217-f0dc769d0c56 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:49.120927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a1dc-ea3f-45c3-918e-b06dd6484d36 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:49.158473 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94f2d2-fda2-4292-a4ec-ff155e0550fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:49.159135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94f2d2-fda2-4292-a4ec-ff155e0550fa None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.159425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94f2d2-fda2-4292-a4ec-ff155e0550fa None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.159707 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94f2d2-fda2-4292-a4ec-ff155e0550fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.171227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94f2d2-fda2-4292-a4ec-ff155e0550fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-dd94f2d2-fda2-4292-a4ec-ff155e0550fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:11:49.176734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:49.177568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:49.178313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:49.178313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:49.178313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:49.178313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:49.178313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:11:49.178313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:11:49.178313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:11:49.178313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:11:49.178313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:11:49.178313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:11:49.178313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:11:49.178313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:11:49.178313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 38/70] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:11:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:11:49.179565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94f2d2-fda2-4292-a4ec-ff155e0550fa None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:49.189452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32667a8d-6df4-4449-b217-f0dc769d0c56 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:49.200334 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:49.224289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:49.227104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b353b2-1558-42c6-9961-54f97240e760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:49.227754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b353b2-1558-42c6-9961-54f97240e760 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.228036 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b353b2-1558-42c6-9961-54f97240e760 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.228316 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b353b2-1558-42c6-9961-54f97240e760 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.238128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b353b2-1558-42c6-9961-54f97240e760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-f9b353b2-1558-42c6-9961-54f97240e760 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:11:49.243050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:49.243896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:49.244635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:49.244635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:49.244635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:49.244635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:49.244635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:11:49.244635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:11:49.244635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:11:49.244635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:11:49.244635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:11:49.244635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:11:49.244635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:11:49.244635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:11:49.244635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 33/71] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:11:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:11:49.245578 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd84b35-2809-46d5-aa47-a704795c54a1 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.245737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd84b35-2809-46d5-aa47-a704795c54a1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.246022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd84b35-2809-46d5-aa47-a704795c54a1 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.247287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 34/72] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:49.250516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd84b35-2809-46d5-aa47-a704795c54a1 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:49.285964 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94f2d2-fda2-4292-a4ec-ff155e0550fa None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:49.319573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee55e16-4706-46ed-9354-55d474eae4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:49.320228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee55e16-4706-46ed-9354-55d474eae4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.320517 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee55e16-4706-46ed-9354-55d474eae4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.320797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee55e16-4706-46ed-9354-55d474eae4a3 None admin] PATH_INFO: `/v3/users/cc4961f214f64c8f9d7137d2763ee3e7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.335645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee55e16-4706-46ed-9354-55d474eae4a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4961f214f64c8f9d7137d2763ee3e7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:49.337139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee55e16-4706-46ed-9354-55d474eae4a3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:49.338806 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 39/73] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:11:49 2022] GET /identity/v3/users/cc4961f214f64c8f9d7137d2763ee3e7 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:49.339968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd903d8-68b1-4c3d-b78e-70a181a2e51c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.340261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd903d8-68b1-4c3d-b78e-70a181a2e51c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.340563 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd903d8-68b1-4c3d-b78e-70a181a2e51c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.341900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 40/74] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:49.342580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd903d8-68b1-4c3d-b78e-70a181a2e51c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:49.350893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd84b35-2809-46d5-aa47-a704795c54a1 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:49.384639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5051cc-ab5c-4534-a4c6-b5f5b4ad16a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:49.385267 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5051cc-ab5c-4534-a4c6-b5f5b4ad16a2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.385554 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5051cc-ab5c-4534-a4c6-b5f5b4ad16a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.385857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5051cc-ab5c-4534-a4c6-b5f5b4ad16a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.386587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5051cc-ab5c-4534-a4c6-b5f5b4ad16a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:49.386901 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5051cc-ab5c-4534-a4c6-b5f5b4ad16a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:49.388275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5051cc-ab5c-4534-a4c6-b5f5b4ad16a2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:49.396525 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 35/75] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:11:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:49.398299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24b10f-5813-417f-86ec-7111c630bffa None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.398640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24b10f-5813-417f-86ec-7111c630bffa None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.398933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24b10f-5813-417f-86ec-7111c630bffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.416720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-7a24b10f-5813-417f-86ec-7111c630bffa None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:49.417933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7a24b10f-5813-417f-86ec-7111c630bffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:49.439680 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:49.442201 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:49.443745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd903d8-68b1-4c3d-b78e-70a181a2e51c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:49.479735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86333fc5-0d5b-4ab8-92da-c02815c97f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:49.480352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86333fc5-0d5b-4ab8-92da-c02815c97f77 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.480633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86333fc5-0d5b-4ab8-92da-c02815c97f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.480904 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86333fc5-0d5b-4ab8-92da-c02815c97f77 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.481609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86333fc5-0d5b-4ab8-92da-c02815c97f77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:49.481915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86333fc5-0d5b-4ab8-92da-c02815c97f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:49.483314 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86333fc5-0d5b-4ab8-92da-c02815c97f77 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:49.486149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 36/76] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:49.488630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24b10f-5813-417f-86ec-7111c630bffa None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:49.492083 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 41/77] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:11:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:49.493583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692d4c-3be3-4069-9c33-bf3f34bbbed9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.493897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692d4c-3be3-4069-9c33-bf3f34bbbed9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.494153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3692d4c-3be3-4069-9c33-bf3f34bbbed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.512277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e3692d4c-3be3-4069-9c33-bf3f34bbbed9 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:49.513492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e3692d4c-3be3-4069-9c33-bf3f34bbbed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:49.581235 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 42/78] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:49.595061 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3692d4c-3be3-4069-9c33-bf3f34bbbed9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:49.595154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24b10f-5813-417f-86ec-7111c630bffa None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:49.623664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e41f5e-d7ef-4e62-9047-9e9d9e868ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:49.624295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e41f5e-d7ef-4e62-9047-9e9d9e868ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.624581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e41f5e-d7ef-4e62-9047-9e9d9e868ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.624860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e41f5e-d7ef-4e62-9047-9e9d9e868ab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.652301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:49.672361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:49.682015 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3692d4c-3be3-4069-9c33-bf3f34bbbed9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:49.691951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e41f5e-d7ef-4e62-9047-9e9d9e868ab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:49.693445 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e41f5e-d7ef-4e62-9047-9e9d9e868ab8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:49.715457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35285067-2dd8-4ad4-b795-cb24770313e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:49.716100 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35285067-2dd8-4ad4-b795-cb24770313e7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.716390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35285067-2dd8-4ad4-b795-cb24770313e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.716669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35285067-2dd8-4ad4-b795-cb24770313e7 None admin] PATH_INFO: `/v3/users/cc4961f214f64c8f9d7137d2763ee3e7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.717840 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35285067-2dd8-4ad4-b795-cb24770313e7 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4961f214f64c8f9d7137d2763ee3e7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:49.719437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35285067-2dd8-4ad4-b795-cb24770313e7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:49.721055 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 43/79] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:11:49 2022] GET /identity/v3/users/cc4961f214f64c8f9d7137d2763ee3e7 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:49.723726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35285067-2dd8-4ad4-b795-cb24770313e7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:49.792744 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 37/80] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:11:49.797721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e41f5e-d7ef-4e62-9047-9e9d9e868ab8 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:49.822188 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35285067-2dd8-4ad4-b795-cb24770313e7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:49.853236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:49.855407 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236b3ee-3b71-43b3-861a-72f13ae220c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:49.856047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236b3ee-3b71-43b3-861a-72f13ae220c5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.856328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236b3ee-3b71-43b3-861a-72f13ae220c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.856596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236b3ee-3b71-43b3-861a-72f13ae220c5 None admin] PATH_INFO: `/v3/users/8c0fa3378af3402089d42ceacf7a26b5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.857755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236b3ee-3b71-43b3-861a-72f13ae220c5 None admin] RBAC: Authorizing `identity:get_user(user_id=8c0fa3378af3402089d42ceacf7a26b5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:49.859249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236b3ee-3b71-43b3-861a-72f13ae220c5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:49.861026 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 44/81] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:11:49 2022] GET /identity/v3/users/8c0fa3378af3402089d42ceacf7a26b5 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:49.861603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236b3ee-3b71-43b3-861a-72f13ae220c5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:49.888890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:49.895060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e41f5e-d7ef-4e62-9047-9e9d9e868ab8 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:49.928202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5e3f3-c1d9-4f69-b161-14c4c91a642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:49.929428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5e3f3-c1d9-4f69-b161-14c4c91a642d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.929708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5e3f3-c1d9-4f69-b161-14c4c91a642d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.929979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5e3f3-c1d9-4f69-b161-14c4c91a642d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.940314 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5e3f3-c1d9-4f69-b161-14c4c91a642d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-bea5e3f3-c1d9-4f69-b161-14c4c91a642d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:11:49.945284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:49.946223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:49.946997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:49.946997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:49.946997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:49.946997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:49.946997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:11:49.946997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:11:49.946997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:11:49.946997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:11:49.946997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:11:49.946997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:11:49.946997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:11:49.946997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:11:49.946997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 38/82] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:11:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:11:49.947630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5e3f3-c1d9-4f69-b161-14c4c91a642d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:49.960505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236b3ee-3b71-43b3-861a-72f13ae220c5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:49.993816 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbb645-e253-4f92-a17d-9957567b228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:49.994473 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbb645-e253-4f92-a17d-9957567b228b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:49.994757 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbb645-e253-4f92-a17d-9957567b228b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:49.995032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbb645-e253-4f92-a17d-9957567b228b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:49.996165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbb645-e253-4f92-a17d-9957567b228b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:49.997616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbb645-e253-4f92-a17d-9957567b228b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:49.999239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 45/83] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:11:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:49.999989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbb645-e253-4f92-a17d-9957567b228b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:50.049619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5e3f3-c1d9-4f69-b161-14c4c91a642d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:50.070123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:50.084720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4ab4c-1e3f-4df7-b0a1-b83c77c028c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:50.085346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4ab4c-1e3f-4df7-b0a1-b83c77c028c3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:50.085631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4ab4c-1e3f-4df7-b0a1-b83c77c028c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:50.085913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4ab4c-1e3f-4df7-b0a1-b83c77c028c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:50.089655 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:50.096659 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbb645-e253-4f92-a17d-9957567b228b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:50.132863 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f28ff-c2e3-4c8b-91a5-8ebb7ca34e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:50.133438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f28ff-c2e3-4c8b-91a5-8ebb7ca34e12 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:50.133722 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f28ff-c2e3-4c8b-91a5-8ebb7ca34e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:50.134001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f28ff-c2e3-4c8b-91a5-8ebb7ca34e12 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:50.135187 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f28ff-c2e3-4c8b-91a5-8ebb7ca34e12 None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:50.136644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f28ff-c2e3-4c8b-91a5-8ebb7ca34e12 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:50.138305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 46/84] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:11:49 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:50.139092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f28ff-c2e3-4c8b-91a5-8ebb7ca34e12 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:50.155207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4ab4c-1e3f-4df7-b0a1-b83c77c028c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:50.156657 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4ab4c-1e3f-4df7-b0a1-b83c77c028c3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:50.236822 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f28ff-c2e3-4c8b-91a5-8ebb7ca34e12 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:50.253991 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 39/85] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:11:50.254892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4ab4c-1e3f-4df7-b0a1-b83c77c028c3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:50.272817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587171d-55f4-4361-8122-d1f9500f2ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:50.273434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587171d-55f4-4361-8122-d1f9500f2ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:50.273717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587171d-55f4-4361-8122-d1f9500f2ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:50.273990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587171d-55f4-4361-8122-d1f9500f2ad4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:50.275285 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:50.304341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:50.341532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587171d-55f4-4361-8122-d1f9500f2ad4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:50.343249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587171d-55f4-4361-8122-d1f9500f2ad4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:50.354013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4ab4c-1e3f-4df7-b0a1-b83c77c028c3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:50.387156 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fcb8b-543b-4f86-8a96-9a635c1c07d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:50.387712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fcb8b-543b-4f86-8a96-9a635c1c07d1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:50.387989 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fcb8b-543b-4f86-8a96-9a635c1c07d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:50.388259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fcb8b-543b-4f86-8a96-9a635c1c07d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:50.388965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fcb8b-543b-4f86-8a96-9a635c1c07d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:50.389270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fcb8b-543b-4f86-8a96-9a635c1c07d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:50.390684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fcb8b-543b-4f86-8a96-9a635c1c07d1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:50.399758 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 40/86] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:11:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:50.400401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fcb8b-543b-4f86-8a96-9a635c1c07d1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:50.441269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 47/87] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:11:50.442124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587171d-55f4-4361-8122-d1f9500f2ad4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:50.485036 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:50.504242 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fcb8b-543b-4f86-8a96-9a635c1c07d1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:50.510223 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:50.540749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985ba32-5774-475e-b8a9-9a2d175c6f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:50.541550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985ba32-5774-475e-b8a9-9a2d175c6f0a None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:50.541967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985ba32-5774-475e-b8a9-9a2d175c6f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:50.542336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985ba32-5774-475e-b8a9-9a2d175c6f0a None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:50.543057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985ba32-5774-475e-b8a9-9a2d175c6f0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:50.544504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985ba32-5774-475e-b8a9-9a2d175c6f0a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:50.548850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587171d-55f4-4361-8122-d1f9500f2ad4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:50.581661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 41/88] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:11:50 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:11:50.581661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985ba32-5774-475e-b8a9-9a2d175c6f0a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:50.585389 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150974c-4e8d-4766-a66a-88ebb0bdf0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:50.586046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150974c-4e8d-4766-a66a-88ebb0bdf0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:50.586335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150974c-4e8d-4766-a66a-88ebb0bdf0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:50.586651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150974c-4e8d-4766-a66a-88ebb0bdf0e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:50.587528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150974c-4e8d-4766-a66a-88ebb0bdf0e2 None admin] RBAC: Adding query filter params (role.id=d295e312e144479ca8f748650ac995a4, scope.project.id=7bd58a62525c46c888f56577918c1637, user.id=cc4961f214f64c8f9d7137d2763ee3e7) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:50.587860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150974c-4e8d-4766-a66a-88ebb0bdf0e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:50.589390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150974c-4e8d-4766-a66a-88ebb0bdf0e2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:50.595756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 48/89] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:11:50 2022] GET /identity/v3/role_assignments?user.id=cc4961f214f64c8f9d7137d2763ee3e7&scope.project.id=7bd58a62525c46c888f56577918c1637&role.id=d295e312e144479ca8f748650ac995a4 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:50.596625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150974c-4e8d-4766-a66a-88ebb0bdf0e2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:50.724702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985ba32-5774-475e-b8a9-9a2d175c6f0a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:50.768705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150974c-4e8d-4766-a66a-88ebb0bdf0e2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:50.775480 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23ed39-db94-4ad6-98bf-f2e0d8e37acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:50.776150 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23ed39-db94-4ad6-98bf-f2e0d8e37acc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:50.776438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23ed39-db94-4ad6-98bf-f2e0d8e37acc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:50.776719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23ed39-db94-4ad6-98bf-f2e0d8e37acc None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:50.778006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23ed39-db94-4ad6-98bf-f2e0d8e37acc None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:50.780337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23ed39-db94-4ad6-98bf-f2e0d8e37acc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:50.781532 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 42/90] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:11:50 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:50.782364 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23ed39-db94-4ad6-98bf-f2e0d8e37acc None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:50.793574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:50.802203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:50.813349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9c956-0c48-4888-a2bd-9f885f99dccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:50.814007 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9c956-0c48-4888-a2bd-9f885f99dccf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:50.814292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9c956-0c48-4888-a2bd-9f885f99dccf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:50.814648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9c956-0c48-4888-a2bd-9f885f99dccf None admin] PATH_INFO: `/v3/users/cc4961f214f64c8f9d7137d2763ee3e7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:50.816787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9c956-0c48-4888-a2bd-9f885f99dccf None admin] RBAC: Authorizing `identity:get_user(user_id=cc4961f214f64c8f9d7137d2763ee3e7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:50.817240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9c956-0c48-4888-a2bd-9f885f99dccf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:50.821271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 49/91] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:11:50 2022] GET /identity/v3/users/cc4961f214f64c8f9d7137d2763ee3e7 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:50.821271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9c956-0c48-4888-a2bd-9f885f99dccf None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:50.918810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23ed39-db94-4ad6-98bf-f2e0d8e37acc None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:50.954736 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9c956-0c48-4888-a2bd-9f885f99dccf None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:50.968433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac71752-ff08-4f9c-a28b-f71bc50a1a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:50.968433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac71752-ff08-4f9c-a28b-f71bc50a1a55 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:50.968706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac71752-ff08-4f9c-a28b-f71bc50a1a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:50.968773 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac71752-ff08-4f9c-a28b-f71bc50a1a55 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:50.971836 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac71752-ff08-4f9c-a28b-f71bc50a1a55 None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:50.973521 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac71752-ff08-4f9c-a28b-f71bc50a1a55 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:50.976502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 43/92] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:11:50 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:50.977053 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac71752-ff08-4f9c-a28b-f71bc50a1a55 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:50.999045 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ecd5b-684f-4be2-9303-bf38dad5080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:50.999696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ecd5b-684f-4be2-9303-bf38dad5080b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:51.000024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ecd5b-684f-4be2-9303-bf38dad5080b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:51.000305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ecd5b-684f-4be2-9303-bf38dad5080b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:51.001099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ecd5b-684f-4be2-9303-bf38dad5080b None admin] RBAC: Adding query filter params (role.id=b371b8f12e7348e8b01784eeddeca2ac, scope.project.id=7bd58a62525c46c888f56577918c1637, user.id=cc4961f214f64c8f9d7137d2763ee3e7) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:51.001465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ecd5b-684f-4be2-9303-bf38dad5080b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:51.002960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ecd5b-684f-4be2-9303-bf38dad5080b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:51.010509 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 50/93] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:11:50 2022] GET /identity/v3/role_assignments?user.id=cc4961f214f64c8f9d7137d2763ee3e7&scope.project.id=7bd58a62525c46c888f56577918c1637&role.id=b371b8f12e7348e8b01784eeddeca2ac => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:51.011752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ecd5b-684f-4be2-9303-bf38dad5080b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:51.078863 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:51.094912 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:51.112919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac71752-ff08-4f9c-a28b-f71bc50a1a55 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:51.146947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ecd5b-684f-4be2-9303-bf38dad5080b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:51.169031 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20671526-4e24-4122-b07b-56b122d647d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:51.169688 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20671526-4e24-4122-b07b-56b122d647d5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:51.169976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20671526-4e24-4122-b07b-56b122d647d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:51.170257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20671526-4e24-4122-b07b-56b122d647d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:51.220628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b4c5d-5589-4331-8f1d-5e77350784d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:51.221627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b4c5d-5589-4331-8f1d-5e77350784d2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:51.222112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b4c5d-5589-4331-8f1d-5e77350784d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:51.222613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b4c5d-5589-4331-8f1d-5e77350784d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:51.223626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b4c5d-5589-4331-8f1d-5e77350784d2 None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=7bd58a62525c46c888f56577918c1637, user.id=8c0fa3378af3402089d42ceacf7a26b5) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:51.224205 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b4c5d-5589-4331-8f1d-5e77350784d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:51.232803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b4c5d-5589-4331-8f1d-5e77350784d2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:51.238617 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 51/94] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:11:51 2022] GET /identity/v3/role_assignments?user.id=8c0fa3378af3402089d42ceacf7a26b5&scope.project.id=7bd58a62525c46c888f56577918c1637&role.id=0053c24ce06147938dbb61657a531c94 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:51.308854 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20671526-4e24-4122-b07b-56b122d647d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:51.310479 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20671526-4e24-4122-b07b-56b122d647d5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:51.422562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:51.457874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 44/95] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:11:51.463465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b4c5d-5589-4331-8f1d-5e77350784d2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:51.594832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b4c5d-5589-4331-8f1d-5e77350784d2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:51.624759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:51.636519 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cc25b-d4e4-452f-a7f2-960324d259d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:51.637180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc25b-d4e4-452f-a7f2-960324d259d8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:51.637471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc25b-d4e4-452f-a7f2-960324d259d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:51.637752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc25b-d4e4-452f-a7f2-960324d259d8 None admin] PATH_INFO: `/v3/projects/30ce2cc4671148318b411f3e15c47c0f` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:51.638976 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cc25b-d4e4-452f-a7f2-960324d259d8 None admin] RBAC: Authorizing `identity:get_project(project_id=30ce2cc4671148318b411f3e15c47c0f)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:51.640678 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cc25b-d4e4-452f-a7f2-960324d259d8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:51.642709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 52/96] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:11:51 2022] GET /identity/v3/projects/30ce2cc4671148318b411f3e15c47c0f => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:51.648647 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20671526-4e24-4122-b07b-56b122d647d5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:51.771268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20671526-4e24-4122-b07b-56b122d647d5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:51.817992 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8370b8f-001d-4703-bc45-0bfd17d21940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:51.818656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8370b8f-001d-4703-bc45-0bfd17d21940 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:51.818968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8370b8f-001d-4703-bc45-0bfd17d21940 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:51.819254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8370b8f-001d-4703-bc45-0bfd17d21940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:51.820120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8370b8f-001d-4703-bc45-0bfd17d21940 None admin] RBAC: Adding query filter params (role.id=d295e312e144479ca8f748650ac995a4, scope.project.id=30ce2cc4671148318b411f3e15c47c0f, user.id=cc4961f214f64c8f9d7137d2763ee3e7) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:51.820438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8370b8f-001d-4703-bc45-0bfd17d21940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:51.821905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8370b8f-001d-4703-bc45-0bfd17d21940 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:51.828170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 45/97] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:11:51 2022] GET /identity/v3/role_assignments?user.id=cc4961f214f64c8f9d7137d2763ee3e7&scope.project.id=30ce2cc4671148318b411f3e15c47c0f&role.id=d295e312e144479ca8f748650ac995a4 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:53.081104 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d3a13-f5f5-4d4d-93a2-d9aeb125618e None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:53.081768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d3a13-f5f5-4d4d-93a2-d9aeb125618e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:53.081768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d3a13-f5f5-4d4d-93a2-d9aeb125618e None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:53.083326 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 53/98] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:53.088847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086525a-fa1f-4855-b5ba-dda4034ce66b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:53.089302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086525a-fa1f-4855-b5ba-dda4034ce66b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:53.089467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086525a-fa1f-4855-b5ba-dda4034ce66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:53.114111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-4086525a-fa1f-4855-b5ba-dda4034ce66b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:53.115373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4086525a-fa1f-4855-b5ba-dda4034ce66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:53.151660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:53.203159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 46/99] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:53.248015 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d3a13-f5f5-4d4d-93a2-d9aeb125618e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:53.377390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d3a13-f5f5-4d4d-93a2-d9aeb125618e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:53.419719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999e8c3-9d48-4299-8ca2-91559d32fa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:53.420381 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999e8c3-9d48-4299-8ca2-91559d32fa82 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:53.420676 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999e8c3-9d48-4299-8ca2-91559d32fa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:53.420954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999e8c3-9d48-4299-8ca2-91559d32fa82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:53.435467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999e8c3-9d48-4299-8ca2-91559d32fa82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2999e8c3-9d48-4299-8ca2-91559d32fa82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:11:53.444546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:53.446949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:53.448960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:53.448960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:53.448960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:53.448960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:53.448960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:11:53.448960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:11:53.448960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:11:53.448960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:11:53.448960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:11:53.448960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:11:53.448960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:11:53.448960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:11:53.448960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 54/100] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:11:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:11:53.454429 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086525a-fa1f-4855-b5ba-dda4034ce66b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:53.587322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086525a-fa1f-4855-b5ba-dda4034ce66b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:53.631219 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066d5ee-2d09-496a-9c64-69b9749ae6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:53.632320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066d5ee-2d09-496a-9c64-69b9749ae6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:53.632669 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066d5ee-2d09-496a-9c64-69b9749ae6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:53.632951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066d5ee-2d09-496a-9c64-69b9749ae6e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:53.633684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066d5ee-2d09-496a-9c64-69b9749ae6e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:53.633999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066d5ee-2d09-496a-9c64-69b9749ae6e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:53.635410 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066d5ee-2d09-496a-9c64-69b9749ae6e9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:53.652874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 47/101] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:11:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:53.656219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999e8c3-9d48-4299-8ca2-91559d32fa82 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:53.730849 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:53.805965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999e8c3-9d48-4299-8ca2-91559d32fa82 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:53.827005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed45c6-7b75-4d1b-91ea-c0ea4eded1f6 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:53.827326 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed45c6-7b75-4d1b-91ea-c0ea4eded1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:53.827568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed45c6-7b75-4d1b-91ea-c0ea4eded1f6 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:53.829321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 48/102] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:53.834538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7116-5260-4aad-95a6-1a0d3b479cca None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:53.835371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7116-5260-4aad-95a6-1a0d3b479cca None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:53.835657 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7116-5260-4aad-95a6-1a0d3b479cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:53.867132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83361759-2e99-469a-8c99-fc1ea1356977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:53.867797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361759-2e99-469a-8c99-fc1ea1356977 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:53.868089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361759-2e99-469a-8c99-fc1ea1356977 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:53.868375 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83361759-2e99-469a-8c99-fc1ea1356977 None admin] PATH_INFO: `/v3/users/cc4961f214f64c8f9d7137d2763ee3e7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:53.869634 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83361759-2e99-469a-8c99-fc1ea1356977 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4961f214f64c8f9d7137d2763ee3e7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:53.871106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83361759-2e99-469a-8c99-fc1ea1356977 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:53.872903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 55/103] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:11:53 2022] GET /identity/v3/users/cc4961f214f64c8f9d7137d2763ee3e7 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:53.873802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-e0fc7116-5260-4aad-95a6-1a0d3b479cca None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:53.875029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e0fc7116-5260-4aad-95a6-1a0d3b479cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:53.899318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83361759-2e99-469a-8c99-fc1ea1356977 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:53.908265 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:53.985323 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 49/104] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:54.019030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc7116-5260-4aad-95a6-1a0d3b479cca None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:54.104049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83361759-2e99-469a-8c99-fc1ea1356977 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:54.127558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:54.144411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e058e38-dd01-454c-b24e-7db73c02e287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:54.145475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058e38-dd01-454c-b24e-7db73c02e287 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:54.145833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058e38-dd01-454c-b24e-7db73c02e287 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:54.146216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058e38-dd01-454c-b24e-7db73c02e287 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:54.148337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e058e38-dd01-454c-b24e-7db73c02e287 None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:54.150107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e058e38-dd01-454c-b24e-7db73c02e287 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:54.152185 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 56/105] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:11:53 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:11:54.158612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e058e38-dd01-454c-b24e-7db73c02e287 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:54.180240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc7116-5260-4aad-95a6-1a0d3b479cca None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:54.250049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b015841-7636-4e13-83dd-ec974bd2c8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:54.251042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b015841-7636-4e13-83dd-ec974bd2c8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:54.251538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b015841-7636-4e13-83dd-ec974bd2c8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:54.251997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b015841-7636-4e13-83dd-ec974bd2c8c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:54.273236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e058e38-dd01-454c-b24e-7db73c02e287 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:54.274331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b015841-7636-4e13-83dd-ec974bd2c8c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-8b015841-7636-4e13-83dd-ec974bd2c8c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:11:54.279825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:54.280663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:54.281411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:54.281411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:54.281411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:54.281411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:54.281411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:11:54.281411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:11:54.281411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:11:54.281411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:11:54.281411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:11:54.281411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:11:54.281411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:11:54.281411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:11:54.283940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 50/106] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:11:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:11:54.291704 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b015841-7636-4e13-83dd-ec974bd2c8c3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:54.322659 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208f386-0b2a-43d0-8fb9-b6aaa9e25ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:54.323354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208f386-0b2a-43d0-8fb9-b6aaa9e25ba8 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:54.323648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208f386-0b2a-43d0-8fb9-b6aaa9e25ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:54.323934 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208f386-0b2a-43d0-8fb9-b6aaa9e25ba8 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637/users/cc4961f214f64c8f9d7137d2763ee3e7/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:54.324308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:54.327086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208f386-0b2a-43d0-8fb9-b6aaa9e25ba8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bd58a62525c46c888f56577918c1637, user_id=cc4961f214f64c8f9d7137d2763ee3e7, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:54.328566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208f386-0b2a-43d0-8fb9-b6aaa9e25ba8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:54.345125 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 57/107] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:11:54 2022] PUT /identity/v3/projects/7bd58a62525c46c888f56577918c1637/users/cc4961f214f64c8f9d7137d2763ee3e7/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:11:54.346735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7bd68-5d96-4eb0-828a-61a519170147 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:54.347030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7bd68-5d96-4eb0-828a-61a519170147 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:54.347455 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7bd68-5d96-4eb0-828a-61a519170147 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:54.348972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 58/108] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:54.350125 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aeb7a-2aa7-4961-984d-d610c7fdd66c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:54.355181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aeb7a-2aa7-4961-984d-d610c7fdd66c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:54.355572 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aeb7a-2aa7-4961-984d-d610c7fdd66c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:54.357153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 59/109] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:54.358879 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd16419-543b-46b8-b60a-27b71bf59a0f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:54.359168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd16419-543b-46b8-b60a-27b71bf59a0f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:54.359446 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd16419-543b-46b8-b60a-27b71bf59a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:54.380494 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7fd16419-543b-46b8-b60a-27b71bf59a0f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:54.381787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7fd16419-543b-46b8-b60a-27b71bf59a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:54.416969 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b015841-7636-4e13-83dd-ec974bd2c8c3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:54.434941 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:54.454877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6083a-0ebb-456d-8ef0-b955680edde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:54.455524 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6083a-0ebb-456d-8ef0-b955680edde3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:54.455814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6083a-0ebb-456d-8ef0-b955680edde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:54.456098 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6083a-0ebb-456d-8ef0-b955680edde3 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:54.456835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6083a-0ebb-456d-8ef0-b955680edde3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:54.457150 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6083a-0ebb-456d-8ef0-b955680edde3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:54.458611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6083a-0ebb-456d-8ef0-b955680edde3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:54.463715 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 60/110] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:11:54.464249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd5e9b-3b91-4611-95c0-047ef65bfa49 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:54.470430 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 51/111] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:11:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:54.470718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd5e9b-3b91-4611-95c0-047ef65bfa49 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:54.470718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd5e9b-3b91-4611-95c0-047ef65bfa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:54.486375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6083a-0ebb-456d-8ef0-b955680edde3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:54.508076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-53bd5e9b-3b91-4611-95c0-047ef65bfa49 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:54.509363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-53bd5e9b-3b91-4611-95c0-047ef65bfa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:54.596670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 61/112] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:54.597366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd5e9b-3b91-4611-95c0-047ef65bfa49 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:54.651450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:54.673196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6083a-0ebb-456d-8ef0-b955680edde3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:54.717891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576cbc8-c06b-4e29-8d41-976af1e58ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:54.718622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576cbc8-c06b-4e29-8d41-976af1e58ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:54.718887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576cbc8-c06b-4e29-8d41-976af1e58ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:54.719171 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576cbc8-c06b-4e29-8d41-976af1e58ee0 None admin] PATH_INFO: `/v3/users/8c0fa3378af3402089d42ceacf7a26b5` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:54.720367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576cbc8-c06b-4e29-8d41-976af1e58ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=8c0fa3378af3402089d42ceacf7a26b5)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:54.721826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576cbc8-c06b-4e29-8d41-976af1e58ee0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:54.723654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 52/113] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:11:54 2022] GET /identity/v3/users/8c0fa3378af3402089d42ceacf7a26b5 => generated 247 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:54.727442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576cbc8-c06b-4e29-8d41-976af1e58ee0 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:54.743276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd5e9b-3b91-4611-95c0-047ef65bfa49 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:54.753612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:54.780733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c85c1-e92f-4be0-b99c-9bb9d2fe4450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:54.781387 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c85c1-e92f-4be0-b99c-9bb9d2fe4450 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:54.781670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c85c1-e92f-4be0-b99c-9bb9d2fe4450 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:54.781946 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c85c1-e92f-4be0-b99c-9bb9d2fe4450 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:54.783302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c85c1-e92f-4be0-b99c-9bb9d2fe4450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:54.784915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c85c1-e92f-4be0-b99c-9bb9d2fe4450 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:54.786728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 62/114] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:11:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:54.787893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef24e7-a506-4916-adbc-6505e40411e1 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:54.788178 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef24e7-a506-4916-adbc-6505e40411e1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:54.788483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef24e7-a506-4916-adbc-6505e40411e1 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:54.789836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 63/115] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:54.794676 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef24e7-a506-4916-adbc-6505e40411e1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:54.838676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576cbc8-c06b-4e29-8d41-976af1e58ee0 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:54.875707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e022f-9174-478c-85fd-6493a870e4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:54.876365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e022f-9174-478c-85fd-6493a870e4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:54.876653 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e022f-9174-478c-85fd-6493a870e4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:54.876943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e022f-9174-478c-85fd-6493a870e4e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:54.888206 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e022f-9174-478c-85fd-6493a870e4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-3b1e022f-9174-478c-85fd-6493a870e4e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:11:54.894199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:54.895093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:54.895848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:54.895848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:54.895848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:54.895848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:54.895848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:11:54.895848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:11:54.895848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:11:54.895848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:11:54.895848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:11:54.895848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:11:54.895848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:11:54.895848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:11:54.895848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 53/116] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:11:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:11:54.897312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e022f-9174-478c-85fd-6493a870e4e7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:54.909755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef24e7-a506-4916-adbc-6505e40411e1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:54.910289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:54.953983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854510a-8d19-4082-9ed7-f2463b4712f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:54.954644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854510a-8d19-4082-9ed7-f2463b4712f3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:54.954935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854510a-8d19-4082-9ed7-f2463b4712f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:54.955213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854510a-8d19-4082-9ed7-f2463b4712f3 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:54.956398 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854510a-8d19-4082-9ed7-f2463b4712f3 None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:54.957889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854510a-8d19-4082-9ed7-f2463b4712f3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:54.959802 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 64/117] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:11:54 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:54.960740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d07e1-98eb-4e66-ba4e-bd92c2eb971e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:54.961033 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d07e1-98eb-4e66-ba4e-bd92c2eb971e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:54.961499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d07e1-98eb-4e66-ba4e-bd92c2eb971e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:54.980041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e08d07e1-98eb-4e66-ba4e-bd92c2eb971e None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:54.981249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e08d07e1-98eb-4e66-ba4e-bd92c2eb971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:55.008972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e022f-9174-478c-85fd-6493a870e4e7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:55.023211 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:55.046996 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15641d21-bf80-4da0-a409-bb6571a64f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:55.047924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15641d21-bf80-4da0-a409-bb6571a64f07 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:55.048363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15641d21-bf80-4da0-a409-bb6571a64f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:55.048647 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15641d21-bf80-4da0-a409-bb6571a64f07 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:55.049333 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15641d21-bf80-4da0-a409-bb6571a64f07 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:55.050803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15641d21-bf80-4da0-a409-bb6571a64f07 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:55.051824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 65/118] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:55.053092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588713d6-d77e-4bbc-9b60-8fad83bdf57c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:55.053908 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588713d6-d77e-4bbc-9b60-8fad83bdf57c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:55.054190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588713d6-d77e-4bbc-9b60-8fad83bdf57c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:55.055627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 66/119] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:55.060268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588713d6-d77e-4bbc-9b60-8fad83bdf57c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:55.086176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 54/120] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 4 22:11:54 2022] POST /identity/v3/projects => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:11:55.087340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15641d21-bf80-4da0-a409-bb6571a64f07 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:55.173128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:55.202130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588713d6-d77e-4bbc-9b60-8fad83bdf57c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:55.231078 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15641d21-bf80-4da0-a409-bb6571a64f07 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:55.247026 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1584cfb-4c9b-4b21-8f96-4256d2b0cc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:55.247650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1584cfb-4c9b-4b21-8f96-4256d2b0cc6b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:55.247924 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1584cfb-4c9b-4b21-8f96-4256d2b0cc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:55.248195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1584cfb-4c9b-4b21-8f96-4256d2b0cc6b None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:55.248909 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1584cfb-4c9b-4b21-8f96-4256d2b0cc6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:55.249224 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1584cfb-4c9b-4b21-8f96-4256d2b0cc6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:55.250738 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1584cfb-4c9b-4b21-8f96-4256d2b0cc6b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:55.259387 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 67/121] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:11:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:55.260565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b528b-8e6e-4f2c-98c9-787c9d87a640 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:55.260854 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b528b-8e6e-4f2c-98c9-787c9d87a640 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:55.261127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b528b-8e6e-4f2c-98c9-787c9d87a640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:55.280293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5b3b528b-8e6e-4f2c-98c9-787c9d87a640 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:55.281540 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5b3b528b-8e6e-4f2c-98c9-787c9d87a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:55.285066 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26839-7b63-4a79-9529-8abeb183e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:55.285952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26839-7b63-4a79-9529-8abeb183e525 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:55.286058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26839-7b63-4a79-9529-8abeb183e525 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:55.286309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c26839-7b63-4a79-9529-8abeb183e525 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637/users/8c0fa3378af3402089d42ceacf7a26b5/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:55.288872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c26839-7b63-4a79-9529-8abeb183e525 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bd58a62525c46c888f56577918c1637, user_id=8c0fa3378af3402089d42ceacf7a26b5, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:55.290338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c26839-7b63-4a79-9529-8abeb183e525 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:55.314441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 55/122] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:11:55 2022] PUT /identity/v3/projects/7bd58a62525c46c888f56577918c1637/users/8c0fa3378af3402089d42ceacf7a26b5/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:11:55.314441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26839-7b63-4a79-9529-8abeb183e525 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:55.331695 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:55.379809 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 68/123] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:55.382581 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b528b-8e6e-4f2c-98c9-787c9d87a640 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:55.437215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c26839-7b63-4a79-9529-8abeb183e525 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:55.463250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:55.476903 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285adaa-5d9f-464c-9d5e-900b20a9d53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:55.477571 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285adaa-5d9f-464c-9d5e-900b20a9d53c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:55.477968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285adaa-5d9f-464c-9d5e-900b20a9d53c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:55.478261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285adaa-5d9f-464c-9d5e-900b20a9d53c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:55.490965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285adaa-5d9f-464c-9d5e-900b20a9d53c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-9285adaa-5d9f-464c-9d5e-900b20a9d53c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:11:55.496500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:55.497361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:55.498131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:55.498131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:55.498131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:55.498131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:55.498131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:11:55.498131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:11:55.498131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:11:55.498131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:11:55.498131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:11:55.498131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:11:55.498131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:11:55.498131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:11:55.498131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 56/124] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:11:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:11:55.498807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285adaa-5d9f-464c-9d5e-900b20a9d53c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:55.529061 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b528b-8e6e-4f2c-98c9-787c9d87a640 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:55.574860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e41a8-102b-4d3e-8945-fda76d7b2753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:55.575774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e41a8-102b-4d3e-8945-fda76d7b2753 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:55.576064 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e41a8-102b-4d3e-8945-fda76d7b2753 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:55.576345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e41a8-102b-4d3e-8945-fda76d7b2753 None admin] PATH_INFO: `/v3/users/89b639595caf4cabbca58dbf898454c2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:55.594739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e41a8-102b-4d3e-8945-fda76d7b2753 None admin] RBAC: Authorizing `identity:get_user(user_id=89b639595caf4cabbca58dbf898454c2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:55.596155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e41a8-102b-4d3e-8945-fda76d7b2753 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:55.597875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 69/125] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:11:55 2022] GET /identity/v3/users/89b639595caf4cabbca58dbf898454c2 => generated 289 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:55.598698 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e41a8-102b-4d3e-8945-fda76d7b2753 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:55.615161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285adaa-5d9f-464c-9d5e-900b20a9d53c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:55.625558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:55.654102 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac140fd-a958-4957-98ca-08652a600bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:55.655217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac140fd-a958-4957-98ca-08652a600bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:55.655733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac140fd-a958-4957-98ca-08652a600bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:55.656268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac140fd-a958-4957-98ca-08652a600bd5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:55.668812 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac140fd-a958-4957-98ca-08652a600bd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-dac140fd-a958-4957-98ca-08652a600bd5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:11:55.675187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:55.676060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:55.676853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:55.676853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:55.676853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:55.676853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:55.676853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:11:55.676853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:11:55.676853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:11:55.676853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:11:55.676853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:11:55.676853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:11:55.676853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:11:55.676853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:11:55.679317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 57/126] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:11:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:11:55.680425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac140fd-a958-4957-98ca-08652a600bd5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:55.715759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e41a8-102b-4d3e-8945-fda76d7b2753 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:55.732861 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:55.753131 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7d41c-c024-4ee7-9e2f-2668abf68d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:55.754195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7d41c-c024-4ee7-9e2f-2668abf68d3b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:55.754733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7d41c-c024-4ee7-9e2f-2668abf68d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:55.755305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7d41c-c024-4ee7-9e2f-2668abf68d3b None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:55.756406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7d41c-c024-4ee7-9e2f-2668abf68d3b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:55.756943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7d41c-c024-4ee7-9e2f-2668abf68d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:55.758693 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7d41c-c024-4ee7-9e2f-2668abf68d3b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:55.768220 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 70/127] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:11:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:55.769702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7d41c-c024-4ee7-9e2f-2668abf68d3b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:55.804538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac140fd-a958-4957-98ca-08652a600bd5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:55.847768 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37412814-e217-4b9d-923c-83ed6d05f977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:55.848382 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37412814-e217-4b9d-923c-83ed6d05f977 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:55.848671 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37412814-e217-4b9d-923c-83ed6d05f977 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:55.848948 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37412814-e217-4b9d-923c-83ed6d05f977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:55.942814 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:55.952183 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7d41c-c024-4ee7-9e2f-2668abf68d3b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:55.990368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f53f3b-9156-4816-b7eb-c307edcbae39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:55.991127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53f3b-9156-4816-b7eb-c307edcbae39 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:55.991425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53f3b-9156-4816-b7eb-c307edcbae39 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:55.991709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53f3b-9156-4816-b7eb-c307edcbae39 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:55.992434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f53f3b-9156-4816-b7eb-c307edcbae39 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:55.992908 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f53f3b-9156-4816-b7eb-c307edcbae39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:55.994701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f53f3b-9156-4816-b7eb-c307edcbae39 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:56.004077 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 71/128] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:11:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:56.004851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f53f3b-9156-4816-b7eb-c307edcbae39 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:56.025839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37412814-e217-4b9d-923c-83ed6d05f977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:56.027428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37412814-e217-4b9d-923c-83ed6d05f977 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:56.070912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:56.117746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f53f3b-9156-4816-b7eb-c307edcbae39 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:56.133397 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 58/129] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:11:56.134362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37412814-e217-4b9d-923c-83ed6d05f977 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:56.154066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea426b-1223-42d0-ae96-9a82863b485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:56.154837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea426b-1223-42d0-ae96-9a82863b485a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:56.155123 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea426b-1223-42d0-ae96-9a82863b485a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:56.155403 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea426b-1223-42d0-ae96-9a82863b485a None admin] PATH_INFO: `/v3/users/cc4961f214f64c8f9d7137d2763ee3e7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:56.156649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea426b-1223-42d0-ae96-9a82863b485a None admin] RBAC: Authorizing `identity:get_user(user_id=cc4961f214f64c8f9d7137d2763ee3e7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:56.158182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea426b-1223-42d0-ae96-9a82863b485a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:56.160100 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 72/130] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:11:56 2022] GET /identity/v3/users/cc4961f214f64c8f9d7137d2763ee3e7 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:56.160864 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea426b-1223-42d0-ae96-9a82863b485a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:56.190790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:56.264148 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37412814-e217-4b9d-923c-83ed6d05f977 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:56.307060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea426b-1223-42d0-ae96-9a82863b485a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:56.317007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef76f0-bc84-4d87-81ca-9f34bc27ce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:56.317735 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef76f0-bc84-4d87-81ca-9f34bc27ce4f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:56.318030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef76f0-bc84-4d87-81ca-9f34bc27ce4f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:56.318311 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef76f0-bc84-4d87-81ca-9f34bc27ce4f None admin] PATH_INFO: `/v3/users/cc4961f214f64c8f9d7137d2763ee3e7` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:56.321149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef76f0-bc84-4d87-81ca-9f34bc27ce4f None admin] RBAC: Authorizing `identity:get_user(user_id=cc4961f214f64c8f9d7137d2763ee3e7)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:56.322641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef76f0-bc84-4d87-81ca-9f34bc27ce4f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:56.324285 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 59/131] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:11:56 2022] GET /identity/v3/users/cc4961f214f64c8f9d7137d2763ee3e7 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:56.325063 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef76f0-bc84-4d87-81ca-9f34bc27ce4f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:56.349200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:56.369544 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93ac50-3659-4f99-b7de-7f9aba45c22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:56.370258 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93ac50-3659-4f99-b7de-7f9aba45c22d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:56.370575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93ac50-3659-4f99-b7de-7f9aba45c22d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:56.378649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93ac50-3659-4f99-b7de-7f9aba45c22d None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:56.379993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93ac50-3659-4f99-b7de-7f9aba45c22d None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:56.381516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93ac50-3659-4f99-b7de-7f9aba45c22d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:56.383376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 73/132] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:11:56 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:56.384222 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93ac50-3659-4f99-b7de-7f9aba45c22d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:56.482531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:56.486704 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef76f0-bc84-4d87-81ca-9f34bc27ce4f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:56.515216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93ac50-3659-4f99-b7de-7f9aba45c22d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:56.529492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d0ac2-7dea-465f-a7a5-63ca72c53ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:56.530164 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d0ac2-7dea-465f-a7a5-63ca72c53ecf None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:56.530470 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d0ac2-7dea-465f-a7a5-63ca72c53ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:56.530823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d0ac2-7dea-465f-a7a5-63ca72c53ecf None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:56.532043 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d0ac2-7dea-465f-a7a5-63ca72c53ecf None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:56.533518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d0ac2-7dea-465f-a7a5-63ca72c53ecf None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:56.535686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 60/133] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:11:56 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:56.536478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d0ac2-7dea-465f-a7a5-63ca72c53ecf None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:56.589087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5b6fa-9087-44b5-83d9-8fa0cd667ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:56.590135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5b6fa-9087-44b5-83d9-8fa0cd667ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:56.590661 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5b6fa-9087-44b5-83d9-8fa0cd667ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:56.591242 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5b6fa-9087-44b5-83d9-8fa0cd667ee7 None admin] PATH_INFO: `/v3/projects/30ce2cc4671148318b411f3e15c47c0f` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:56.596200 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5b6fa-9087-44b5-83d9-8fa0cd667ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=30ce2cc4671148318b411f3e15c47c0f)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:56.598070 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5b6fa-9087-44b5-83d9-8fa0cd667ee7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:56.601034 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 74/134] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:11:56 2022] GET /identity/v3/projects/30ce2cc4671148318b411f3e15c47c0f => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:56.602036 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5b6fa-9087-44b5-83d9-8fa0cd667ee7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:56.630847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:56.651829 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d0ac2-7dea-465f-a7a5-63ca72c53ecf None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:56.694984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db6dae-6fe2-4761-9c8f-9caf5078f518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:56.695617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db6dae-6fe2-4761-9c8f-9caf5078f518 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:56.695906 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db6dae-6fe2-4761-9c8f-9caf5078f518 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:56.696190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db6dae-6fe2-4761-9c8f-9caf5078f518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:56.697230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db6dae-6fe2-4761-9c8f-9caf5078f518 None admin] RBAC: Adding query filter params (role.id=fdbe1fc69914484591390937886dfbfa, scope.project.id=7bd58a62525c46c888f56577918c1637, user.id=89b639595caf4cabbca58dbf898454c2) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:56.697561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db6dae-6fe2-4761-9c8f-9caf5078f518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:56.699652 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db6dae-6fe2-4761-9c8f-9caf5078f518 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:56.706128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 61/135] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:11:56 2022] GET /identity/v3/role_assignments?user.id=89b639595caf4cabbca58dbf898454c2&scope.project.id=7bd58a62525c46c888f56577918c1637&role.id=fdbe1fc69914484591390937886dfbfa => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:56.706932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db6dae-6fe2-4761-9c8f-9caf5078f518 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:56.783596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5b6fa-9087-44b5-83d9-8fa0cd667ee7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:56.828846 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515a8f9-39fc-4118-991d-ea9c6cb9220b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:56.830011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515a8f9-39fc-4118-991d-ea9c6cb9220b None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:56.830560 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515a8f9-39fc-4118-991d-ea9c6cb9220b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:56.831044 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515a8f9-39fc-4118-991d-ea9c6cb9220b None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637/users/cc4961f214f64c8f9d7137d2763ee3e7/roles/b371b8f12e7348e8b01784eeddeca2ac` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:56.833969 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515a8f9-39fc-4118-991d-ea9c6cb9220b None admin] RBAC: Authorizing `identity:create_grant(project_id=7bd58a62525c46c888f56577918c1637, user_id=cc4961f214f64c8f9d7137d2763ee3e7, role_id=b371b8f12e7348e8b01784eeddeca2ac)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:56.835878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515a8f9-39fc-4118-991d-ea9c6cb9220b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:56.848818 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db6dae-6fe2-4761-9c8f-9caf5078f518 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:56.855051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 75/136] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:11:56 2022] PUT /identity/v3/projects/7bd58a62525c46c888f56577918c1637/users/cc4961f214f64c8f9d7137d2763ee3e7/roles/b371b8f12e7348e8b01784eeddeca2ac => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:11:56.893483 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44df47-fc87-4261-9bdb-6122ed2adee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:56.894248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44df47-fc87-4261-9bdb-6122ed2adee7 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:56.894611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44df47-fc87-4261-9bdb-6122ed2adee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:56.894899 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44df47-fc87-4261-9bdb-6122ed2adee7 None admin] PATH_INFO: `/v3/projects/30ce2cc4671148318b411f3e15c47c0f/users/cc4961f214f64c8f9d7137d2763ee3e7/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:56.897115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44df47-fc87-4261-9bdb-6122ed2adee7 None admin] RBAC: Authorizing `identity:create_grant(project_id=30ce2cc4671148318b411f3e15c47c0f, user_id=cc4961f214f64c8f9d7137d2763ee3e7, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:56.898690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44df47-fc87-4261-9bdb-6122ed2adee7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:56.916427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 62/137] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:11:56 2022] PUT /identity/v3/projects/30ce2cc4671148318b411f3e15c47c0f/users/cc4961f214f64c8f9d7137d2763ee3e7/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:11:57.043554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a0b52-ab12-4aee-83af-a714c3b39a84 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:57.044052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a0b52-ab12-4aee-83af-a714c3b39a84 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:57.044467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a0b52-ab12-4aee-83af-a714c3b39a84 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:57.046430 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 76/138] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:57.052555 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752923e-1852-40ff-bff5-a59b826dbcc8 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:57.052844 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752923e-1852-40ff-bff5-a59b826dbcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:57.053128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752923e-1852-40ff-bff5-a59b826dbcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:57.063372 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:57.080881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6752923e-1852-40ff-bff5-a59b826dbcc8 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:57.082255 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6752923e-1852-40ff-bff5-a59b826dbcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:57.164989 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 63/139] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:57.187292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a0b52-ab12-4aee-83af-a714c3b39a84 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:57.210334 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:57.337667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a0b52-ab12-4aee-83af-a714c3b39a84 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:57.380421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485aa7-e3fd-4b3f-a242-d2b8052913a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:57.381081 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485aa7-e3fd-4b3f-a242-d2b8052913a6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:57.381893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485aa7-e3fd-4b3f-a242-d2b8052913a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:57.382186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485aa7-e3fd-4b3f-a242-d2b8052913a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:57.398556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6485aa7-e3fd-4b3f-a242-d2b8052913a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e6485aa7-e3fd-4b3f-a242-d2b8052913a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:11:57.404099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:57.404910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:57.406305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:57.406305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:57.406305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:57.406305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:57.406305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:11:57.406305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:11:57.406305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:11:57.406305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:11:57.406305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:11:57.406305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:11:57.406305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:11:57.406305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:11:57.406305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 77/140] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:11:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:11:57.413041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752923e-1852-40ff-bff5-a59b826dbcc8 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:57.544514 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752923e-1852-40ff-bff5-a59b826dbcc8 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:57.578696 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:57.582784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae063606-2cee-45a9-909f-46f7295db143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:57.583432 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae063606-2cee-45a9-909f-46f7295db143 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:57.583720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae063606-2cee-45a9-909f-46f7295db143 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:57.584001 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae063606-2cee-45a9-909f-46f7295db143 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:57.585301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae063606-2cee-45a9-909f-46f7295db143 None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:57.585627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae063606-2cee-45a9-909f-46f7295db143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:57.587292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae063606-2cee-45a9-909f-46f7295db143 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:57.596635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 64/141] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:11:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:57.602540 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485aa7-e3fd-4b3f-a242-d2b8052913a6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:57.705432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:57.744175 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485aa7-e3fd-4b3f-a242-d2b8052913a6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:57.784315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04370516-3fa1-4792-afc7-cadc30681f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:57.784969 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370516-3fa1-4792-afc7-cadc30681f7c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:57.785255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370516-3fa1-4792-afc7-cadc30681f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:57.785531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370516-3fa1-4792-afc7-cadc30681f7c None admin] PATH_INFO: `/v3/users/cc4961f214f64c8f9d7137d2763ee3e7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:57.791150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04370516-3fa1-4792-afc7-cadc30681f7c None admin] RBAC: Authorizing `identity:get_user(user_id=cc4961f214f64c8f9d7137d2763ee3e7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:57.792631 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04370516-3fa1-4792-afc7-cadc30681f7c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:57.794573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 78/142] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:11:57 2022] GET /identity/v3/users/cc4961f214f64c8f9d7137d2763ee3e7 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:57.800311 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae063606-2cee-45a9-909f-46f7295db143 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:57.856568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3340040-96b2-43f0-b4c0-e493db2d9ab9 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:57.856857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3340040-96b2-43f0-b4c0-e493db2d9ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:57.857154 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3340040-96b2-43f0-b4c0-e493db2d9ab9 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:57.858839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 79/143] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:57.864864 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da1ee0-af78-4fab-9bd5-28b0cd90ce30 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:57.865156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da1ee0-af78-4fab-9bd5-28b0cd90ce30 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:57.865435 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da1ee0-af78-4fab-9bd5-28b0cd90ce30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:57.893129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b8da1ee0-af78-4fab-9bd5-28b0cd90ce30 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:57.894432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b8da1ee0-af78-4fab-9bd5-28b0cd90ce30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:57.962531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae063606-2cee-45a9-909f-46f7295db143 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:58.023142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ec89e-382b-4432-8969-5d1a0275ebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:58.023795 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ec89e-382b-4432-8969-5d1a0275ebd4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:58.024088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ec89e-382b-4432-8969-5d1a0275ebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:58.024373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ec89e-382b-4432-8969-5d1a0275ebd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:58.055740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 80/144] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:58.115562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da1ee0-af78-4fab-9bd5-28b0cd90ce30 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:58.123432 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ec89e-382b-4432-8969-5d1a0275ebd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:58.124999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ec89e-382b-4432-8969-5d1a0275ebd4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:58.147643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:58.279224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 65/145] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:11:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:11:58.284897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ec89e-382b-4432-8969-5d1a0275ebd4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:58.346757 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:58.390876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:58.392356 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da1ee0-af78-4fab-9bd5-28b0cd90ce30 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:58.398603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ec89e-382b-4432-8969-5d1a0275ebd4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:58.442134 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590a51e-6eb1-4cc1-8e0d-0e76f9979b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:58.444299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590a51e-6eb1-4cc1-8e0d-0e76f9979b0b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:58.445188 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0aa70-8075-433f-b59c-9942ac12b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:58.446443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0aa70-8075-433f-b59c-9942ac12b3ce None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:58.446795 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590a51e-6eb1-4cc1-8e0d-0e76f9979b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:58.447359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590a51e-6eb1-4cc1-8e0d-0e76f9979b0b None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:58.448565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0aa70-8075-433f-b59c-9942ac12b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:58.449074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0aa70-8075-433f-b59c-9942ac12b3ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:58.449979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590a51e-6eb1-4cc1-8e0d-0e76f9979b0b None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:58.452733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590a51e-6eb1-4cc1-8e0d-0e76f9979b0b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:58.455224 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0aa70-8075-433f-b59c-9942ac12b3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:58.456982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0aa70-8075-433f-b59c-9942ac12b3ce None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:58.460195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 81/146] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:11:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:58.460596 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 66/147] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:11:58 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:58.466470 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5ffe8-cbf3-475c-a2e6-aeecc0db8213 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:58.466827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5ffe8-cbf3-475c-a2e6-aeecc0db8213 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:58.467120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5ffe8-cbf3-475c-a2e6-aeecc0db8213 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:58.468652 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0aa70-8075-433f-b59c-9942ac12b3ce None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:58.471878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 67/148] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:58.471878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5ffe8-cbf3-475c-a2e6-aeecc0db8213 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:58.664259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0aa70-8075-433f-b59c-9942ac12b3ce None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:58.670303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5ffe8-cbf3-475c-a2e6-aeecc0db8213 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:58.720807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab18e87-bd68-47d2-a605-2b6149ee671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:58.721708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab18e87-bd68-47d2-a605-2b6149ee671b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:58.722977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab18e87-bd68-47d2-a605-2b6149ee671b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:58.723105 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab18e87-bd68-47d2-a605-2b6149ee671b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:58.723929 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab18e87-bd68-47d2-a605-2b6149ee671b None admin] RBAC: Adding query filter params (role.id=d295e312e144479ca8f748650ac995a4, scope.project.id=7bd58a62525c46c888f56577918c1637, user.id=cc4961f214f64c8f9d7137d2763ee3e7) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:58.724270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab18e87-bd68-47d2-a605-2b6149ee671b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:58.726275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab18e87-bd68-47d2-a605-2b6149ee671b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:58.732849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 68/149] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:11:58 2022] GET /identity/v3/role_assignments?user.id=cc4961f214f64c8f9d7137d2763ee3e7&scope.project.id=7bd58a62525c46c888f56577918c1637&role.id=d295e312e144479ca8f748650ac995a4 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:58.734116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d31c4-0e50-4229-a4e3-d28d15cf1ae7 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:58.742484 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d31c4-0e50-4229-a4e3-d28d15cf1ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:58.742484 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d31c4-0e50-4229-a4e3-d28d15cf1ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:58.746245 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba477d-7768-4fa4-a3fb-d57e62de7aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:58.747277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba477d-7768-4fa4-a3fb-d57e62de7aac None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:58.747824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba477d-7768-4fa4-a3fb-d57e62de7aac None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:58.748339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba477d-7768-4fa4-a3fb-d57e62de7aac None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:58.749302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba477d-7768-4fa4-a3fb-d57e62de7aac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:58.751047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba477d-7768-4fa4-a3fb-d57e62de7aac None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:58.770882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:58.777417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-943d31c4-0e50-4229-a4e3-d28d15cf1ae7 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:58.787160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-943d31c4-0e50-4229-a4e3-d28d15cf1ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:58.801429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 82/150] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:11:58 2022] POST /identity/v3/users => generated 283 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:11:58.826533 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:58.893315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 69/151] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:11:58.941077 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba477d-7768-4fa4-a3fb-d57e62de7aac None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:59.058886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba477d-7768-4fa4-a3fb-d57e62de7aac None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:59.097841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c3dc3-a423-46e9-819e-f3063ea1f300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:59.098907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c3dc3-a423-46e9-819e-f3063ea1f300 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:59.099407 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c3dc3-a423-46e9-819e-f3063ea1f300 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:59.099888 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c3dc3-a423-46e9-819e-f3063ea1f300 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:59.110910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c3dc3-a423-46e9-819e-f3063ea1f300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-ae7c3dc3-a423-46e9-819e-f3063ea1f300 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:11:59.116666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:11:59.117599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:11:59.118448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:11:59.118448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:11:59.118448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:11:59.118448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:11:59.118448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:11:59.118448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:11:59.118448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:11:59.118448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:11:59.118448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:11:59.118448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:11:59.118448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:11:59.118448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:11:59.121185 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 83/152] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:11:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:11:59.127030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d31c4-0e50-4229-a4e3-d28d15cf1ae7 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:59.234708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d31c4-0e50-4229-a4e3-d28d15cf1ae7 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:59.273959 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed773f0-f364-4550-89de-29da01db2efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:59.274634 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed773f0-f364-4550-89de-29da01db2efc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:59.274918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed773f0-f364-4550-89de-29da01db2efc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:59.275212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed773f0-f364-4550-89de-29da01db2efc None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:59.275945 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed773f0-f364-4550-89de-29da01db2efc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:11:59.276257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed773f0-f364-4550-89de-29da01db2efc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:59.277648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed773f0-f364-4550-89de-29da01db2efc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:59.290779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 70/153] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:11:59.292584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c3dc3-a423-46e9-819e-f3063ea1f300 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:59.374818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:59.427708 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c3dc3-a423-46e9-819e-f3063ea1f300 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:59.468646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114278a-7ad0-4c23-8a09-01f8b63f8986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:59.469561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114278a-7ad0-4c23-8a09-01f8b63f8986 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:59.470052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114278a-7ad0-4c23-8a09-01f8b63f8986 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:59.470573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114278a-7ad0-4c23-8a09-01f8b63f8986 None admin] PATH_INFO: `/v3/users/8c0fa3378af3402089d42ceacf7a26b5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:59.473288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114278a-7ad0-4c23-8a09-01f8b63f8986 None admin] RBAC: Authorizing `identity:get_user(user_id=8c0fa3378af3402089d42ceacf7a26b5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:59.475079 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114278a-7ad0-4c23-8a09-01f8b63f8986 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:59.477486 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 84/154] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:11:59 2022] GET /identity/v3/users/8c0fa3378af3402089d42ceacf7a26b5 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:11:59.483799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed773f0-f364-4550-89de-29da01db2efc None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:59.509767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:59.595960 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed773f0-f364-4550-89de-29da01db2efc None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:59.635976 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640e8ab-d13c-4f75-9fa8-f34ca7800c9d None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:59.636156 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085d3a8-e854-4ca8-a8e6-0c6255ca84c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:59.636698 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640e8ab-d13c-4f75-9fa8-f34ca7800c9d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:59.636817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d3a8-e854-4ca8-a8e6-0c6255ca84c7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:59.636988 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d3a8-e854-4ca8-a8e6-0c6255ca84c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:59.637261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d3a8-e854-4ca8-a8e6-0c6255ca84c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:59.637673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640e8ab-d13c-4f75-9fa8-f34ca7800c9d None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:59.639284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 85/155] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:59.644954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10373f68-22d2-4539-bd0c-794ab2ffa398 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:59.645522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10373f68-22d2-4539-bd0c-794ab2ffa398 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:59.646010 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10373f68-22d2-4539-bd0c-794ab2ffa398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:59.665993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-10373f68-22d2-4539-bd0c-794ab2ffa398 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:11:59.667578 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-10373f68-22d2-4539-bd0c-794ab2ffa398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:11:59.733119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085d3a8-e854-4ca8-a8e6-0c6255ca84c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:11:59.735640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085d3a8-e854-4ca8-a8e6-0c6255ca84c7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:11:59.760495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:59.763349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 86/156] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:11:59.789054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10373f68-22d2-4539-bd0c-794ab2ffa398 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:59.854043 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:11:59.867797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 71/157] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:11:59.875337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827064-c147-4efc-acbd-a6256ee1ff68 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:59.875857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827064-c147-4efc-acbd-a6256ee1ff68 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:59.876289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827064-c147-4efc-acbd-a6256ee1ff68 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:11:59.878241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 72/158] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:11:59.879883 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3827064-c147-4efc-acbd-a6256ee1ff68 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:11:59.938046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10373f68-22d2-4539-bd0c-794ab2ffa398 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:11:59.983395 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6059b36-3a4f-4e95-bf58-049a5d9b1869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:11:59.984237 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059b36-3a4f-4e95-bf58-049a5d9b1869 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:11:59.984621 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059b36-3a4f-4e95-bf58-049a5d9b1869 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:11:59.985020 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059b36-3a4f-4e95-bf58-049a5d9b1869 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:00.000661 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6059b36-3a4f-4e95-bf58-049a5d9b1869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b6059b36-3a4f-4e95-bf58-049a5d9b1869 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:00.006142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:00.007832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:00.008819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:00.008819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:00.008819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:00.008819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:00.008819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:00.008819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:00.008819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:00.008819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:00.008819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:00.008819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:00.008819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:00.008819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:00.014829 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 87/159] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:11:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:00.016038 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b60108-80a6-41c9-834a-eab45e48861e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:00.016428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b60108-80a6-41c9-834a-eab45e48861e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:00.016820 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b60108-80a6-41c9-834a-eab45e48861e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:00.022106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3827064-c147-4efc-acbd-a6256ee1ff68 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:00.037933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-87b60108-80a6-41c9-834a-eab45e48861e None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:00.039442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-87b60108-80a6-41c9-834a-eab45e48861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:00.047635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:00.065158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81d28b-e876-49ff-ab3c-fc4e3a19d0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:00.065818 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81d28b-e876-49ff-ab3c-fc4e3a19d0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:00.066100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81d28b-e876-49ff-ab3c-fc4e3a19d0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:00.066378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81d28b-e876-49ff-ab3c-fc4e3a19d0f1 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:00.068097 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81d28b-e876-49ff-ab3c-fc4e3a19d0f1 None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:00.069895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81d28b-e876-49ff-ab3c-fc4e3a19d0f1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:00.072370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 73/160] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:11:59 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:00.073147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81d28b-e876-49ff-ab3c-fc4e3a19d0f1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:00.144776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 88/161] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:00.146072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b60108-80a6-41c9-834a-eab45e48861e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:00.193631 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:00.255245 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b60108-80a6-41c9-834a-eab45e48861e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:00.292818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbaee50-c9ca-4fad-a8b2-cbed85887697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:00.293364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaee50-c9ca-4fad-a8b2-cbed85887697 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:00.293654 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaee50-c9ca-4fad-a8b2-cbed85887697 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:00.293937 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaee50-c9ca-4fad-a8b2-cbed85887697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:00.294784 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbaee50-c9ca-4fad-a8b2-cbed85887697 None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=7bd58a62525c46c888f56577918c1637, user.id=8c0fa3378af3402089d42ceacf7a26b5) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:00.295099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbaee50-c9ca-4fad-a8b2-cbed85887697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:00.296861 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbaee50-c9ca-4fad-a8b2-cbed85887697 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:00.304287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 89/162] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:00 2022] GET /identity/v3/role_assignments?user.id=8c0fa3378af3402089d42ceacf7a26b5&scope.project.id=7bd58a62525c46c888f56577918c1637&role.id=0053c24ce06147938dbb61657a531c94 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:00.305534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc1ed2-8739-46ad-8daa-8d3f93254cef None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:00.305974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc1ed2-8739-46ad-8daa-8d3f93254cef None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:00.306265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc1ed2-8739-46ad-8daa-8d3f93254cef None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:00.307797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 90/163] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:00.308688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc1ed2-8739-46ad-8daa-8d3f93254cef None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:00.388417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81d28b-e876-49ff-ab3c-fc4e3a19d0f1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:00.425327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc1ed2-8739-46ad-8daa-8d3f93254cef None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:00.454782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:00.476870 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62596b-a74f-44a8-92f9-937091044cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:00.477921 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62596b-a74f-44a8-92f9-937091044cdb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:00.478422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62596b-a74f-44a8-92f9-937091044cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:00.479150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62596b-a74f-44a8-92f9-937091044cdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:00.494951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f965b1b-4fb5-4abc-9e1e-6f981f447ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:00.494951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f965b1b-4fb5-4abc-9e1e-6f981f447ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:00.494951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f965b1b-4fb5-4abc-9e1e-6f981f447ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:00.494951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f965b1b-4fb5-4abc-9e1e-6f981f447ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:00.495701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f965b1b-4fb5-4abc-9e1e-6f981f447ca7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:00.495701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f965b1b-4fb5-4abc-9e1e-6f981f447ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:00.495701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f965b1b-4fb5-4abc-9e1e-6f981f447ca7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:00.500087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62596b-a74f-44a8-92f9-937091044cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-7b62596b-a74f-44a8-92f9-937091044cdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:00.505506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:00.510965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:00.511774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:00.511774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:00.511774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:00.511774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:00.511774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:00.511774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:00.511774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:00.511774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:00.511774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:00.511774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:00.511774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:00.511774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:00.514305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 91/165] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:00.515840 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649ac0-3052-4006-841c-48e20484a262 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:00.516338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649ac0-3052-4006-841c-48e20484a262 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:00.516812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649ac0-3052-4006-841c-48e20484a262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:00.518899 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 74/165] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:00.526467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f965b1b-4fb5-4abc-9e1e-6f981f447ca7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:00.548175 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-46649ac0-3052-4006-841c-48e20484a262 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:00.549734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-46649ac0-3052-4006-841c-48e20484a262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:00.629360 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 92/166] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:00.630616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46649ac0-3052-4006-841c-48e20484a262 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:00.666324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:00.731933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:00.737370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46649ac0-3052-4006-841c-48e20484a262 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:00.774552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307c88a-e5c3-48b3-8d0b-25fe110a9cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:00.775335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307c88a-e5c3-48b3-8d0b-25fe110a9cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:00.775776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307c88a-e5c3-48b3-8d0b-25fe110a9cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:00.776123 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307c88a-e5c3-48b3-8d0b-25fe110a9cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:00.776920 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307c88a-e5c3-48b3-8d0b-25fe110a9cc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:00.777327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307c88a-e5c3-48b3-8d0b-25fe110a9cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:00.778848 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307c88a-e5c3-48b3-8d0b-25fe110a9cc1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:00.788860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 93/167] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:00.789827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307c88a-e5c3-48b3-8d0b-25fe110a9cc1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:00.836838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f965b1b-4fb5-4abc-9e1e-6f981f447ca7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:00.896280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307c88a-e5c3-48b3-8d0b-25fe110a9cc1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:00.931537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd99684-0723-44f6-941d-a981d800c5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:00.932320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd99684-0723-44f6-941d-a981d800c5eb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:00.932673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd99684-0723-44f6-941d-a981d800c5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:00.933038 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd99684-0723-44f6-941d-a981d800c5eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:00.943618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd99684-0723-44f6-941d-a981d800c5eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-7fd99684-0723-44f6-941d-a981d800c5eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:00.958434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:00.959382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:00.960878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:00.960878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:00.960878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:00.960878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:00.960878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:00.960878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:00.960878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:00.960878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:00.960878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:00.960878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:00.960878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:00.960878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:00.960878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 94/168] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:12:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:00.961548 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd99684-0723-44f6-941d-a981d800c5eb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:00.987729 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc5916-80c1-4f4b-a2d1-806da5961d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:00.988403 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5916-80c1-4f4b-a2d1-806da5961d8f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:00.988607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:00.988720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5916-80c1-4f4b-a2d1-806da5961d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:00.988940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5916-80c1-4f4b-a2d1-806da5961d8f None admin] PATH_INFO: `/v3/users/89b639595caf4cabbca58dbf898454c2` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:00.990134 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc5916-80c1-4f4b-a2d1-806da5961d8f None admin] RBAC: Authorizing `identity:get_user(user_id=89b639595caf4cabbca58dbf898454c2)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:00.992713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc5916-80c1-4f4b-a2d1-806da5961d8f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:00.994777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 75/169] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:00 2022] GET /identity/v3/users/89b639595caf4cabbca58dbf898454c2 => generated 289 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:00.997941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc5916-80c1-4f4b-a2d1-806da5961d8f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:01.135520 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd99684-0723-44f6-941d-a981d800c5eb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:01.168243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc5916-80c1-4f4b-a2d1-806da5961d8f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:01.190260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336562b-7b81-403b-abf7-47525ef0df88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:01.190977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336562b-7b81-403b-abf7-47525ef0df88 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:01.191258 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336562b-7b81-403b-abf7-47525ef0df88 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:01.191531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336562b-7b81-403b-abf7-47525ef0df88 None admin] PATH_INFO: `/v3/users/cc4961f214f64c8f9d7137d2763ee3e7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:01.192777 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336562b-7b81-403b-abf7-47525ef0df88 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4961f214f64c8f9d7137d2763ee3e7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:01.194921 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336562b-7b81-403b-abf7-47525ef0df88 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:01.196999 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 95/170] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:00 2022] GET /identity/v3/users/cc4961f214f64c8f9d7137d2763ee3e7 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:01.203133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336562b-7b81-403b-abf7-47525ef0df88 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:01.205185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:01.303176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65653-fe89-4275-8e32-cbff21044fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:01.303838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65653-fe89-4275-8e32-cbff21044fda None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:01.304130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65653-fe89-4275-8e32-cbff21044fda None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:01.304439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65653-fe89-4275-8e32-cbff21044fda None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:01.305184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf65653-fe89-4275-8e32-cbff21044fda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:01.305498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf65653-fe89-4275-8e32-cbff21044fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:01.306941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf65653-fe89-4275-8e32-cbff21044fda None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:01.308700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:01.326787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 76/171] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:01.327469 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65653-fe89-4275-8e32-cbff21044fda None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:01.337409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336562b-7b81-403b-abf7-47525ef0df88 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:01.384001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e20d9c-fd6c-4861-b62d-b4fee6880336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:01.385200 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e20d9c-fd6c-4861-b62d-b4fee6880336 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:01.386553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e20d9c-fd6c-4861-b62d-b4fee6880336 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:01.387721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e20d9c-fd6c-4861-b62d-b4fee6880336 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:01.390165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e20d9c-fd6c-4861-b62d-b4fee6880336 None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:01.393670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e20d9c-fd6c-4861-b62d-b4fee6880336 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:01.398600 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 96/172] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:01 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:01.399702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e20d9c-fd6c-4861-b62d-b4fee6880336 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:01.536215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65653-fe89-4275-8e32-cbff21044fda None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:01.580401 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e20d9c-fd6c-4861-b62d-b4fee6880336 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:01.613300 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e2733-1e7d-4eaf-94e3-b048c270c20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:01.614287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e2733-1e7d-4eaf-94e3-b048c270c20a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:01.614838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e2733-1e7d-4eaf-94e3-b048c270c20a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:01.615318 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e2733-1e7d-4eaf-94e3-b048c270c20a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:01.626064 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef60420-e5c4-4896-bab7-0489cdd676f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:01.626249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef60420-e5c4-4896-bab7-0489cdd676f8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:01.631029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef60420-e5c4-4896-bab7-0489cdd676f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef60420-e5c4-4896-bab7-0489cdd676f8 None admin] PATH_INFO: `/v3/users/cc4961f214f64c8f9d7137d2763ee3e7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:01.633179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef60420-e5c4-4896-bab7-0489cdd676f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4961f214f64c8f9d7137d2763ee3e7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:01.634868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef60420-e5c4-4896-bab7-0489cdd676f8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:01.636841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 97/173] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:01 2022] GET /identity/v3/users/cc4961f214f64c8f9d7137d2763ee3e7 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:01.639630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef60420-e5c4-4896-bab7-0489cdd676f8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:01.688374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:01.723586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:01.775598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e2733-1e7d-4eaf-94e3-b048c270c20a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:01.776308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef60420-e5c4-4896-bab7-0489cdd676f8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:01.777094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e2733-1e7d-4eaf-94e3-b048c270c20a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:01.821588 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515ece7-b34a-49f5-b86f-5a48f3708286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:01.822281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515ece7-b34a-49f5-b86f-5a48f3708286 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:01.822589 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515ece7-b34a-49f5-b86f-5a48f3708286 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:01.822863 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515ece7-b34a-49f5-b86f-5a48f3708286 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637/users/89b639595caf4cabbca58dbf898454c2/roles/fdbe1fc69914484591390937886dfbfa` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:01.825016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515ece7-b34a-49f5-b86f-5a48f3708286 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bd58a62525c46c888f56577918c1637, user_id=89b639595caf4cabbca58dbf898454c2, role_id=fdbe1fc69914484591390937886dfbfa)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:01.826935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515ece7-b34a-49f5-b86f-5a48f3708286 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:01.858491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 98/174] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:12:01 2022] PUT /identity/v3/projects/7bd58a62525c46c888f56577918c1637/users/89b639595caf4cabbca58dbf898454c2/roles/fdbe1fc69914484591390937886dfbfa => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:12:01.859838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515ece7-b34a-49f5-b86f-5a48f3708286 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:01.961686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 77/175] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:01.978031 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e2733-1e7d-4eaf-94e3-b048c270c20a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:02.019957 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:02.056783 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515ece7-b34a-49f5-b86f-5a48f3708286 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:02.127371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d46572-13eb-4aff-bafb-5e9cb2c641bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:02.128027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d46572-13eb-4aff-bafb-5e9cb2c641bf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:02.128315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d46572-13eb-4aff-bafb-5e9cb2c641bf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:02.128592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d46572-13eb-4aff-bafb-5e9cb2c641bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:02.198027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:02.230096 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d46572-13eb-4aff-bafb-5e9cb2c641bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:02.231556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d46572-13eb-4aff-bafb-5e9cb2c641bf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:02.246783 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e2733-1e7d-4eaf-94e3-b048c270c20a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:02.285778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c21fa6-f307-4f2c-be62-6f061ad132f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:02.286468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c21fa6-f307-4f2c-be62-6f061ad132f2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:02.286755 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c21fa6-f307-4f2c-be62-6f061ad132f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:02.287031 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c21fa6-f307-4f2c-be62-6f061ad132f2 None admin] PATH_INFO: `/v3/projects/30ce2cc4671148318b411f3e15c47c0f` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:02.288799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c21fa6-f307-4f2c-be62-6f061ad132f2 None admin] RBAC: Authorizing `identity:get_project(project_id=30ce2cc4671148318b411f3e15c47c0f)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:02.290247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c21fa6-f307-4f2c-be62-6f061ad132f2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:02.292111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 78/176] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:01 2022] GET /identity/v3/projects/30ce2cc4671148318b411f3e15c47c0f => generated 312 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:02.293113 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5a5cb-f610-4c81-b43d-cdad3410580a None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:02.293397 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5a5cb-f610-4c81-b43d-cdad3410580a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:02.293673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5a5cb-f610-4c81-b43d-cdad3410580a None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:02.294979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 79/177] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:02.296019 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095d529-6b1c-4b56-aabf-3fb564522872 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:02.296300 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095d529-6b1c-4b56-aabf-3fb564522872 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:02.296577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095d529-6b1c-4b56-aabf-3fb564522872 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:02.298088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 80/178] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:02.302272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40239a-622d-4f54-b0b5-77a4bcf59cca None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:02.302604 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40239a-622d-4f54-b0b5-77a4bcf59cca None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:02.302881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40239a-622d-4f54-b0b5-77a4bcf59cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:02.322296 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-bd40239a-622d-4f54-b0b5-77a4bcf59cca None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:02.323522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-bd40239a-622d-4f54-b0b5-77a4bcf59cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:02.331135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:02.354274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 99/179] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:02.355560 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224999c-1540-4554-b43a-ce5d75540d59 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:02.355844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224999c-1540-4554-b43a-ce5d75540d59 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:02.356115 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224999c-1540-4554-b43a-ce5d75540d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:02.378096 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5224999c-1540-4554-b43a-ce5d75540d59 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:02.379319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5224999c-1540-4554-b43a-ce5d75540d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:02.398056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 81/180] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:02.403279 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40239a-622d-4f54-b0b5-77a4bcf59cca None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:02.449600 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 100/181] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:02.449600 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224999c-1540-4554-b43a-ce5d75540d59 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:02.505230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:02.531864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40239a-622d-4f54-b0b5-77a4bcf59cca None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:02.564843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224999c-1540-4554-b43a-ce5d75540d59 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:02.568251 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fb01c-6061-4b4f-b9a5-7ee8389117aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:02.569428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fb01c-6061-4b4f-b9a5-7ee8389117aa None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:02.569918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fb01c-6061-4b4f-b9a5-7ee8389117aa None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:02.570370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fb01c-6061-4b4f-b9a5-7ee8389117aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:02.571384 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fb01c-6061-4b4f-b9a5-7ee8389117aa None admin] RBAC: Adding query filter params (role.id=d295e312e144479ca8f748650ac995a4, scope.project.id=30ce2cc4671148318b411f3e15c47c0f, user.id=cc4961f214f64c8f9d7137d2763ee3e7) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:02.571877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fb01c-6061-4b4f-b9a5-7ee8389117aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:02.573480 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fb01c-6061-4b4f-b9a5-7ee8389117aa None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:02.578960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:02.580529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 82/182] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:02 2022] GET /identity/v3/role_assignments?user.id=cc4961f214f64c8f9d7137d2763ee3e7&scope.project.id=30ce2cc4671148318b411f3e15c47c0f&role.id=d295e312e144479ca8f748650ac995a4 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:02.582191 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37b5f4-32ab-4b87-9625-e4db4cdd3684 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:02.582500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37b5f4-32ab-4b87-9625-e4db4cdd3684 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:02.582782 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37b5f4-32ab-4b87-9625-e4db4cdd3684 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:02.586638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 83/183] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:02.586638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37b5f4-32ab-4b87-9625-e4db4cdd3684 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:02.617354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f097f47-7e5f-4856-b115-23befe683b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:02.618442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f097f47-7e5f-4856-b115-23befe683b1f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:02.618575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f097f47-7e5f-4856-b115-23befe683b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:02.618979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f097f47-7e5f-4856-b115-23befe683b1f None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:02.620468 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f097f47-7e5f-4856-b115-23befe683b1f None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:02.622389 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f097f47-7e5f-4856-b115-23befe683b1f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:02.624793 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 101/184] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:02 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:02.625872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f097f47-7e5f-4856-b115-23befe683b1f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:02.736542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37b5f4-32ab-4b87-9625-e4db4cdd3684 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:02.764163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f097f47-7e5f-4856-b115-23befe683b1f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:02.783345 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10308f05-278e-425c-8ecb-fc02c82723d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:02.784169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10308f05-278e-425c-8ecb-fc02c82723d3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:02.784526 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10308f05-278e-425c-8ecb-fc02c82723d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:02.784883 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10308f05-278e-425c-8ecb-fc02c82723d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:02.800679 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:02.801839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10308f05-278e-425c-8ecb-fc02c82723d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-10308f05-278e-425c-8ecb-fc02c82723d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:02.808558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:02.809576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:02.810350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:02.810350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:02.810350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:02.810350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:02.810350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:02.810350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:02.810350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:02.810350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:02.810350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:02.810350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:02.810350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:12:02.810350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:02.810350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 84/185] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:12:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:02.810350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c81df-3006-4911-a631-789095be896f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:02.811130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c81df-3006-4911-a631-789095be896f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:02.811130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c81df-3006-4911-a631-789095be896f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:02.812912 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81fc57-e9ce-479d-bbe7-b7f4adb08db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:02.814265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81fc57-e9ce-479d-bbe7-b7f4adb08db0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:02.814998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81fc57-e9ce-479d-bbe7-b7f4adb08db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:02.815413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81fc57-e9ce-479d-bbe7-b7f4adb08db0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:02.829935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81fc57-e9ce-479d-bbe7-b7f4adb08db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:02.834198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-ef4c81df-3006-4911-a631-789095be896f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:02.836007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ef4c81df-3006-4911-a631-789095be896f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-8e81fc57-e9ce-479d-bbe7-b7f4adb08db0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:02.836422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:02.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:02.838782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:02.838782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:02.838782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:02.838782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:02.838782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:02.838782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:02.838782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:02.838782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:02.838782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:02.838782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:02.838782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:02.838782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:02.841615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 102/186] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:12:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:02.842671 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81fc57-e9ce-479d-bbe7-b7f4adb08db0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:02.890486 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:02.916978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 85/187] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:02.918132 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c81df-3006-4911-a631-789095be896f None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:02.961253 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81fc57-e9ce-479d-bbe7-b7f4adb08db0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:02.995775 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f51dd-610b-47bd-bc67-9d129f442f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:02.996386 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f51dd-610b-47bd-bc67-9d129f442f90 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:02.996664 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f51dd-610b-47bd-bc67-9d129f442f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:02.996936 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f51dd-610b-47bd-bc67-9d129f442f90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:02.997729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f51dd-610b-47bd-bc67-9d129f442f90 None admin] RBAC: Adding query filter params (role.id=b371b8f12e7348e8b01784eeddeca2ac, scope.project.id=7bd58a62525c46c888f56577918c1637, user.id=cc4961f214f64c8f9d7137d2763ee3e7) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:02.998035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f51dd-610b-47bd-bc67-9d129f442f90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:02.999530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f51dd-610b-47bd-bc67-9d129f442f90 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:03.005272 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 103/188] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:02 2022] GET /identity/v3/role_assignments?user.id=cc4961f214f64c8f9d7137d2763ee3e7&scope.project.id=7bd58a62525c46c888f56577918c1637&role.id=b371b8f12e7348e8b01784eeddeca2ac => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:03.006055 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f51dd-610b-47bd-bc67-9d129f442f90 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:03.047170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c81df-3006-4911-a631-789095be896f None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:03.091604 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:03.097674 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61467248-c314-4232-8291-14ec73a55ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:03.099203 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61467248-c314-4232-8291-14ec73a55ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:03.099855 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61467248-c314-4232-8291-14ec73a55ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:03.100445 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61467248-c314-4232-8291-14ec73a55ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:03.101362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61467248-c314-4232-8291-14ec73a55ef2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:03.102108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61467248-c314-4232-8291-14ec73a55ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:03.104848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61467248-c314-4232-8291-14ec73a55ef2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:03.118377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 86/189] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:03.120618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61467248-c314-4232-8291-14ec73a55ef2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:03.135120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f51dd-610b-47bd-bc67-9d129f442f90 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:03.138636 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:03.185948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979485-038a-4f9c-bc2f-1887e83639c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:03.187099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979485-038a-4f9c-bc2f-1887e83639c8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:03.187596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979485-038a-4f9c-bc2f-1887e83639c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:03.188329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979485-038a-4f9c-bc2f-1887e83639c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:03.189247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b979485-038a-4f9c-bc2f-1887e83639c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:03.189772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b979485-038a-4f9c-bc2f-1887e83639c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:03.191835 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b979485-038a-4f9c-bc2f-1887e83639c8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:03.203975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 104/190] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:03.205113 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979485-038a-4f9c-bc2f-1887e83639c8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:03.251588 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61467248-c314-4232-8291-14ec73a55ef2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:03.292593 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290643d6-93b5-444f-abb5-649877fc42d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:03.293705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290643d6-93b5-444f-abb5-649877fc42d9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:03.293705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290643d6-93b5-444f-abb5-649877fc42d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:03.293995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290643d6-93b5-444f-abb5-649877fc42d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:03.295278 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290643d6-93b5-444f-abb5-649877fc42d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:03.296772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290643d6-93b5-444f-abb5-649877fc42d9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:03.298715 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 87/191] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:03.299466 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290643d6-93b5-444f-abb5-649877fc42d9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:03.334794 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979485-038a-4f9c-bc2f-1887e83639c8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:03.361206 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:03.372546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b044b-254a-4396-9d93-bd378d5ec426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:03.373235 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b044b-254a-4396-9d93-bd378d5ec426 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:03.373521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b044b-254a-4396-9d93-bd378d5ec426 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:03.374387 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b044b-254a-4396-9d93-bd378d5ec426 None admin] PATH_INFO: `/v3/users/4cfaec0dd6c1462989da67520fab9d16` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:03.387677 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b044b-254a-4396-9d93-bd378d5ec426 None admin] RBAC: Authorizing `identity:get_user(user_id=4cfaec0dd6c1462989da67520fab9d16)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:03.389682 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b044b-254a-4396-9d93-bd378d5ec426 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:03.391534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 105/192] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:03 2022] GET /identity/v3/users/4cfaec0dd6c1462989da67520fab9d16 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:03.392105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b044b-254a-4396-9d93-bd378d5ec426 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:03.408521 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290643d6-93b5-444f-abb5-649877fc42d9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:03.421818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:03.445250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c222277-20df-4ac2-bb5b-3a68631a4c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:03.446183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c222277-20df-4ac2-bb5b-3a68631a4c8d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:03.449472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c222277-20df-4ac2-bb5b-3a68631a4c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:03.449472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c222277-20df-4ac2-bb5b-3a68631a4c8d None admin] PATH_INFO: `/v3/users/4cfaec0dd6c1462989da67520fab9d16` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:03.449472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c222277-20df-4ac2-bb5b-3a68631a4c8d None admin] RBAC: Authorizing `identity:get_user(user_id=4cfaec0dd6c1462989da67520fab9d16)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:03.449783 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c222277-20df-4ac2-bb5b-3a68631a4c8d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:03.451696 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 88/193] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:03 2022] GET /identity/v3/users/4cfaec0dd6c1462989da67520fab9d16 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:03.454529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c222277-20df-4ac2-bb5b-3a68631a4c8d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:03.513995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b044b-254a-4396-9d93-bd378d5ec426 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:03.551384 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745838ce-e426-4918-8575-5c7d6dafb9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:03.551930 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745838ce-e426-4918-8575-5c7d6dafb9e7 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:03.552206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745838ce-e426-4918-8575-5c7d6dafb9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:03.552476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745838ce-e426-4918-8575-5c7d6dafb9e7 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:03.553809 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745838ce-e426-4918-8575-5c7d6dafb9e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:03.555399 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745838ce-e426-4918-8575-5c7d6dafb9e7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:03.556929 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c222277-20df-4ac2-bb5b-3a68631a4c8d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:03.586436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 106/194] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:12:03 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:12:03.586436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745838ce-e426-4918-8575-5c7d6dafb9e7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:03.593908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:03.604161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482737c-5818-423e-9216-5189b6f7e86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:03.604802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482737c-5818-423e-9216-5189b6f7e86e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:03.605085 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482737c-5818-423e-9216-5189b6f7e86e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:03.605364 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482737c-5818-423e-9216-5189b6f7e86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:03.687388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482737c-5818-423e-9216-5189b6f7e86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:03.689196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482737c-5818-423e-9216-5189b6f7e86e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:03.706884 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:03.730796 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745838ce-e426-4918-8575-5c7d6dafb9e7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:03.770233 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e227bb-5306-4d26-8047-307408cb1e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:03.770916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e227bb-5306-4d26-8047-307408cb1e5d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:03.771221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e227bb-5306-4d26-8047-307408cb1e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:03.771566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e227bb-5306-4d26-8047-307408cb1e5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:03.806215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 89/195] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:03.811790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482737c-5818-423e-9216-5189b6f7e86e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:03.849322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:03.857024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e227bb-5306-4d26-8047-307408cb1e5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:03.857180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e227bb-5306-4d26-8047-307408cb1e5d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:03.942846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482737c-5818-423e-9216-5189b6f7e86e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:03.957115 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:03.987927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 107/196] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:03.996231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e227bb-5306-4d26-8047-307408cb1e5d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:03.996847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3b65f-b074-48c1-af06-cbda1fe714ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:03.997726 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3b65f-b074-48c1-af06-cbda1fe714ea None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:03.998186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3b65f-b074-48c1-af06-cbda1fe714ea None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:03.998663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3b65f-b074-48c1-af06-cbda1fe714ea None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:04.000835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3b65f-b074-48c1-af06-cbda1fe714ea None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:04.002550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3b65f-b074-48c1-af06-cbda1fe714ea None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:04.004463 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 90/197] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:03 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:04.011400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3b65f-b074-48c1-af06-cbda1fe714ea None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:04.135123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:04.144169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3b65f-b074-48c1-af06-cbda1fe714ea None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:04.171455 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e227bb-5306-4d26-8047-307408cb1e5d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:04.211609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1262b98-9bc7-4773-b95d-0155a9c4935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:04.212247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1262b98-9bc7-4773-b95d-0155a9c4935a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:04.212527 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1262b98-9bc7-4773-b95d-0155a9c4935a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:04.212799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1262b98-9bc7-4773-b95d-0155a9c4935a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:04.213598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1262b98-9bc7-4773-b95d-0155a9c4935a None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=a33fb2c471ff405e8562d6379c3558bd, user.id=4cfaec0dd6c1462989da67520fab9d16) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:04.214113 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1262b98-9bc7-4773-b95d-0155a9c4935a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:04.216622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1262b98-9bc7-4773-b95d-0155a9c4935a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:04.228341 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 91/198] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:04 2022] GET /identity/v3/role_assignments?user.id=4cfaec0dd6c1462989da67520fab9d16&scope.project.id=a33fb2c471ff405e8562d6379c3558bd&role.id=0053c24ce06147938dbb61657a531c94 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:04.235700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144f2e7-6a02-47cf-88db-211aabb26049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:04.236375 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144f2e7-6a02-47cf-88db-211aabb26049 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:04.236659 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144f2e7-6a02-47cf-88db-211aabb26049 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:04.236940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144f2e7-6a02-47cf-88db-211aabb26049 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:04.238283 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144f2e7-6a02-47cf-88db-211aabb26049 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:04.239901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144f2e7-6a02-47cf-88db-211aabb26049 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:04.242304 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 108/199] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:03 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:04.248535 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1262b98-9bc7-4773-b95d-0155a9c4935a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:04.257297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe90ce-0c18-442a-9251-86a3713823fe None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:04.257601 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe90ce-0c18-442a-9251-86a3713823fe None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:04.257847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe90ce-0c18-442a-9251-86a3713823fe None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:04.259304 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 109/200] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:04.271818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5587710-82eb-4dac-b0b4-5bbdf8909dc5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:04.272151 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5587710-82eb-4dac-b0b4-5bbdf8909dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:04.272407 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5587710-82eb-4dac-b0b4-5bbdf8909dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:04.319593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b5587710-82eb-4dac-b0b4-5bbdf8909dc5 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:04.320884 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b5587710-82eb-4dac-b0b4-5bbdf8909dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:04.384021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:04.409068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1262b98-9bc7-4773-b95d-0155a9c4935a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:04.411080 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 110/201] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:04.454654 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5587710-82eb-4dac-b0b4-5bbdf8909dc5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:04.481288 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4d783-70d9-45b7-8246-ff2c8c6f932c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:04.481922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4d783-70d9-45b7-8246-ff2c8c6f932c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:04.482205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4d783-70d9-45b7-8246-ff2c8c6f932c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:04.482510 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4d783-70d9-45b7-8246-ff2c8c6f932c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:04.483323 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4d783-70d9-45b7-8246-ff2c8c6f932c None admin] RBAC: Adding query filter params (role.id=b371b8f12e7348e8b01784eeddeca2ac, scope.project.id=a33fb2c471ff405e8562d6379c3558bd, user.id=4cfaec0dd6c1462989da67520fab9d16) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:04.483635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4d783-70d9-45b7-8246-ff2c8c6f932c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:04.485077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4d783-70d9-45b7-8246-ff2c8c6f932c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:04.495129 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 92/202] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:04 2022] GET /identity/v3/role_assignments?user.id=4cfaec0dd6c1462989da67520fab9d16&scope.project.id=a33fb2c471ff405e8562d6379c3558bd&role.id=b371b8f12e7348e8b01784eeddeca2ac => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:04.602519 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5587710-82eb-4dac-b0b4-5bbdf8909dc5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:04.643071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe031a7-8ac2-47f8-b355-02a0e0ce5a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:04.644014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe031a7-8ac2-47f8-b355-02a0e0ce5a99 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:04.644444 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe031a7-8ac2-47f8-b355-02a0e0ce5a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:04.644875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe031a7-8ac2-47f8-b355-02a0e0ce5a99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:04.658911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe031a7-8ac2-47f8-b355-02a0e0ce5a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-5fe031a7-8ac2-47f8-b355-02a0e0ce5a99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:04.667338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:04.668573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:04.669579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:04.669579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:04.669579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:04.669579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:04.669579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:04.669579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:04.669579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:04.669579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:04.669579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:04.669579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:04.669579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:04.669579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:04.672029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 111/203] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:04.679471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4d783-70d9-45b7-8246-ff2c8c6f932c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:04.721774 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:04.803958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4d783-70d9-45b7-8246-ff2c8c6f932c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:04.841867 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fba3d3-afd6-4b5c-b797-06ab0e27b690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:04.842639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fba3d3-afd6-4b5c-b797-06ab0e27b690 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:04.843148 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fba3d3-afd6-4b5c-b797-06ab0e27b690 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:04.843616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fba3d3-afd6-4b5c-b797-06ab0e27b690 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:04.844349 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fba3d3-afd6-4b5c-b797-06ab0e27b690 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:04.844658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fba3d3-afd6-4b5c-b797-06ab0e27b690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:04.846041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fba3d3-afd6-4b5c-b797-06ab0e27b690 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:04.858193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 93/204] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:04.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe031a7-8ac2-47f8-b355-02a0e0ce5a99 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:04.926773 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:05.002567 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe031a7-8ac2-47f8-b355-02a0e0ce5a99 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:05.049592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295bf7c-2e88-4801-9635-d4f304b6823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:05.050249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295bf7c-2e88-4801-9635-d4f304b6823c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:05.050558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295bf7c-2e88-4801-9635-d4f304b6823c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:05.050837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295bf7c-2e88-4801-9635-d4f304b6823c None admin] PATH_INFO: `/v3/users/89b639595caf4cabbca58dbf898454c2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:05.052037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295bf7c-2e88-4801-9635-d4f304b6823c None admin] RBAC: Authorizing `identity:get_user(user_id=89b639595caf4cabbca58dbf898454c2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:05.055543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295bf7c-2e88-4801-9635-d4f304b6823c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:05.059273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 112/205] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:04 2022] GET /identity/v3/users/89b639595caf4cabbca58dbf898454c2 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:05.068344 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fba3d3-afd6-4b5c-b797-06ab0e27b690 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:05.183724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:05.200699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fba3d3-afd6-4b5c-b797-06ab0e27b690 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:05.249476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78b9a6-54b5-4c66-a231-0f859c2bcedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:05.250124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78b9a6-54b5-4c66-a231-0f859c2bcedb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:05.250428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78b9a6-54b5-4c66-a231-0f859c2bcedb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:05.250709 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78b9a6-54b5-4c66-a231-0f859c2bcedb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:05.344630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78b9a6-54b5-4c66-a231-0f859c2bcedb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:05.346122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78b9a6-54b5-4c66-a231-0f859c2bcedb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:05.433294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:05.456500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 94/206] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:05.465554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295bf7c-2e88-4801-9635-d4f304b6823c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:05.595457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295bf7c-2e88-4801-9635-d4f304b6823c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:05.607400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:05.641928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ee063-4267-4f4b-9283-c068ddbeb2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:05.642600 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ee063-4267-4f4b-9283-c068ddbeb2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:05.642881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ee063-4267-4f4b-9283-c068ddbeb2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:05.643152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ee063-4267-4f4b-9283-c068ddbeb2e3 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:05.647139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ee063-4267-4f4b-9283-c068ddbeb2e3 None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:05.648657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ee063-4267-4f4b-9283-c068ddbeb2e3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:05.650667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 113/207] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:05 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:05.656552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78b9a6-54b5-4c66-a231-0f859c2bcedb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:05.792385 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78b9a6-54b5-4c66-a231-0f859c2bcedb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:05.833556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ad2a4-7431-4c03-ae6c-1b7ca9430cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:05.834187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad2a4-7431-4c03-ae6c-1b7ca9430cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:05.834522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad2a4-7431-4c03-ae6c-1b7ca9430cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:05.834803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad2a4-7431-4c03-ae6c-1b7ca9430cc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:05.835659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ad2a4-7431-4c03-ae6c-1b7ca9430cc9 None admin] RBAC: Adding query filter params (role.id=fdbe1fc69914484591390937886dfbfa, scope.project.id=7bd58a62525c46c888f56577918c1637, user.id=89b639595caf4cabbca58dbf898454c2) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:05.835976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ad2a4-7431-4c03-ae6c-1b7ca9430cc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:05.837419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ad2a4-7431-4c03-ae6c-1b7ca9430cc9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:05.843983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 95/208] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:05 2022] GET /identity/v3/role_assignments?user.id=89b639595caf4cabbca58dbf898454c2&scope.project.id=7bd58a62525c46c888f56577918c1637&role.id=fdbe1fc69914484591390937886dfbfa => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:06.177501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b953b7-ee46-41b7-a7b9-12060722ec14 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:06.178013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b953b7-ee46-41b7-a7b9-12060722ec14 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:06.178013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b953b7-ee46-41b7-a7b9-12060722ec14 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:06.179451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 114/209] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:06.184561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ab27-4e00-4eac-8ef9-2cd6552a6a0e None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:06.184843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ab27-4e00-4eac-8ef9-2cd6552a6a0e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:06.185116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62ab27-4e00-4eac-8ef9-2cd6552a6a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:06.206442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-0a62ab27-4e00-4eac-8ef9-2cd6552a6a0e None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:06.207645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0a62ab27-4e00-4eac-8ef9-2cd6552a6a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:06.266239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:06.291115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 96/210] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:06.314388 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b953b7-ee46-41b7-a7b9-12060722ec14 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:06.432974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b953b7-ee46-41b7-a7b9-12060722ec14 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:06.482364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd57e73-8693-4352-8659-87c297f5a50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:06.483107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd57e73-8693-4352-8659-87c297f5a50d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:06.483371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd57e73-8693-4352-8659-87c297f5a50d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:06.483642 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd57e73-8693-4352-8659-87c297f5a50d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:06.497123 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd57e73-8693-4352-8659-87c297f5a50d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2dd57e73-8693-4352-8659-87c297f5a50d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:06.501995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:06.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:06.503718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:06.503718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:06.503718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:06.503718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:06.503718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:06.503718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:06.503718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:06.503718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:06.503718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:06.503718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:06.503718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:06.503718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:06.503718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 115/211] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:06.509568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62ab27-4e00-4eac-8ef9-2cd6552a6a0e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:06.548530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f039d-6ff2-48bc-b3d9-98f97ceadc52 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:06.548876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f039d-6ff2-48bc-b3d9-98f97ceadc52 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:06.549099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f039d-6ff2-48bc-b3d9-98f97ceadc52 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:06.551722 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 116/212] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:06.556041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb7d9a-c30f-4b7a-bfda-2228a5bd0dbe None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:06.556041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb7d9a-c30f-4b7a-bfda-2228a5bd0dbe None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:06.556339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb7d9a-c30f-4b7a-bfda-2228a5bd0dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:06.577395 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-99cb7d9a-c30f-4b7a-bfda-2228a5bd0dbe None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:06.578885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-99cb7d9a-c30f-4b7a-bfda-2228a5bd0dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:06.619667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:06.628719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62ab27-4e00-4eac-8ef9-2cd6552a6a0e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:06.669584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 117/213] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:06.671949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468d0f6-918b-4cb2-8df9-adb9b3e9bf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:06.672810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468d0f6-918b-4cb2-8df9-adb9b3e9bf00 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:06.673293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468d0f6-918b-4cb2-8df9-adb9b3e9bf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:06.673777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468d0f6-918b-4cb2-8df9-adb9b3e9bf00 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:06.674769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468d0f6-918b-4cb2-8df9-adb9b3e9bf00 None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:06.675300 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468d0f6-918b-4cb2-8df9-adb9b3e9bf00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:06.677166 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468d0f6-918b-4cb2-8df9-adb9b3e9bf00 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:06.677566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8c0b6-62d2-4dd9-bf4a-0c9fb53bd173 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:06.677858 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8c0b6-62d2-4dd9-bf4a-0c9fb53bd173 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:06.678175 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8c0b6-62d2-4dd9-bf4a-0c9fb53bd173 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:06.680444 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 118/214] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:12:06.686736 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb03d1-dd45-456d-bc2a-a65e17294ee7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:06.686863 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 97/215] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:06.686953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb03d1-dd45-456d-bc2a-a65e17294ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:06.687154 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb03d1-dd45-456d-bc2a-a65e17294ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:06.694438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468d0f6-918b-4cb2-8df9-adb9b3e9bf00 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:06.710945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b7eb03d1-dd45-456d-bc2a-a65e17294ee7 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:06.711907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b7eb03d1-dd45-456d-bc2a-a65e17294ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:06.745904 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:06.783028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 119/216] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:06.784331 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb03d1-dd45-456d-bc2a-a65e17294ee7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:06.813540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468d0f6-918b-4cb2-8df9-adb9b3e9bf00 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:06.848741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6caa3b-93d9-489b-8682-45f0502e24c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:06.849388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6caa3b-93d9-489b-8682-45f0502e24c8 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:06.849673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6caa3b-93d9-489b-8682-45f0502e24c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:06.849974 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6caa3b-93d9-489b-8682-45f0502e24c8 None admin] PATH_INFO: `/v3/users/3461ef7e626e47f089164d33654b4273` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:06.866801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6caa3b-93d9-489b-8682-45f0502e24c8 None admin] RBAC: Authorizing `identity:get_user(user_id=3461ef7e626e47f089164d33654b4273)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:06.868259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6caa3b-93d9-489b-8682-45f0502e24c8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:06.869916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 98/217] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:06 2022] GET /identity/v3/users/3461ef7e626e47f089164d33654b4273 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:06.870717 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6caa3b-93d9-489b-8682-45f0502e24c8 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:06.902314 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:06.910993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb03d1-dd45-456d-bc2a-a65e17294ee7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:06.947894 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1b80d-dc15-406d-9c40-dedb00b3ffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:06.948804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1b80d-dc15-406d-9c40-dedb00b3ffb0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:06.949266 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1b80d-dc15-406d-9c40-dedb00b3ffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:06.949833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1b80d-dc15-406d-9c40-dedb00b3ffb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:06.951572 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1b80d-dc15-406d-9c40-dedb00b3ffb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:06.953335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1b80d-dc15-406d-9c40-dedb00b3ffb0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:06.955613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 120/218] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:06.956736 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1b80d-dc15-406d-9c40-dedb00b3ffb0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:06.977562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:06.981296 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6caa3b-93d9-489b-8682-45f0502e24c8 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:07.027203 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2977c5f-32d2-4ee5-b16b-abb5d5d7fd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:07.027853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2977c5f-32d2-4ee5-b16b-abb5d5d7fd3f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:07.028139 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2977c5f-32d2-4ee5-b16b-abb5d5d7fd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:07.028419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2977c5f-32d2-4ee5-b16b-abb5d5d7fd3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:07.041935 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2977c5f-32d2-4ee5-b16b-abb5d5d7fd3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-e2977c5f-32d2-4ee5-b16b-abb5d5d7fd3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:07.046887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:07.048000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:07.048972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:07.048972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:07.048972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:07.048972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:07.048972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:07.048972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:07.048972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:07.048972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:07.048972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:07.048972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:07.048972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:12:07.048972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:07.048972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 99/219] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:12:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:07.049799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2977c5f-32d2-4ee5-b16b-abb5d5d7fd3f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:07.066133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1b80d-dc15-406d-9c40-dedb00b3ffb0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:07.105367 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e223727-92e4-4af0-954a-8cb6dc5e7a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:07.105989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e223727-92e4-4af0-954a-8cb6dc5e7a9b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:07.106269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e223727-92e4-4af0-954a-8cb6dc5e7a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:07.106589 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e223727-92e4-4af0-954a-8cb6dc5e7a9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:07.135714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:07.155018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2977c5f-32d2-4ee5-b16b-abb5d5d7fd3f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:07.174089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e223727-92e4-4af0-954a-8cb6dc5e7a9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:07.175599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e223727-92e4-4af0-954a-8cb6dc5e7a9b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:07.187695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffbf77-3dc6-4bf9-8b02-835bc90f6163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:07.188321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffbf77-3dc6-4bf9-8b02-835bc90f6163 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:07.188606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffbf77-3dc6-4bf9-8b02-835bc90f6163 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:07.188885 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffbf77-3dc6-4bf9-8b02-835bc90f6163 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:07.189574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffbf77-3dc6-4bf9-8b02-835bc90f6163 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:07.191043 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffbf77-3dc6-4bf9-8b02-835bc90f6163 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:07.213635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 100/220] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:12:07 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:12:07.215070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f033e-0630-468b-889d-76e0fac3901b None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:07.215070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f033e-0630-468b-889d-76e0fac3901b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:07.215365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f033e-0630-468b-889d-76e0fac3901b None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:07.218528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 101/221] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:07.218528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f033e-0630-468b-889d-76e0fac3901b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:07.257283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:07.288949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 121/222] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:07.290258 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360516-060e-4a77-ab6c-7d2ecd878185 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:07.290580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360516-060e-4a77-ab6c-7d2ecd878185 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:07.290858 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360516-060e-4a77-ab6c-7d2ecd878185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:07.310762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-41360516-060e-4a77-ab6c-7d2ecd878185 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:07.312000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-41360516-060e-4a77-ab6c-7d2ecd878185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:07.360698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f033e-0630-468b-889d-76e0fac3901b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:07.378981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:07.392729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 122/223] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:07.402437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41360516-060e-4a77-ab6c-7d2ecd878185 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:07.404328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8887b0e-6e35-4356-a25e-065efab03abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:07.405055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8887b0e-6e35-4356-a25e-065efab03abd None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:07.405412 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8887b0e-6e35-4356-a25e-065efab03abd None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:07.405759 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8887b0e-6e35-4356-a25e-065efab03abd None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:07.406587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8887b0e-6e35-4356-a25e-065efab03abd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:07.406961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8887b0e-6e35-4356-a25e-065efab03abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:07.408423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8887b0e-6e35-4356-a25e-065efab03abd None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:07.419865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 102/224] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:07.423068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8887b0e-6e35-4356-a25e-065efab03abd None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:07.510340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41360516-060e-4a77-ab6c-7d2ecd878185 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:07.525313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:07.551266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8887b0e-6e35-4356-a25e-065efab03abd None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:07.554612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8272f3-3587-4134-9247-6bdf70bc3a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:07.555273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8272f3-3587-4134-9247-6bdf70bc3a37 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:07.555597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8272f3-3587-4134-9247-6bdf70bc3a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:07.555870 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8272f3-3587-4134-9247-6bdf70bc3a37 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:07.558616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8272f3-3587-4134-9247-6bdf70bc3a37 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:07.560074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8272f3-3587-4134-9247-6bdf70bc3a37 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:07.562061 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 123/225] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:07 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:07.562894 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8272f3-3587-4134-9247-6bdf70bc3a37 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:07.592121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60478b7-9f3d-485b-b869-f086ea75890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:07.593064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60478b7-9f3d-485b-b869-f086ea75890c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:07.593349 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60478b7-9f3d-485b-b869-f086ea75890c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:07.593626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60478b7-9f3d-485b-b869-f086ea75890c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:07.608511 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60478b7-9f3d-485b-b869-f086ea75890c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-e60478b7-9f3d-485b-b869-f086ea75890c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:07.616083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:07.617016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:07.617817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:07.617817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:07.617817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:07.617817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:07.617817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:07.617817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:07.617817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:07.617817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:07.617817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:07.617817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:07.617817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:07.617817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:07.618899 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 103/226] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:12:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:07.619069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60478b7-9f3d-485b-b869-f086ea75890c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:07.638221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:07.687340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8272f3-3587-4134-9247-6bdf70bc3a37 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:07.733211 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b31c10-b2be-4a88-b347-cb595ab07c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:07.733793 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b31c10-b2be-4a88-b347-cb595ab07c78 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:07.734359 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b31c10-b2be-4a88-b347-cb595ab07c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:07.734671 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b31c10-b2be-4a88-b347-cb595ab07c78 None admin] PATH_INFO: `/v3/users/4cfaec0dd6c1462989da67520fab9d16` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:07.736256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b31c10-b2be-4a88-b347-cb595ab07c78 None admin] RBAC: Authorizing `identity:get_user(user_id=4cfaec0dd6c1462989da67520fab9d16)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:07.737737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b31c10-b2be-4a88-b347-cb595ab07c78 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:07.740260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 124/227] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:07 2022] GET /identity/v3/users/4cfaec0dd6c1462989da67520fab9d16 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:07.746888 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b31c10-b2be-4a88-b347-cb595ab07c78 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:07.755045 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60478b7-9f3d-485b-b869-f086ea75890c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:07.792124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c3340-2782-47a3-8a12-a12b4ab7c717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:07.793016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c3340-2782-47a3-8a12-a12b4ab7c717 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:07.793569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c3340-2782-47a3-8a12-a12b4ab7c717 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:07.794094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c3340-2782-47a3-8a12-a12b4ab7c717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:07.795630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c3340-2782-47a3-8a12-a12b4ab7c717 None admin] RBAC: Adding query filter params (role.id=d295e312e144479ca8f748650ac995a4, scope.project.id=a33fb2c471ff405e8562d6379c3558bd, user.id=3461ef7e626e47f089164d33654b4273) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:07.796118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c3340-2782-47a3-8a12-a12b4ab7c717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:07.797626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c3340-2782-47a3-8a12-a12b4ab7c717 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:07.804259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 104/228] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:07 2022] GET /identity/v3/role_assignments?user.id=3461ef7e626e47f089164d33654b4273&scope.project.id=a33fb2c471ff405e8562d6379c3558bd&role.id=d295e312e144479ca8f748650ac995a4 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:07.805209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c3340-2782-47a3-8a12-a12b4ab7c717 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:07.808984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:07.884954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b31c10-b2be-4a88-b347-cb595ab07c78 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:07.932845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c3340-2782-47a3-8a12-a12b4ab7c717 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:07.942765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:07.976313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dde468-b8a5-4582-b4bb-f948e8e788b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:07.976557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fd632-7bb5-4cdf-b45f-8d46351f84d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:07.976954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd632-7bb5-4cdf-b45f-8d46351f84d0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:07.977128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dde468-b8a5-4582-b4bb-f948e8e788b6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:07.977276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd632-7bb5-4cdf-b45f-8d46351f84d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:07.977418 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dde468-b8a5-4582-b4bb-f948e8e788b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:07.977569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dde468-b8a5-4582-b4bb-f948e8e788b6 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:07.977711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd632-7bb5-4cdf-b45f-8d46351f84d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:07.978258 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fd632-7bb5-4cdf-b45f-8d46351f84d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:07.978626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fd632-7bb5-4cdf-b45f-8d46351f84d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:07.978789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dde468-b8a5-4582-b4bb-f948e8e788b6 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:07.980068 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fd632-7bb5-4cdf-b45f-8d46351f84d0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:07.980240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dde468-b8a5-4582-b4bb-f948e8e788b6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:07.982468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 105/229] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:07 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:07.989231 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dde468-b8a5-4582-b4bb-f948e8e788b6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:08.004836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 125/230] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:08.010190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fd632-7bb5-4cdf-b45f-8d46351f84d0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:08.077380 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:08.117765 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dde468-b8a5-4582-b4bb-f948e8e788b6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:08.158425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5500bd-688e-4963-ba93-9562bec534fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:08.159122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5500bd-688e-4963-ba93-9562bec534fb None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:08.159556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5500bd-688e-4963-ba93-9562bec534fb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:08.159843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5500bd-688e-4963-ba93-9562bec534fb None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd/users/4cfaec0dd6c1462989da67520fab9d16/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:08.161986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5500bd-688e-4963-ba93-9562bec534fb None admin] RBAC: Authorizing `identity:create_grant(project_id=a33fb2c471ff405e8562d6379c3558bd, user_id=4cfaec0dd6c1462989da67520fab9d16, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:08.164006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5500bd-688e-4963-ba93-9562bec534fb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:08.179703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 106/231] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:12:07 2022] PUT /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd/users/4cfaec0dd6c1462989da67520fab9d16/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:12:08.238939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fd632-7bb5-4cdf-b45f-8d46351f84d0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:08.293220 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2efcd7-a1e7-45df-87db-4424be501b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:08.293972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2efcd7-a1e7-45df-87db-4424be501b46 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:08.294131 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2efcd7-a1e7-45df-87db-4424be501b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:08.294315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2efcd7-a1e7-45df-87db-4424be501b46 None admin] PATH_INFO: `/v3/users/4cfaec0dd6c1462989da67520fab9d16` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:08.295584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2efcd7-a1e7-45df-87db-4424be501b46 None admin] RBAC: Authorizing `identity:get_user(user_id=4cfaec0dd6c1462989da67520fab9d16)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:08.297051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2efcd7-a1e7-45df-87db-4424be501b46 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:08.299044 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 126/232] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:08 2022] GET /identity/v3/users/4cfaec0dd6c1462989da67520fab9d16 => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:08.304925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5500bd-688e-4963-ba93-9562bec534fb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:08.446791 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5500bd-688e-4963-ba93-9562bec534fb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:08.487883 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:08.495694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d91809-4f00-4a9e-88ff-47e8c65aa56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:08.496346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d91809-4f00-4a9e-88ff-47e8c65aa56d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:08.496625 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d91809-4f00-4a9e-88ff-47e8c65aa56d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:08.496892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d91809-4f00-4a9e-88ff-47e8c65aa56d None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:08.498182 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d91809-4f00-4a9e-88ff-47e8c65aa56d None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:08.500242 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d91809-4f00-4a9e-88ff-47e8c65aa56d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:08.506703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 107/233] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:08 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:08.508348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2efcd7-a1e7-45df-87db-4424be501b46 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:08.578544 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:08.632494 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2efcd7-a1e7-45df-87db-4424be501b46 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:08.681452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560ff2f-7b2d-4943-af2b-7a262c4beafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:08.682134 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560ff2f-7b2d-4943-af2b-7a262c4beafd None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:08.682437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560ff2f-7b2d-4943-af2b-7a262c4beafd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:08.682724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560ff2f-7b2d-4943-af2b-7a262c4beafd None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd/users/4cfaec0dd6c1462989da67520fab9d16/roles/b371b8f12e7348e8b01784eeddeca2ac` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:08.684978 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560ff2f-7b2d-4943-af2b-7a262c4beafd None admin] RBAC: Authorizing `identity:create_grant(project_id=a33fb2c471ff405e8562d6379c3558bd, user_id=4cfaec0dd6c1462989da67520fab9d16, role_id=b371b8f12e7348e8b01784eeddeca2ac)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:08.686456 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560ff2f-7b2d-4943-af2b-7a262c4beafd None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:08.708109 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 127/234] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:12:08 2022] PUT /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd/users/4cfaec0dd6c1462989da67520fab9d16/roles/b371b8f12e7348e8b01784eeddeca2ac => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:12:09.575290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74a4a0-1413-4217-aa23-f138d6e3e54b None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:09.576075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74a4a0-1413-4217-aa23-f138d6e3e54b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:09.576163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74a4a0-1413-4217-aa23-f138d6e3e54b None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:09.577578 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 108/235] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:09.587934 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eb24a-4dff-4e7a-b24e-7bdd310eb7c4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:09.588369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eb24a-4dff-4e7a-b24e-7bdd310eb7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:09.588554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eb24a-4dff-4e7a-b24e-7bdd310eb7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:09.611369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7c8eb24a-4dff-4e7a-b24e-7bdd310eb7c4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:09.612551 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7c8eb24a-4dff-4e7a-b24e-7bdd310eb7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:09.700049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 128/236] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:09.742370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74a4a0-1413-4217-aa23-f138d6e3e54b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:09.800162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4c7e3-f79d-4c46-9540-203c33b70dbb None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:09.800510 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4c7e3-f79d-4c46-9540-203c33b70dbb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:09.800725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4c7e3-f79d-4c46-9540-203c33b70dbb None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:09.802089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 129/237] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:09.811964 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdb33d-c32b-4eea-a6a5-ae1f8b527f4c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:09.812249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdb33d-c32b-4eea-a6a5-ae1f8b527f4c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:09.812527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdb33d-c32b-4eea-a6a5-ae1f8b527f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:09.848162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a6fdb33d-c32b-4eea-a6a5-ae1f8b527f4c None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:09.853891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a6fdb33d-c32b-4eea-a6a5-ae1f8b527f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:09.892331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74a4a0-1413-4217-aa23-f138d6e3e54b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:09.927425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fbf2b-e57a-46bc-a1fd-3e7a34502ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:09.929045 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fbf2b-e57a-46bc-a1fd-3e7a34502ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:09.929528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fbf2b-e57a-46bc-a1fd-3e7a34502ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:09.929996 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fbf2b-e57a-46bc-a1fd-3e7a34502ab5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:09.940880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fbf2b-e57a-46bc-a1fd-3e7a34502ab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:09.943941 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-f39fbf2b-e57a-46bc-a1fd-3e7a34502ab5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:09.947061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:09.947909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:09.948728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:09.948728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:09.948728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:09.948728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:09.948728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:09.948728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:09.948728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:09.948728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:09.948728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:09.948728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:09.948728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:09.948728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:09.951708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 109/238] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:09.957209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fbf2b-e57a-46bc-a1fd-3e7a34502ab5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:10.001314 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 130/239] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:10.041764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdb33d-c32b-4eea-a6a5-ae1f8b527f4c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:10.052907 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:10.128339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fbf2b-e57a-46bc-a1fd-3e7a34502ab5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:10.170350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b7256-9e14-4d27-93e9-499f62ae94d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:10.171299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b7256-9e14-4d27-93e9-499f62ae94d8 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:10.171797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b7256-9e14-4d27-93e9-499f62ae94d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:10.172307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b7256-9e14-4d27-93e9-499f62ae94d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:10.173199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b7256-9e14-4d27-93e9-499f62ae94d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:10.173785 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b7256-9e14-4d27-93e9-499f62ae94d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:10.175424 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b7256-9e14-4d27-93e9-499f62ae94d8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:10.184697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 110/240] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:10.189941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b7256-9e14-4d27-93e9-499f62ae94d8 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:10.237092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdb33d-c32b-4eea-a6a5-ae1f8b527f4c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:10.319724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f7ca6-9ebb-4ce8-86df-68183d1993f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:10.320311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f7ca6-9ebb-4ce8-86df-68183d1993f6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:10.320590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f7ca6-9ebb-4ce8-86df-68183d1993f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:10.320856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f7ca6-9ebb-4ce8-86df-68183d1993f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:10.322035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f7ca6-9ebb-4ce8-86df-68183d1993f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:10.323513 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f7ca6-9ebb-4ce8-86df-68183d1993f6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:10.325302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 131/241] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:10.330805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f7ca6-9ebb-4ce8-86df-68183d1993f6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:10.331831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b7256-9e14-4d27-93e9-499f62ae94d8 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:10.357489 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:10.379124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a76244-df15-4f90-90a7-e6796d211534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:10.380085 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76244-df15-4f90-90a7-e6796d211534 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:10.380546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76244-df15-4f90-90a7-e6796d211534 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:10.381022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76244-df15-4f90-90a7-e6796d211534 None admin] PATH_INFO: `/v3/users/26cd6b597a6f49f788e9d54d1b17cf81` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:10.413318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:10.431759 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a76244-df15-4f90-90a7-e6796d211534 None admin] RBAC: Authorizing `identity:get_user(user_id=26cd6b597a6f49f788e9d54d1b17cf81)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:10.433252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a76244-df15-4f90-90a7-e6796d211534 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:10.435364 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 111/242] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:10 2022] GET /identity/v3/users/26cd6b597a6f49f788e9d54d1b17cf81 => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:10.440481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a76244-df15-4f90-90a7-e6796d211534 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:10.476507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f7ca6-9ebb-4ce8-86df-68183d1993f6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:10.520258 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42632c8-0daa-4c46-a752-7de2a9542655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:10.522372 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42632c8-0daa-4c46-a752-7de2a9542655 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:10.522686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42632c8-0daa-4c46-a752-7de2a9542655 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:10.522960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42632c8-0daa-4c46-a752-7de2a9542655 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:10.523659 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42632c8-0daa-4c46-a752-7de2a9542655 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:10.525108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42632c8-0daa-4c46-a752-7de2a9542655 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:10.555560 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 132/243] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:12:10 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:12:10.557078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d4011-9100-4f72-8364-49b8a6a59db2 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:10.557367 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d4011-9100-4f72-8364-49b8a6a59db2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:10.557687 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d4011-9100-4f72-8364-49b8a6a59db2 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:10.562521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 133/244] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:10.565753 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e4bb3-bd9f-43db-bfa8-4d0d6bfa83fc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:10.566151 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e4bb3-bd9f-43db-bfa8-4d0d6bfa83fc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:10.566328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e4bb3-bd9f-43db-bfa8-4d0d6bfa83fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:10.590740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-dd6e4bb3-bd9f-43db-bfa8-4d0d6bfa83fc None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:10.591917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dd6e4bb3-bd9f-43db-bfa8-4d0d6bfa83fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:10.610978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a76244-df15-4f90-90a7-e6796d211534 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:10.658096 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94e7d-7542-4b43-b0d1-fb868f4eb860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:10.659063 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94e7d-7542-4b43-b0d1-fb868f4eb860 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:10.659660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94e7d-7542-4b43-b0d1-fb868f4eb860 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:10.660099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94e7d-7542-4b43-b0d1-fb868f4eb860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:10.669367 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 134/245] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:10.692754 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e4bb3-bd9f-43db-bfa8-4d0d6bfa83fc None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:10.732309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:10.758128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:10.785739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb94e7d-7542-4b43-b0d1-fb868f4eb860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:10.786374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb94e7d-7542-4b43-b0d1-fb868f4eb860 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:10.859264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e4bb3-bd9f-43db-bfa8-4d0d6bfa83fc None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:10.900740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb13d77-9cfc-4e78-8f61-0b6d9c3cf54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:10.901701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb13d77-9cfc-4e78-8f61-0b6d9c3cf54c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:10.901994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb13d77-9cfc-4e78-8f61-0b6d9c3cf54c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:10.902266 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb13d77-9cfc-4e78-8f61-0b6d9c3cf54c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:10.907204 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 112/246] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 22:12:10.912025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94e7d-7542-4b43-b0d1-fb868f4eb860 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:10.920297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb13d77-9cfc-4e78-8f61-0b6d9c3cf54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-8eb13d77-9cfc-4e78-8f61-0b6d9c3cf54c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:10.926053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:10.927058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:10.927880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:10.927880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:10.927880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:10.927880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:10.927880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:10.927880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:10.927880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:10.927880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:10.927880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:10.927880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:10.927880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:10.927880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:10.934472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 135/247] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:10.936491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4bdaa-632a-4303-8de4-e0d0817cfee5 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:10.936955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4bdaa-632a-4303-8de4-e0d0817cfee5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:10.937376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4bdaa-632a-4303-8de4-e0d0817cfee5 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:10.938889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 136/248] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:10.940732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4bdaa-632a-4303-8de4-e0d0817cfee5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:10.994862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:11.020180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94e7d-7542-4b43-b0d1-fb868f4eb860 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:11.059618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:11.071173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3f035-45a8-494b-a8c9-cfba156e7ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:11.071363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4bdaa-632a-4303-8de4-e0d0817cfee5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:11.071835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3f035-45a8-494b-a8c9-cfba156e7ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:11.072124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3f035-45a8-494b-a8c9-cfba156e7ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:11.072398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3f035-45a8-494b-a8c9-cfba156e7ae7 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:11.073826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3f035-45a8-494b-a8c9-cfba156e7ae7 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:11.075771 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3f035-45a8-494b-a8c9-cfba156e7ae7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:11.078530 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 113/249] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:10 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:11.080124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f36e8-9a97-40d6-8648-2f0362a334a1 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:11.080411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f36e8-9a97-40d6-8648-2f0362a334a1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:11.080687 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f36e8-9a97-40d6-8648-2f0362a334a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:11.101947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-d31f36e8-9a97-40d6-8648-2f0362a334a1 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:11.103179 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d31f36e8-9a97-40d6-8648-2f0362a334a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:11.119693 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb673b-7b0d-43f5-8021-ba4c40b8b1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:11.120916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb673b-7b0d-43f5-8021-ba4c40b8b1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:11.121403 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb673b-7b0d-43f5-8021-ba4c40b8b1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:11.121886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb673b-7b0d-43f5-8021-ba4c40b8b1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:11.123184 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb673b-7b0d-43f5-8021-ba4c40b8b1b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:11.123746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb673b-7b0d-43f5-8021-ba4c40b8b1b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:11.125696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb673b-7b0d-43f5-8021-ba4c40b8b1b9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:11.138217 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 137/250] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:11.139544 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb673b-7b0d-43f5-8021-ba4c40b8b1b9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:11.199249 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 114/251] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:11.200679 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f36e8-9a97-40d6-8648-2f0362a334a1 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:11.259085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb673b-7b0d-43f5-8021-ba4c40b8b1b9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:11.295236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f2590-36a5-45ec-b330-2d02d4554535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:11.296352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f2590-36a5-45ec-b330-2d02d4554535 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:11.296630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f2590-36a5-45ec-b330-2d02d4554535 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:11.297028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f2590-36a5-45ec-b330-2d02d4554535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:11.297971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f2590-36a5-45ec-b330-2d02d4554535 None admin] RBAC: Adding query filter params (role.id=fdbe1fc69914484591390937886dfbfa, scope.project.id=a33fb2c471ff405e8562d6379c3558bd, user.id=26cd6b597a6f49f788e9d54d1b17cf81) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:11.298280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f2590-36a5-45ec-b330-2d02d4554535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:11.300787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f2590-36a5-45ec-b330-2d02d4554535 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:11.307452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 138/252] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:11 2022] GET /identity/v3/role_assignments?user.id=26cd6b597a6f49f788e9d54d1b17cf81&scope.project.id=a33fb2c471ff405e8562d6379c3558bd&role.id=fdbe1fc69914484591390937886dfbfa => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:11.307702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:11.311479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430731f-88fd-4873-b4bb-6021bb4b4c02 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:11.311770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430731f-88fd-4873-b4bb-6021bb4b4c02 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:11.312047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430731f-88fd-4873-b4bb-6021bb4b4c02 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:11.314493 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 139/253] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:11.315627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430731f-88fd-4873-b4bb-6021bb4b4c02 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:11.346882 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f36e8-9a97-40d6-8648-2f0362a334a1 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:11.365631 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:11.392287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e89a6-ff77-47fc-9073-876fef6a5dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:11.393205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e89a6-ff77-47fc-9073-876fef6a5dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:11.393693 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e89a6-ff77-47fc-9073-876fef6a5dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:11.394689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e89a6-ff77-47fc-9073-876fef6a5dc6 None admin] PATH_INFO: `/v3/users/3461ef7e626e47f089164d33654b4273` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:11.396448 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e89a6-ff77-47fc-9073-876fef6a5dc6 None admin] RBAC: Authorizing `identity:get_user(user_id=3461ef7e626e47f089164d33654b4273)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:11.398790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e89a6-ff77-47fc-9073-876fef6a5dc6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:11.401444 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 115/254] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:11 2022] GET /identity/v3/users/3461ef7e626e47f089164d33654b4273 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:11.403618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e952e3-ba49-4cf4-a0b5-50700505748f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:11.404207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e952e3-ba49-4cf4-a0b5-50700505748f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:11.404842 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e952e3-ba49-4cf4-a0b5-50700505748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:11.429402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-38e952e3-ba49-4cf4-a0b5-50700505748f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:11.431503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-38e952e3-ba49-4cf4-a0b5-50700505748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:11.523144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430731f-88fd-4873-b4bb-6021bb4b4c02 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:11.558684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 116/255] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:11.560010 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e952e3-ba49-4cf4-a0b5-50700505748f None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:11.584183 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9631c-15f7-45f9-8df7-9f87c7d1ecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:11.585149 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9631c-15f7-45f9-8df7-9f87c7d1ecc9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:11.585576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9631c-15f7-45f9-8df7-9f87c7d1ecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:11.586054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9631c-15f7-45f9-8df7-9f87c7d1ecc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:11.606296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9631c-15f7-45f9-8df7-9f87c7d1ecc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-78a9631c-15f7-45f9-8df7-9f87c7d1ecc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:11.612569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:11.613627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:11.614619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:11.614619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:11.614619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:11.614619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:11.614619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:11.614619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:11.614619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:11.614619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:11.614619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:11.614619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:11.614619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:12:11.614619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:11.617472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 140/256] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:12:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:11.618538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9631c-15f7-45f9-8df7-9f87c7d1ecc9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:11.661800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:11.711476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e952e3-ba49-4cf4-a0b5-50700505748f None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:11.747147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:11.747523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bb211-f575-4c48-bfe9-47c98ccc1e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:11.748261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bb211-f575-4c48-bfe9-47c98ccc1e81 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:11.748607 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bb211-f575-4c48-bfe9-47c98ccc1e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:11.749069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bb211-f575-4c48-bfe9-47c98ccc1e81 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:11.750439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435bb211-f575-4c48-bfe9-47c98ccc1e81 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:11.752062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435bb211-f575-4c48-bfe9-47c98ccc1e81 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:11.753999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 117/257] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:11 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:11.755034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bb211-f575-4c48-bfe9-47c98ccc1e81 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:11.775281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9631c-15f7-45f9-8df7-9f87c7d1ecc9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:11.835902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ea2ff-9bf8-44cb-a904-cdc2635e22bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:11.837412 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ea2ff-9bf8-44cb-a904-cdc2635e22bd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:11.837693 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ea2ff-9bf8-44cb-a904-cdc2635e22bd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:11.838020 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ea2ff-9bf8-44cb-a904-cdc2635e22bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:11.849079 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ea2ff-9bf8-44cb-a904-cdc2635e22bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-709ea2ff-9bf8-44cb-a904-cdc2635e22bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:11.854203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:11.855101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:11.855868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:11.855868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:11.855868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:11.855868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:11.855868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:11.855868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:11.855868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:11.855868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:11.855868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:11.855868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:11.855868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:11.855868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:11.855868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 141/258] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:12:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:11.859267 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ea2ff-9bf8-44cb-a904-cdc2635e22bd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:11.912701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435bb211-f575-4c48-bfe9-47c98ccc1e81 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:11.973238 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ea2ff-9bf8-44cb-a904-cdc2635e22bd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:11.989615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80970b-8da1-435f-bda7-00312450fc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:11.991041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80970b-8da1-435f-bda7-00312450fc91 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:11.991465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80970b-8da1-435f-bda7-00312450fc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:11.991987 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80970b-8da1-435f-bda7-00312450fc91 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:11.992951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80970b-8da1-435f-bda7-00312450fc91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:11.993396 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80970b-8da1-435f-bda7-00312450fc91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:11.994943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80970b-8da1-435f-bda7-00312450fc91 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:12.011108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c02999-f4f9-4781-a17e-f63dea90e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:12.011916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c02999-f4f9-4781-a17e-f63dea90e725 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:12.012201 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c02999-f4f9-4781-a17e-f63dea90e725 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:12.012474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c02999-f4f9-4781-a17e-f63dea90e725 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd/users/3461ef7e626e47f089164d33654b4273/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:12.014580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c02999-f4f9-4781-a17e-f63dea90e725 None admin] RBAC: Authorizing `identity:create_grant(project_id=a33fb2c471ff405e8562d6379c3558bd, user_id=3461ef7e626e47f089164d33654b4273, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:12.014740 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 118/259] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:12.015699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80970b-8da1-435f-bda7-00312450fc91 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:12.016100 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c02999-f4f9-4781-a17e-f63dea90e725 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:12.023027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:12.045254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 142/260] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:12:11 2022] PUT /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd/users/3461ef7e626e47f089164d33654b4273/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:12:12.046183 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c02999-f4f9-4781-a17e-f63dea90e725 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:12.046800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:12.154674 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80970b-8da1-435f-bda7-00312450fc91 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:12.190817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2976320-eb72-4e13-88de-9baef28fd4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:12.191374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2976320-eb72-4e13-88de-9baef28fd4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:12.191657 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2976320-eb72-4e13-88de-9baef28fd4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:12.191933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2976320-eb72-4e13-88de-9baef28fd4f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:12.192667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2976320-eb72-4e13-88de-9baef28fd4f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:12.192973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2976320-eb72-4e13-88de-9baef28fd4f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:12.194580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2976320-eb72-4e13-88de-9baef28fd4f3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:12.208557 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 119/261] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:12.210543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2976320-eb72-4e13-88de-9baef28fd4f3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:12.253411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c02999-f4f9-4781-a17e-f63dea90e725 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:12.297048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:12.356576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154892a9-0feb-42e8-833c-77fde831a1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:12.357242 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154892a9-0feb-42e8-833c-77fde831a1be None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:12.357528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154892a9-0feb-42e8-833c-77fde831a1be None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:12.357804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154892a9-0feb-42e8-833c-77fde831a1be None admin] PATH_INFO: `/v3/users/4cfaec0dd6c1462989da67520fab9d16` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:12.362397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154892a9-0feb-42e8-833c-77fde831a1be None admin] RBAC: Authorizing `identity:get_user(user_id=4cfaec0dd6c1462989da67520fab9d16)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:12.362530 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2976320-eb72-4e13-88de-9baef28fd4f3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:12.366511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154892a9-0feb-42e8-833c-77fde831a1be None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:12.368392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 143/262] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:12 2022] GET /identity/v3/users/4cfaec0dd6c1462989da67520fab9d16 => generated 283 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:12.373573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154892a9-0feb-42e8-833c-77fde831a1be None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:12.415880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378d20e-9f02-4e8f-b49a-3385fbe203a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:12.416599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378d20e-9f02-4e8f-b49a-3385fbe203a0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:12.416882 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378d20e-9f02-4e8f-b49a-3385fbe203a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:12.417207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378d20e-9f02-4e8f-b49a-3385fbe203a0 None admin] PATH_INFO: `/v3/users/4cfaec0dd6c1462989da67520fab9d16` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:12.422460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378d20e-9f02-4e8f-b49a-3385fbe203a0 None admin] RBAC: Authorizing `identity:get_user(user_id=4cfaec0dd6c1462989da67520fab9d16)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:12.422460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378d20e-9f02-4e8f-b49a-3385fbe203a0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:12.422874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 120/263] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:12 2022] GET /identity/v3/users/4cfaec0dd6c1462989da67520fab9d16 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:12.432103 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378d20e-9f02-4e8f-b49a-3385fbe203a0 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:12.534785 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:12.599422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154892a9-0feb-42e8-833c-77fde831a1be None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:12.671481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378d20e-9f02-4e8f-b49a-3385fbe203a0 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:12.691765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff629e5-1e3c-42ff-b7aa-344503bb463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:12.692408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff629e5-1e3c-42ff-b7aa-344503bb463a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:12.692664 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff629e5-1e3c-42ff-b7aa-344503bb463a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:12.693068 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff629e5-1e3c-42ff-b7aa-344503bb463a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:12.750990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f1705-720a-4651-8dff-df2adaf73810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:12.751582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f1705-720a-4651-8dff-df2adaf73810 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:12.751862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f1705-720a-4651-8dff-df2adaf73810 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:12.752130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f1705-720a-4651-8dff-df2adaf73810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:12.758749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:12.843585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff629e5-1e3c-42ff-b7aa-344503bb463a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:12.845445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff629e5-1e3c-42ff-b7aa-344503bb463a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:12.935491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f1705-720a-4651-8dff-df2adaf73810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:12.937209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f1705-720a-4651-8dff-df2adaf73810 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:12.938236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:12.995313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 144/264] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 22:12:13.001058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff629e5-1e3c-42ff-b7aa-344503bb463a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:13.107753 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff629e5-1e3c-42ff-b7aa-344503bb463a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:13.125030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 121/265] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:13.131776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f1705-720a-4651-8dff-df2adaf73810 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:13.165268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a519646-a2e7-4b51-afbb-ff7ff5d5c459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:13.166004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a519646-a2e7-4b51-afbb-ff7ff5d5c459 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:13.166517 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a519646-a2e7-4b51-afbb-ff7ff5d5c459 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:13.166900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a519646-a2e7-4b51-afbb-ff7ff5d5c459 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:13.171128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a519646-a2e7-4b51-afbb-ff7ff5d5c459 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:13.172620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a519646-a2e7-4b51-afbb-ff7ff5d5c459 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:13.174345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 145/266] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:13 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:13.189778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:13.201445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a519646-a2e7-4b51-afbb-ff7ff5d5c459 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:13.250842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:13.300775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f1705-720a-4651-8dff-df2adaf73810 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:13.320352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a519646-a2e7-4b51-afbb-ff7ff5d5c459 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:13.356297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cbe4f-e2ad-4cc5-a59d-a52cfeed7852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:13.357014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cbe4f-e2ad-4cc5-a59d-a52cfeed7852 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:13.357386 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cbe4f-e2ad-4cc5-a59d-a52cfeed7852 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:13.357657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cbe4f-e2ad-4cc5-a59d-a52cfeed7852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:13.358484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cbe4f-e2ad-4cc5-a59d-a52cfeed7852 None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=a33fb2c471ff405e8562d6379c3558bd, user.id=4cfaec0dd6c1462989da67520fab9d16) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:13.358798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cbe4f-e2ad-4cc5-a59d-a52cfeed7852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:13.360241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cbe4f-e2ad-4cc5-a59d-a52cfeed7852 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:13.364309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c90ec-4b3d-4c60-8166-5fadcc7008e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:13.364973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c90ec-4b3d-4c60-8166-5fadcc7008e3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:13.365322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c90ec-4b3d-4c60-8166-5fadcc7008e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:13.365644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c90ec-4b3d-4c60-8166-5fadcc7008e3 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:13.367027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 146/267] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:13 2022] GET /identity/v3/role_assignments?user.id=4cfaec0dd6c1462989da67520fab9d16&scope.project.id=a33fb2c471ff405e8562d6379c3558bd&role.id=0053c24ce06147938dbb61657a531c94 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:13.371195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c90ec-4b3d-4c60-8166-5fadcc7008e3 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:13.372668 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c90ec-4b3d-4c60-8166-5fadcc7008e3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:13.374701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 122/268] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:13 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:13.380706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cbe4f-e2ad-4cc5-a59d-a52cfeed7852 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:13.525560 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:13.529071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cbe4f-e2ad-4cc5-a59d-a52cfeed7852 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:13.554667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bffbd-7fb9-44c5-8223-79ddd7dd61fb None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:13.555257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bffbd-7fb9-44c5-8223-79ddd7dd61fb None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:13.555841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bffbd-7fb9-44c5-8223-79ddd7dd61fb None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:13.561280 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 123/269] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:13.563743 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14c29a-3cbe-4bfa-9036-ab5f9dfd2d4e None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:13.564240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14c29a-3cbe-4bfa-9036-ab5f9dfd2d4e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:13.564716 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14c29a-3cbe-4bfa-9036-ab5f9dfd2d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:13.569306 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5403b-ff44-421b-9fb4-31dbad88de0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:13.569970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5403b-ff44-421b-9fb4-31dbad88de0a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:13.570253 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5403b-ff44-421b-9fb4-31dbad88de0a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:13.570703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5403b-ff44-421b-9fb4-31dbad88de0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:13.571444 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5403b-ff44-421b-9fb4-31dbad88de0a None admin] RBAC: Adding query filter params (role.id=b371b8f12e7348e8b01784eeddeca2ac, scope.project.id=a33fb2c471ff405e8562d6379c3558bd, user.id=4cfaec0dd6c1462989da67520fab9d16) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:13.571751 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5403b-ff44-421b-9fb4-31dbad88de0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:13.573296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5403b-ff44-421b-9fb4-31dbad88de0a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:13.594587 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 147/270] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:13 2022] GET /identity/v3/role_assignments?user.id=4cfaec0dd6c1462989da67520fab9d16&scope.project.id=a33fb2c471ff405e8562d6379c3558bd&role.id=b371b8f12e7348e8b01784eeddeca2ac => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:13.600399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-0c14c29a-3cbe-4bfa-9036-ab5f9dfd2d4e None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:13.601834 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0c14c29a-3cbe-4bfa-9036-ab5f9dfd2d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:13.714518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 124/271] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:13.741341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfaa1f-01a7-4a9a-812d-2bc523e315d8 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:13.742287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfaa1f-01a7-4a9a-812d-2bc523e315d8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:13.742789 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfaa1f-01a7-4a9a-812d-2bc523e315d8 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:13.745395 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 148/272] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:13.749932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aea936-e6a7-4c3b-befe-554e924d722d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:13.750229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aea936-e6a7-4c3b-befe-554e924d722d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:13.750522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aea936-e6a7-4c3b-befe-554e924d722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:13.760350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfaa1f-01a7-4a9a-812d-2bc523e315d8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:13.778822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-e5aea936-e6a7-4c3b-befe-554e924d722d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:13.780035 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e5aea936-e6a7-4c3b-befe-554e924d722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:13.828157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:13.903006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 125/273] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:13.916544 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfaa1f-01a7-4a9a-812d-2bc523e315d8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:13.929999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aea936-e6a7-4c3b-befe-554e924d722d None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:13.960408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78158d47-3e99-4698-b12b-619746c01cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:13.961053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78158d47-3e99-4698-b12b-619746c01cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:13.961331 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78158d47-3e99-4698-b12b-619746c01cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:13.961604 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78158d47-3e99-4698-b12b-619746c01cf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:13.973813 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78158d47-3e99-4698-b12b-619746c01cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-78158d47-3e99-4698-b12b-619746c01cf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:13.980729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:13.981650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:13.982605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:13.982605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:13.982605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:13.982605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:13.982605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:13.982605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:13.982605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:13.982605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:13.982605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:13.982605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:13.982605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:13.982605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:13.982605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 149/274] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:12:13.990879 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78158d47-3e99-4698-b12b-619746c01cf7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:14.031104 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:14.067334 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aea936-e6a7-4c3b-befe-554e924d722d None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:14.110764 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605223e-ff6a-49dc-b278-f5878b9c8055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:14.111335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605223e-ff6a-49dc-b278-f5878b9c8055 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:14.111619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605223e-ff6a-49dc-b278-f5878b9c8055 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:14.111984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605223e-ff6a-49dc-b278-f5878b9c8055 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:14.113184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605223e-ff6a-49dc-b278-f5878b9c8055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:14.114653 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605223e-ff6a-49dc-b278-f5878b9c8055 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:14.117098 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 126/275] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:14.122577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605223e-ff6a-49dc-b278-f5878b9c8055 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:14.129289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78158d47-3e99-4698-b12b-619746c01cf7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:14.162117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:14.182881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96864275-3688-4ed0-b59e-2eb13f689ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:14.184062 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96864275-3688-4ed0-b59e-2eb13f689ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:14.185044 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96864275-3688-4ed0-b59e-2eb13f689ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:14.185593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96864275-3688-4ed0-b59e-2eb13f689ff2 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:14.186626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96864275-3688-4ed0-b59e-2eb13f689ff2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:14.187083 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96864275-3688-4ed0-b59e-2eb13f689ff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:14.189350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96864275-3688-4ed0-b59e-2eb13f689ff2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:14.201958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 150/276] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:14.207823 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96864275-3688-4ed0-b59e-2eb13f689ff2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:14.257597 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605223e-ff6a-49dc-b278-f5878b9c8055 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:14.298707 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:14.307708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94d9c7-7485-4ac0-a8de-608090366c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:14.308337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94d9c7-7485-4ac0-a8de-608090366c8a None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:14.308620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94d9c7-7485-4ac0-a8de-608090366c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:14.308895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94d9c7-7485-4ac0-a8de-608090366c8a None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:14.309595 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94d9c7-7485-4ac0-a8de-608090366c8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:14.311079 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94d9c7-7485-4ac0-a8de-608090366c8a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:14.317503 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96864275-3688-4ed0-b59e-2eb13f689ff2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:14.336644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 127/277] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:12:14 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:12:14.337806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d1302-75b1-4d0e-833c-675b469845b8 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:14.338103 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d1302-75b1-4d0e-833c-675b469845b8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:14.338386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d1302-75b1-4d0e-833c-675b469845b8 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:14.344413 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 128/278] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:14.347030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d276c-0718-487e-b87a-f25a25c930db None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:14.347627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d276c-0718-487e-b87a-f25a25c930db None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:14.348182 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d276c-0718-487e-b87a-f25a25c930db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:14.363174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff643-e6d8-42e5-a0fb-e5e58fceb954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:14.363764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff643-e6d8-42e5-a0fb-e5e58fceb954 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:14.364047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff643-e6d8-42e5-a0fb-e5e58fceb954 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:14.364320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff643-e6d8-42e5-a0fb-e5e58fceb954 None admin] PATH_INFO: `/v3/users/f8200195ac054d149195ea1d4e9ad0e0` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:14.378039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-f49d276c-0718-487e-b87a-f25a25c930db None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:14.379271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f49d276c-0718-487e-b87a-f25a25c930db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:14.388044 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ff643-e6d8-42e5-a0fb-e5e58fceb954 None admin] RBAC: Authorizing `identity:get_user(user_id=f8200195ac054d149195ea1d4e9ad0e0)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:14.390042 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ff643-e6d8-42e5-a0fb-e5e58fceb954 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:14.392231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 151/279] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:14 2022] GET /identity/v3/users/f8200195ac054d149195ea1d4e9ad0e0 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:14.403977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff643-e6d8-42e5-a0fb-e5e58fceb954 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:14.473713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 129/280] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:14.497810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d276c-0718-487e-b87a-f25a25c930db None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:14.523712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:14.576138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff643-e6d8-42e5-a0fb-e5e58fceb954 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:14.625787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a610cd-c91a-43a0-8a5a-29dcf664484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:14.626316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a610cd-c91a-43a0-8a5a-29dcf664484d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:14.626633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a610cd-c91a-43a0-8a5a-29dcf664484d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:14.626907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a610cd-c91a-43a0-8a5a-29dcf664484d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:14.627709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a610cd-c91a-43a0-8a5a-29dcf664484d None admin] RBAC: Adding query filter params (role.id=d295e312e144479ca8f748650ac995a4, user.id=f8200195ac054d149195ea1d4e9ad0e0, scope.system=all) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:14.628020 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a610cd-c91a-43a0-8a5a-29dcf664484d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:14.629073 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d276c-0718-487e-b87a-f25a25c930db None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:14.629484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a610cd-c91a-43a0-8a5a-29dcf664484d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:14.635627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 152/281] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Aug 4 22:12:14 2022] GET /identity/v3/role_assignments?user.id=f8200195ac054d149195ea1d4e9ad0e0&scope.system=all&role.id=d295e312e144479ca8f748650ac995a4 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:14.671327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d092ed-bdef-487e-b3c6-6d54a9c85e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:14.672106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d092ed-bdef-487e-b3c6-6d54a9c85e03 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:14.672447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d092ed-bdef-487e-b3c6-6d54a9c85e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:14.672777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d092ed-bdef-487e-b3c6-6d54a9c85e03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:14.685446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d092ed-bdef-487e-b3c6-6d54a9c85e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-39d092ed-bdef-487e-b3c6-6d54a9c85e03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:14.690730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:14.691902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:14.692943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:14.692943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:14.692943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:14.692943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:14.692943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:14.692943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:14.692943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:14.692943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:14.692943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:14.692943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:14.692943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:14.692943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:14.694632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 130/282] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:14.702393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a610cd-c91a-43a0-8a5a-29dcf664484d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:14.713518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:14.829010 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a610cd-c91a-43a0-8a5a-29dcf664484d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:14.867463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba1f8d-e996-4a98-96f4-b0b477b041ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:14.868160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba1f8d-e996-4a98-96f4-b0b477b041ea None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:14.868487 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba1f8d-e996-4a98-96f4-b0b477b041ea None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:14.868761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba1f8d-e996-4a98-96f4-b0b477b041ea None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:14.869482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba1f8d-e996-4a98-96f4-b0b477b041ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:14.869787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba1f8d-e996-4a98-96f4-b0b477b041ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:14.871319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba1f8d-e996-4a98-96f4-b0b477b041ea None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:14.881616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 153/283] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:14.887360 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d092ed-bdef-487e-b3c6-6d54a9c85e03 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:15.001495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:15.042429 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d092ed-bdef-487e-b3c6-6d54a9c85e03 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:15.051546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c131e-f852-457b-9e31-9c70925de5da None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:15.051882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c131e-f852-457b-9e31-9c70925de5da None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:15.052179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c131e-f852-457b-9e31-9c70925de5da None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:15.054097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 154/284] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:12:15.059219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106d9d-1cfe-42d5-baf8-5b69272445f2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:15.059502 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106d9d-1cfe-42d5-baf8-5b69272445f2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:15.059764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106d9d-1cfe-42d5-baf8-5b69272445f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:15.090751 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-65106d9d-1cfe-42d5-baf8-5b69272445f2 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:15.091955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-65106d9d-1cfe-42d5-baf8-5b69272445f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:15.123992 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c4681-bf67-4207-b5d0-bfd2dadd058b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:15.124646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4681-bf67-4207-b5d0-bfd2dadd058b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:15.124921 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4681-bf67-4207-b5d0-bfd2dadd058b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:15.125190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4681-bf67-4207-b5d0-bfd2dadd058b None admin] PATH_INFO: `/v3/users/26cd6b597a6f49f788e9d54d1b17cf81` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:15.127169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c4681-bf67-4207-b5d0-bfd2dadd058b None admin] RBAC: Authorizing `identity:get_user(user_id=26cd6b597a6f49f788e9d54d1b17cf81)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:15.128621 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c4681-bf67-4207-b5d0-bfd2dadd058b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:15.132143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 131/285] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:14 2022] GET /identity/v3/users/26cd6b597a6f49f788e9d54d1b17cf81 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:15.140995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c4681-bf67-4207-b5d0-bfd2dadd058b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:15.233168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:15.247821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 155/286] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:15.273168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65106d9d-1cfe-42d5-baf8-5b69272445f2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:15.333068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c4681-bf67-4207-b5d0-bfd2dadd058b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:15.400154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77a56d-3c2b-4455-82d5-d7664f2612cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:15.400722 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77a56d-3c2b-4455-82d5-d7664f2612cb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:15.401002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77a56d-3c2b-4455-82d5-d7664f2612cb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:15.401275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77a56d-3c2b-4455-82d5-d7664f2612cb None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:15.404549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77a56d-3c2b-4455-82d5-d7664f2612cb None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:15.406007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77a56d-3c2b-4455-82d5-d7664f2612cb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:15.408692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 132/287] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:15 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:15.416181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77a56d-3c2b-4455-82d5-d7664f2612cb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:15.427750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65106d9d-1cfe-42d5-baf8-5b69272445f2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:15.442084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:15.496516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f6ecd-5d20-40cf-817b-f5b7fe9a172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:15.497203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f6ecd-5d20-40cf-817b-f5b7fe9a172f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:15.497486 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f6ecd-5d20-40cf-817b-f5b7fe9a172f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:15.497759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f6ecd-5d20-40cf-817b-f5b7fe9a172f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:15.512216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f6ecd-5d20-40cf-817b-f5b7fe9a172f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-425f6ecd-5d20-40cf-817b-f5b7fe9a172f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:15.518423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:15.519293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:15.520085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:15.520085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:15.520085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:15.520085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:15.520085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:15.520085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:15.520085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:15.520085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:15.520085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:15.520085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:15.520085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:15.520085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:15.521142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 156/288] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:12:15.527553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f6ecd-5d20-40cf-817b-f5b7fe9a172f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:15.606736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77a56d-3c2b-4455-82d5-d7664f2612cb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:15.625911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:15.650923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0220358-cd69-49c1-9a7c-5c88dbce03c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:15.652192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0220358-cd69-49c1-9a7c-5c88dbce03c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:15.652475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0220358-cd69-49c1-9a7c-5c88dbce03c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:15.652749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0220358-cd69-49c1-9a7c-5c88dbce03c1 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd/users/26cd6b597a6f49f788e9d54d1b17cf81/roles/fdbe1fc69914484591390937886dfbfa` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:15.654987 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0220358-cd69-49c1-9a7c-5c88dbce03c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a33fb2c471ff405e8562d6379c3558bd, user_id=26cd6b597a6f49f788e9d54d1b17cf81, role_id=fdbe1fc69914484591390937886dfbfa)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:15.656684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0220358-cd69-49c1-9a7c-5c88dbce03c1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:15.673304 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 133/289] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:12:15 2022] PUT /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd/users/26cd6b597a6f49f788e9d54d1b17cf81/roles/fdbe1fc69914484591390937886dfbfa => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:12:15.725800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f6ecd-5d20-40cf-817b-f5b7fe9a172f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:15.783517 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32887581-fe02-49f8-bcb0-ecc5aa565c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:15.784153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32887581-fe02-49f8-bcb0-ecc5aa565c01 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:15.784434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32887581-fe02-49f8-bcb0-ecc5aa565c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:15.784710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32887581-fe02-49f8-bcb0-ecc5aa565c01 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:15.785444 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32887581-fe02-49f8-bcb0-ecc5aa565c01 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:15.785750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32887581-fe02-49f8-bcb0-ecc5aa565c01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:15.787178 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32887581-fe02-49f8-bcb0-ecc5aa565c01 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:15.802511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 157/290] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:15.808344 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0220358-cd69-49c1-9a7c-5c88dbce03c1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:15.944853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:15.982658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0220358-cd69-49c1-9a7c-5c88dbce03c1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:16.029453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b37ba-3db2-45b3-bbff-c4ad5fab6c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:16.030117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b37ba-3db2-45b3-bbff-c4ad5fab6c1c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:16.030393 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b37ba-3db2-45b3-bbff-c4ad5fab6c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:16.030702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b37ba-3db2-45b3-bbff-c4ad5fab6c1c None admin] PATH_INFO: `/v3/users/3461ef7e626e47f089164d33654b4273` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:16.035157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b37ba-3db2-45b3-bbff-c4ad5fab6c1c None admin] RBAC: Authorizing `identity:get_user(user_id=3461ef7e626e47f089164d33654b4273)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:16.036738 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b37ba-3db2-45b3-bbff-c4ad5fab6c1c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:16.038435 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 134/291] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:15 2022] GET /identity/v3/users/3461ef7e626e47f089164d33654b4273 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:16.047492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32887581-fe02-49f8-bcb0-ecc5aa565c01 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:16.190314 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32887581-fe02-49f8-bcb0-ecc5aa565c01 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:16.217400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:16.237329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176da31-4f39-4ff0-8240-15107b72f4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:16.237949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176da31-4f39-4ff0-8240-15107b72f4eb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:16.238231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176da31-4f39-4ff0-8240-15107b72f4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:16.238530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176da31-4f39-4ff0-8240-15107b72f4eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:16.317327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176da31-4f39-4ff0-8240-15107b72f4eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:16.319355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176da31-4f39-4ff0-8240-15107b72f4eb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:16.467689 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 158/292] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:16.472328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b37ba-3db2-45b3-bbff-c4ad5fab6c1c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:16.593624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b37ba-3db2-45b3-bbff-c4ad5fab6c1c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:16.637545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fbc04-9bed-4394-b3f7-07bcfe37db59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:16.638199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fbc04-9bed-4394-b3f7-07bcfe37db59 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:16.638500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fbc04-9bed-4394-b3f7-07bcfe37db59 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:16.638832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fbc04-9bed-4394-b3f7-07bcfe37db59 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:16.640064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fbc04-9bed-4394-b3f7-07bcfe37db59 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:16.641507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fbc04-9bed-4394-b3f7-07bcfe37db59 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:16.643211 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 135/293] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:16 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:16.649593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176da31-4f39-4ff0-8240-15107b72f4eb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:16.674462 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:16.782012 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176da31-4f39-4ff0-8240-15107b72f4eb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:16.819312 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b91ed8-70d4-4182-b744-921c56b6d249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:16.820397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b91ed8-70d4-4182-b744-921c56b6d249 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:16.820888 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b91ed8-70d4-4182-b744-921c56b6d249 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:16.821364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b91ed8-70d4-4182-b744-921c56b6d249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:16.822366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b91ed8-70d4-4182-b744-921c56b6d249 None admin] RBAC: Adding query filter params (role.id=d295e312e144479ca8f748650ac995a4, scope.project.id=a33fb2c471ff405e8562d6379c3558bd, user.id=3461ef7e626e47f089164d33654b4273) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:16.822902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b91ed8-70d4-4182-b744-921c56b6d249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:16.824579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b91ed8-70d4-4182-b744-921c56b6d249 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:16.831899 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 159/294] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:16 2022] GET /identity/v3/role_assignments?user.id=3461ef7e626e47f089164d33654b4273&scope.project.id=a33fb2c471ff405e8562d6379c3558bd&role.id=d295e312e144479ca8f748650ac995a4 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:16.969966 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183da42-b741-48fb-b110-d0e282ae77ea None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:16.970957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183da42-b741-48fb-b110-d0e282ae77ea None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:16.971457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183da42-b741-48fb-b110-d0e282ae77ea None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:16.973334 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 136/295] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:16.979512 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad76736-aa37-4ce3-b651-30c78388b42c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:16.980061 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad76736-aa37-4ce3-b651-30c78388b42c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:16.980543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad76736-aa37-4ce3-b651-30c78388b42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:16.999881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4ad76736-aa37-4ce3-b651-30c78388b42c None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:17.001481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4ad76736-aa37-4ce3-b651-30c78388b42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:17.075755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 160/296] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:17.080278 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa07ee-f01d-433b-8571-a50287ee8303 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:17.080802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa07ee-f01d-433b-8571-a50287ee8303 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:17.081301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa07ee-f01d-433b-8571-a50287ee8303 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:17.083091 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 137/297] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:17.089282 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028ab13-d47e-4469-8c6c-d23905ca898c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:17.089573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028ab13-d47e-4469-8c6c-d23905ca898c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:17.089851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028ab13-d47e-4469-8c6c-d23905ca898c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:17.109788 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa07ee-f01d-433b-8571-a50287ee8303 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:17.114911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0028ab13-d47e-4469-8c6c-d23905ca898c None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:17.116161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0028ab13-d47e-4469-8c6c-d23905ca898c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:17.127650 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:17.130640 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:17.208529 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 161/298] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:17.232549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028ab13-d47e-4469-8c6c-d23905ca898c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:17.280101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa07ee-f01d-433b-8571-a50287ee8303 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:17.327400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74354aa4-4397-49a8-9827-d56e1c1ab894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:17.328635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74354aa4-4397-49a8-9827-d56e1c1ab894 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:17.329127 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74354aa4-4397-49a8-9827-d56e1c1ab894 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:17.330532 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74354aa4-4397-49a8-9827-d56e1c1ab894 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:17.347645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74354aa4-4397-49a8-9827-d56e1c1ab894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-74354aa4-4397-49a8-9827-d56e1c1ab894 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:17.354589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:17.355455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:17.356241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:17.356241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:17.356241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:17.356241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:17.356241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:17.356241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:17.356241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:17.356241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:17.356241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:17.356241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:17.356241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:17.356241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:17.359251 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 138/299] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:17.367107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74354aa4-4397-49a8-9827-d56e1c1ab894 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:17.370305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028ab13-d47e-4469-8c6c-d23905ca898c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:17.412186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206c8c4-5061-4a36-a384-8b1eaacd1aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:17.413730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206c8c4-5061-4a36-a384-8b1eaacd1aff None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:17.413730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206c8c4-5061-4a36-a384-8b1eaacd1aff None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:17.413730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206c8c4-5061-4a36-a384-8b1eaacd1aff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:17.415043 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206c8c4-5061-4a36-a384-8b1eaacd1aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:17.416607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206c8c4-5061-4a36-a384-8b1eaacd1aff None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:17.419128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 162/300] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:17.420248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425904c-5bd3-46f4-9ced-beba5ac55fb1 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:17.420629 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425904c-5bd3-46f4-9ced-beba5ac55fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:17.421000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425904c-5bd3-46f4-9ced-beba5ac55fb1 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:17.422455 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 163/301] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:17.424143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425904c-5bd3-46f4-9ced-beba5ac55fb1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:17.439721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:17.454645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:17.492686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74354aa4-4397-49a8-9827-d56e1c1ab894 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:17.533388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3563b0c-a6fd-4d52-9476-16834cc6baf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:17.534398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3563b0c-a6fd-4d52-9476-16834cc6baf2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:17.534901 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3563b0c-a6fd-4d52-9476-16834cc6baf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:17.535496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3563b0c-a6fd-4d52-9476-16834cc6baf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:17.536524 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3563b0c-a6fd-4d52-9476-16834cc6baf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:17.537060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3563b0c-a6fd-4d52-9476-16834cc6baf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:17.538697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3563b0c-a6fd-4d52-9476-16834cc6baf2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:17.545571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425904c-5bd3-46f4-9ced-beba5ac55fb1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:17.548184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 139/302] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:17.549488 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701602a-3822-4d82-8fea-978a0e830579 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:17.549781 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701602a-3822-4d82-8fea-978a0e830579 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:17.550054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701602a-3822-4d82-8fea-978a0e830579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:17.570318 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a701602a-3822-4d82-8fea-978a0e830579 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:17.571600 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a701602a-3822-4d82-8fea-978a0e830579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:17.586770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb182495-c97b-4b7f-bdaf-9d199cdda380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:17.587320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb182495-c97b-4b7f-bdaf-9d199cdda380 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:17.587603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb182495-c97b-4b7f-bdaf-9d199cdda380 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:17.587879 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb182495-c97b-4b7f-bdaf-9d199cdda380 None admin] PATH_INFO: `/v3/groups` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:17.588547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb182495-c97b-4b7f-bdaf-9d199cdda380 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:17.589994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb182495-c97b-4b7f-bdaf-9d199cdda380 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:17.613440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 164/303] 10.222.0.27 () {60 vars in 1134 bytes} [Thu Aug 4 22:12:17 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:12:17.613440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb182495-c97b-4b7f-bdaf-9d199cdda380 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:17.662620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 140/304] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:17.685798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701602a-3822-4d82-8fea-978a0e830579 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:17.734805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:17.746475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb182495-c97b-4b7f-bdaf-9d199cdda380 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:17.764020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:17.793467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d59ce-7dc3-480f-8132-0286ee8536dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:17.794106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d59ce-7dc3-480f-8132-0286ee8536dd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:17.794385 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d59ce-7dc3-480f-8132-0286ee8536dd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:17.794775 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d59ce-7dc3-480f-8132-0286ee8536dd None admin] PATH_INFO: `/v3/users/f8200195ac054d149195ea1d4e9ad0e0` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:17.796013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d59ce-7dc3-480f-8132-0286ee8536dd None admin] RBAC: Authorizing `identity:get_user(user_id=f8200195ac054d149195ea1d4e9ad0e0)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:17.798424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d59ce-7dc3-480f-8132-0286ee8536dd None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:17.800076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 165/305] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:17 2022] GET /identity/v3/users/f8200195ac054d149195ea1d4e9ad0e0 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:17.805804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d59ce-7dc3-480f-8132-0286ee8536dd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:17.815909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701602a-3822-4d82-8fea-978a0e830579 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:17.862038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908638fe-e523-4f36-87f9-e083c0dfaf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:17.862839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908638fe-e523-4f36-87f9-e083c0dfaf28 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:17.863218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908638fe-e523-4f36-87f9-e083c0dfaf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:17.863497 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908638fe-e523-4f36-87f9-e083c0dfaf28 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:17.876966 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908638fe-e523-4f36-87f9-e083c0dfaf28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-908638fe-e523-4f36-87f9-e083c0dfaf28 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:17.884168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:17.885122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:17.885911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:17.885911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:17.885911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:17.885911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:17.885911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:17.885911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:17.885911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:17.885911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:17.885911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:17.885911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:17.885911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:17.885911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:17.885911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 141/306] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:12:17.891402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908638fe-e523-4f36-87f9-e083c0dfaf28 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:17.926737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d59ce-7dc3-480f-8132-0286ee8536dd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:17.974930 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8ac9d-aba2-4a8b-a551-a1ce84333de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:17.976012 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ac9d-aba2-4a8b-a551-a1ce84333de0 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:17.976504 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ac9d-aba2-4a8b-a551-a1ce84333de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:17.976977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ac9d-aba2-4a8b-a551-a1ce84333de0 None admin] PATH_INFO: `/v3/system/users/f8200195ac054d149195ea1d4e9ad0e0/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:17.978731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8ac9d-aba2-4a8b-a551-a1ce84333de0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f8200195ac054d149195ea1d4e9ad0e0, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:17.980360 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8ac9d-aba2-4a8b-a551-a1ce84333de0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:17.993438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 166/307] 10.222.0.27 () {58 vars in 1334 bytes} [Thu Aug 4 22:12:17 2022] PUT /identity/v3/system/users/f8200195ac054d149195ea1d4e9ad0e0/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:12:18.028217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908638fe-e523-4f36-87f9-e083c0dfaf28 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:18.052311 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:18.069420 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0ac25-ce6e-4789-8dec-b3f0e6f7289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:18.070058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0ac25-ce6e-4789-8dec-b3f0e6f7289e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:18.070340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0ac25-ce6e-4789-8dec-b3f0e6f7289e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:18.070648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0ac25-ce6e-4789-8dec-b3f0e6f7289e None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:18.071381 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0ac25-ce6e-4789-8dec-b3f0e6f7289e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:18.071690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0ac25-ce6e-4789-8dec-b3f0e6f7289e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:18.073088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0ac25-ce6e-4789-8dec-b3f0e6f7289e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:18.083558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 142/308] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:18.089912 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8ac9d-aba2-4a8b-a551-a1ce84333de0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:18.095361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:18.147451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7994e8-254c-416e-b2ec-89028b8cee0e None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:18.147644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7994e8-254c-416e-b2ec-89028b8cee0e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:18.147910 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7994e8-254c-416e-b2ec-89028b8cee0e None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:18.149425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 143/309] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:12:18.154772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c8e7-78c1-4abf-8be1-befd797dfbc6 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:18.155053 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c8e7-78c1-4abf-8be1-befd797dfbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:18.155327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854c8e7-78c1-4abf-8be1-befd797dfbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:18.175931 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b854c8e7-78c1-4abf-8be1-befd797dfbc6 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:18.177230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b854c8e7-78c1-4abf-8be1-befd797dfbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:18.226427 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8ac9d-aba2-4a8b-a551-a1ce84333de0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:18.261229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 144/310] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:18.275760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d383e-9524-4cea-b8b4-9c5e6b4e3dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:18.276408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d383e-9524-4cea-b8b4-9c5e6b4e3dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:18.276690 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d383e-9524-4cea-b8b4-9c5e6b4e3dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:18.276963 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d383e-9524-4cea-b8b4-9c5e6b4e3dc3 None admin] PATH_INFO: `/v3/users/a84454d600cf46bea7ab3e62947a1f1a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:18.284467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854c8e7-78c1-4abf-8be1-befd797dfbc6 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:18.293848 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d383e-9524-4cea-b8b4-9c5e6b4e3dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=a84454d600cf46bea7ab3e62947a1f1a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:18.295360 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d383e-9524-4cea-b8b4-9c5e6b4e3dc3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:18.297990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 167/311] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:18 2022] GET /identity/v3/users/a84454d600cf46bea7ab3e62947a1f1a => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:18.305155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d383e-9524-4cea-b8b4-9c5e6b4e3dc3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:18.378942 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:18.420327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854c8e7-78c1-4abf-8be1-befd797dfbc6 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:18.425615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d383e-9524-4cea-b8b4-9c5e6b4e3dc3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:18.438757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:18.463944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcc064-f091-4527-b48c-db03a87f66f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:18.464796 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcc064-f091-4527-b48c-db03a87f66f6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:18.465169 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcc064-f091-4527-b48c-db03a87f66f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:18.465544 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcc064-f091-4527-b48c-db03a87f66f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:18.466660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcc064-f091-4527-b48c-db03a87f66f6 None admin] RBAC: Adding query filter params (role.id=fdbe1fc69914484591390937886dfbfa, user.id=a84454d600cf46bea7ab3e62947a1f1a, scope.system=all) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:18.467056 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcc064-f091-4527-b48c-db03a87f66f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:18.468589 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcc064-f091-4527-b48c-db03a87f66f6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:18.471911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f284b-8044-41bc-a543-5941e80c8755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:18.473007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f284b-8044-41bc-a543-5941e80c8755 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:18.473436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f284b-8044-41bc-a543-5941e80c8755 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:18.473854 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f284b-8044-41bc-a543-5941e80c8755 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:18.478522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 168/312] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Aug 4 22:12:18 2022] GET /identity/v3/role_assignments?user.id=a84454d600cf46bea7ab3e62947a1f1a&scope.system=all&role.id=fdbe1fc69914484591390937886dfbfa => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:18.493041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f284b-8044-41bc-a543-5941e80c8755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-403f284b-8044-41bc-a543-5941e80c8755 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:18.498252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:18.499269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:18.500055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:18.500055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:18.500055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:18.500055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:18.500055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:18.500055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:18.500055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:18.500055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:18.500055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:18.500055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:18.500055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:18.500055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:18.500055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 145/313] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:12:18.505931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcc064-f091-4527-b48c-db03a87f66f6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:18.624314 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcc064-f091-4527-b48c-db03a87f66f6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:18.661828 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f3a21-09b0-4d28-8ec5-0be74e4d0752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:18.662869 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f3a21-09b0-4d28-8ec5-0be74e4d0752 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:18.663377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:18.663836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f3a21-09b0-4d28-8ec5-0be74e4d0752 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:18.664339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f3a21-09b0-4d28-8ec5-0be74e4d0752 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:18.665264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f3a21-09b0-4d28-8ec5-0be74e4d0752 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:18.665818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f3a21-09b0-4d28-8ec5-0be74e4d0752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:18.667474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f3a21-09b0-4d28-8ec5-0be74e4d0752 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:18.676741 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 169/314] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:18.683758 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f284b-8044-41bc-a543-5941e80c8755 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:18.796196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f284b-8044-41bc-a543-5941e80c8755 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:18.835167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21744c9-c210-4a24-af90-d5ccee1d48df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:18.836127 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21744c9-c210-4a24-af90-d5ccee1d48df None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:18.836586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21744c9-c210-4a24-af90-d5ccee1d48df None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:18.837061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21744c9-c210-4a24-af90-d5ccee1d48df None admin] PATH_INFO: `/v3/users/26cd6b597a6f49f788e9d54d1b17cf81` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:18.838507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21744c9-c210-4a24-af90-d5ccee1d48df None admin] RBAC: Authorizing `identity:get_user(user_id=26cd6b597a6f49f788e9d54d1b17cf81)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:18.840118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21744c9-c210-4a24-af90-d5ccee1d48df None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:18.841917 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 146/315] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:18 2022] GET /identity/v3/users/26cd6b597a6f49f788e9d54d1b17cf81 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:18.847746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f3a21-09b0-4d28-8ec5-0be74e4d0752 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:18.952048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f3a21-09b0-4d28-8ec5-0be74e4d0752 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:18.986003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ffc27-56cb-43d9-aa72-d857f2dfb293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:18.986646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ffc27-56cb-43d9-aa72-d857f2dfb293 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:18.986927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ffc27-56cb-43d9-aa72-d857f2dfb293 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:18.987200 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ffc27-56cb-43d9-aa72-d857f2dfb293 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:19.046859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:19.059672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ffc27-56cb-43d9-aa72-d857f2dfb293 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:19.061494 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ffc27-56cb-43d9-aa72-d857f2dfb293 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:19.169817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 170/316] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:19.170569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21744c9-c210-4a24-af90-d5ccee1d48df None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:19.216562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:19.283734 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21744c9-c210-4a24-af90-d5ccee1d48df None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:19.319688 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e3027-f20f-455f-acdc-1d786200bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:19.320702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e3027-f20f-455f-acdc-1d786200bed3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:19.321189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e3027-f20f-455f-acdc-1d786200bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:19.321665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e3027-f20f-455f-acdc-1d786200bed3 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:19.323088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e3027-f20f-455f-acdc-1d786200bed3 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:19.324738 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e3027-f20f-455f-acdc-1d786200bed3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:19.326919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 147/317] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:19 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:19.335101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ffc27-56cb-43d9-aa72-d857f2dfb293 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:19.422321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:19.436577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ffc27-56cb-43d9-aa72-d857f2dfb293 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:19.477327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9002913-8d17-4d0d-aca5-7d62ca237ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:19.477888 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9002913-8d17-4d0d-aca5-7d62ca237ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:19.478170 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9002913-8d17-4d0d-aca5-7d62ca237ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:19.478470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9002913-8d17-4d0d-aca5-7d62ca237ab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:19.479269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9002913-8d17-4d0d-aca5-7d62ca237ab6 None admin] RBAC: Adding query filter params (role.id=fdbe1fc69914484591390937886dfbfa, scope.project.id=a33fb2c471ff405e8562d6379c3558bd, user.id=26cd6b597a6f49f788e9d54d1b17cf81) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:19.479583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9002913-8d17-4d0d-aca5-7d62ca237ab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:19.481031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9002913-8d17-4d0d-aca5-7d62ca237ab6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:19.487293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 171/318] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:19 2022] GET /identity/v3/role_assignments?user.id=26cd6b597a6f49f788e9d54d1b17cf81&scope.project.id=a33fb2c471ff405e8562d6379c3558bd&role.id=fdbe1fc69914484591390937886dfbfa => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:19.726085 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813f9e0-a36a-4512-a635-e8c01864a84d None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:19.726457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813f9e0-a36a-4512-a635-e8c01864a84d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:19.726771 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813f9e0-a36a-4512-a635-e8c01864a84d None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:19.728224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 148/319] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:19.733660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70241beb-7261-4ebe-b8c8-d0a58d774a9f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:19.733952 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70241beb-7261-4ebe-b8c8-d0a58d774a9f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:19.734234 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70241beb-7261-4ebe-b8c8-d0a58d774a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:19.754126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-70241beb-7261-4ebe-b8c8-d0a58d774a9f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:19.755362 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-70241beb-7261-4ebe-b8c8-d0a58d774a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:19.822919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 172/320] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:19.845601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813f9e0-a36a-4512-a635-e8c01864a84d None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:19.954481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813f9e0-a36a-4512-a635-e8c01864a84d None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:19.964414 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:19.989381 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27ef6f-7f15-4ad9-b23d-f0022cf13ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:19.989956 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27ef6f-7f15-4ad9-b23d-f0022cf13ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:19.990239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27ef6f-7f15-4ad9-b23d-f0022cf13ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:19.990594 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27ef6f-7f15-4ad9-b23d-f0022cf13ed9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:19.991723 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27ef6f-7f15-4ad9-b23d-f0022cf13ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:19.993167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27ef6f-7f15-4ad9-b23d-f0022cf13ed9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:20.000232 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 149/321] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:20.001712 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70241beb-7261-4ebe-b8c8-d0a58d774a9f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:20.085071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:20.104844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70241beb-7261-4ebe-b8c8-d0a58d774a9f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:20.140466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafce50-5112-4d64-838e-d03119d18c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:20.141087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafce50-5112-4d64-838e-d03119d18c60 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:20.141371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafce50-5112-4d64-838e-d03119d18c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:20.141650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafce50-5112-4d64-838e-d03119d18c60 None admin] PATH_INFO: `/v3/groups` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:20.142329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafce50-5112-4d64-838e-d03119d18c60 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:20.143813 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafce50-5112-4d64-838e-d03119d18c60 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:20.160448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 173/322] 10.222.0.27 () {60 vars in 1134 bytes} [Thu Aug 4 22:12:20 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:12:20.182346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5313ec2-961a-4895-9523-f59525cadab0 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:20.182897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5313ec2-961a-4895-9523-f59525cadab0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:20.183006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5313ec2-961a-4895-9523-f59525cadab0 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:20.184659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 150/323] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:20.191037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b767267-83af-4b71-afe1-cfd2c37c2556 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:20.191940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b767267-83af-4b71-afe1-cfd2c37c2556 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:20.192394 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b767267-83af-4b71-afe1-cfd2c37c2556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:20.213024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1b767267-83af-4b71-afe1-cfd2c37c2556 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:20.214666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1b767267-83af-4b71-afe1-cfd2c37c2556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:20.295438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 174/324] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:20.315705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5313ec2-961a-4895-9523-f59525cadab0 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:20.424480 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5313ec2-961a-4895-9523-f59525cadab0 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:20.467591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8188f-e36a-4f81-bf9a-fbafb1fdbb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:20.467591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8188f-e36a-4f81-bf9a-fbafb1fdbb0f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:20.467802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8188f-e36a-4f81-bf9a-fbafb1fdbb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:20.467985 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8188f-e36a-4f81-bf9a-fbafb1fdbb0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:20.479027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8188f-e36a-4f81-bf9a-fbafb1fdbb0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-91f8188f-e36a-4f81-bf9a-fbafb1fdbb0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:20.484209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:20.485092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:20.485886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:20.485886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:20.485886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:20.485886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:20.485886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:20.485886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:20.485886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:20.485886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:20.485886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:20.485886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:20.485886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:20.485886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:20.485886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 151/325] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:20.493380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b767267-83af-4b71-afe1-cfd2c37c2556 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:20.579061 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:20.603310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a72d0-ccba-46ea-bcd0-ee5907f04cc9 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:20.603310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a72d0-ccba-46ea-bcd0-ee5907f04cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:20.603557 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a72d0-ccba-46ea-bcd0-ee5907f04cc9 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:20.605084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 152/326] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:12:20.612552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef4020-3325-42f8-8125-bb9e6b0d6eb0 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:20.612826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef4020-3325-42f8-8125-bb9e6b0d6eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:20.613101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef4020-3325-42f8-8125-bb9e6b0d6eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:20.621739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b767267-83af-4b71-afe1-cfd2c37c2556 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:20.637245 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-0bef4020-3325-42f8-8125-bb9e6b0d6eb0 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:20.638504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0bef4020-3325-42f8-8125-bb9e6b0d6eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:20.676128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:20.677563 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4eaffc-a241-46e9-a51a-b8bc30ed58bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:20.679044 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eaffc-a241-46e9-a51a-b8bc30ed58bb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:20.679291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eaffc-a241-46e9-a51a-b8bc30ed58bb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:20.679595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eaffc-a241-46e9-a51a-b8bc30ed58bb None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:20.680332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4eaffc-a241-46e9-a51a-b8bc30ed58bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:20.680647 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4eaffc-a241-46e9-a51a-b8bc30ed58bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:20.682041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4eaffc-a241-46e9-a51a-b8bc30ed58bb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:20.692959 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 175/327] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:20.699419 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4eaffc-a241-46e9-a51a-b8bc30ed58bb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:20.724324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 153/328] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:20.746972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef4020-3325-42f8-8125-bb9e6b0d6eb0 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:20.828431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4eaffc-a241-46e9-a51a-b8bc30ed58bb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:20.874798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef4020-3325-42f8-8125-bb9e6b0d6eb0 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:20.881530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa75646-6426-4cda-8772-94f83d3ddfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:20.882238 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa75646-6426-4cda-8772-94f83d3ddfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:20.882571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa75646-6426-4cda-8772-94f83d3ddfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:20.882849 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa75646-6426-4cda-8772-94f83d3ddfe3 None admin] PATH_INFO: `/v3/users/f8200195ac054d149195ea1d4e9ad0e0` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:20.884108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa75646-6426-4cda-8772-94f83d3ddfe3 None admin] RBAC: Authorizing `identity:get_user(user_id=f8200195ac054d149195ea1d4e9ad0e0)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:20.885572 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa75646-6426-4cda-8772-94f83d3ddfe3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:20.887518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 176/329] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:20 2022] GET /identity/v3/users/f8200195ac054d149195ea1d4e9ad0e0 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:20.893687 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa75646-6426-4cda-8772-94f83d3ddfe3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:20.896832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:20.926211 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781f634-5208-4cd1-a7a0-727876650e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:20.928973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781f634-5208-4cd1-a7a0-727876650e4c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:20.929476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781f634-5208-4cd1-a7a0-727876650e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:20.929990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781f634-5208-4cd1-a7a0-727876650e4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:20.944680 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781f634-5208-4cd1-a7a0-727876650e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-5781f634-5208-4cd1-a7a0-727876650e4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:20.953976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:20.954920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:20.955701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:20.955701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:20.955701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:20.955701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:20.955701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:20.955701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:20.955701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:20.955701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:20.955701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:20.955701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:20.955701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:20.955701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:20.958193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 154/330] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:12:20.964218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781f634-5208-4cd1-a7a0-727876650e4c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:21.006861 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:21.024043 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa75646-6426-4cda-8772-94f83d3ddfe3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:21.069868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a4aea-3d83-4487-abfa-a2666599922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:21.070909 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a4aea-3d83-4487-abfa-a2666599922d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:21.071371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a4aea-3d83-4487-abfa-a2666599922d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:21.071793 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a4aea-3d83-4487-abfa-a2666599922d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:21.073128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a4aea-3d83-4487-abfa-a2666599922d None admin] RBAC: Adding query filter params (role.id=d295e312e144479ca8f748650ac995a4, user.id=f8200195ac054d149195ea1d4e9ad0e0, scope.system=all) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:21.073869 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a4aea-3d83-4487-abfa-a2666599922d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:21.076243 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a4aea-3d83-4487-abfa-a2666599922d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:21.092238 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 177/331] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Aug 4 22:12:20 2022] GET /identity/v3/role_assignments?user.id=f8200195ac054d149195ea1d4e9ad0e0&scope.system=all&role.id=d295e312e144479ca8f748650ac995a4 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:21.104666 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781f634-5208-4cd1-a7a0-727876650e4c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:21.164239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6e212-d11a-4880-96ed-5221512fe090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:21.165106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6e212-d11a-4880-96ed-5221512fe090 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:21.165531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6e212-d11a-4880-96ed-5221512fe090 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:21.165965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6e212-d11a-4880-96ed-5221512fe090 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:21.166870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6e212-d11a-4880-96ed-5221512fe090 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:21.167319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6e212-d11a-4880-96ed-5221512fe090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:21.168839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6e212-d11a-4880-96ed-5221512fe090 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:21.184365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 155/332] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:21.190862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a4aea-3d83-4487-abfa-a2666599922d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:21.293129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:21.347704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a4aea-3d83-4487-abfa-a2666599922d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:21.390922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32f48a-41d9-4c53-9d9a-024f393bafca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:21.391608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32f48a-41d9-4c53-9d9a-024f393bafca None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:21.391921 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32f48a-41d9-4c53-9d9a-024f393bafca None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:21.392201 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32f48a-41d9-4c53-9d9a-024f393bafca None admin] PATH_INFO: `/v3/users/a84454d600cf46bea7ab3e62947a1f1a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:21.393491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32f48a-41d9-4c53-9d9a-024f393bafca None admin] RBAC: Authorizing `identity:get_user(user_id=a84454d600cf46bea7ab3e62947a1f1a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:21.395124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32f48a-41d9-4c53-9d9a-024f393bafca None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:21.397589 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 178/333] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:21 2022] GET /identity/v3/users/a84454d600cf46bea7ab3e62947a1f1a => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:21.403376 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6e212-d11a-4880-96ed-5221512fe090 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:21.498729 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:21.512094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6e212-d11a-4880-96ed-5221512fe090 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:21.548655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82914bf4-9f50-45e1-9a1c-e42511d78eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:21.549329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82914bf4-9f50-45e1-9a1c-e42511d78eee None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:21.549609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82914bf4-9f50-45e1-9a1c-e42511d78eee None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:21.549894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82914bf4-9f50-45e1-9a1c-e42511d78eee None admin] PATH_INFO: `/v3/system/users/a84454d600cf46bea7ab3e62947a1f1a/roles/fdbe1fc69914484591390937886dfbfa` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:21.551409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82914bf4-9f50-45e1-9a1c-e42511d78eee None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a84454d600cf46bea7ab3e62947a1f1a, role_id=fdbe1fc69914484591390937886dfbfa)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:21.552798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82914bf4-9f50-45e1-9a1c-e42511d78eee None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:21.563625 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 156/334] 10.222.0.27 () {58 vars in 1334 bytes} [Thu Aug 4 22:12:21 2022] PUT /identity/v3/system/users/a84454d600cf46bea7ab3e62947a1f1a/roles/fdbe1fc69914484591390937886dfbfa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:12:22.585237 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b66df-ab26-42a1-a989-4b9834e7ed2c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:22.586235 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b66df-ab26-42a1-a989-4b9834e7ed2c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:22.586772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b66df-ab26-42a1-a989-4b9834e7ed2c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:22.588599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 179/335] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:22.593669 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee8d73-86af-4876-a502-5ae58f37777d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:22.594086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee8d73-86af-4876-a502-5ae58f37777d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:22.594258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee8d73-86af-4876-a502-5ae58f37777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:22.619852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-08ee8d73-86af-4876-a502-5ae58f37777d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:22.621051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-08ee8d73-86af-4876-a502-5ae58f37777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:22.710391 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 157/336] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:22.744769 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b66df-ab26-42a1-a989-4b9834e7ed2c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:22.863859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b66df-ab26-42a1-a989-4b9834e7ed2c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:22.895607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:22.904535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b1b0f-2b05-43dc-96bb-7fbb8d551759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:22.905182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b1b0f-2b05-43dc-96bb-7fbb8d551759 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:22.905460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b1b0f-2b05-43dc-96bb-7fbb8d551759 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:22.905733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b1b0f-2b05-43dc-96bb-7fbb8d551759 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:22.916789 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b1b0f-2b05-43dc-96bb-7fbb8d551759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-be7b1b0f-2b05-43dc-96bb-7fbb8d551759 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:22.922213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:22.923146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:22.923938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:22.923938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:22.923938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:22.923938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:22.923938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:22.923938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:22.923938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:22.923938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:22.923938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:22.923938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:22.923938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:22.923938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:22.928238 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 180/337] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:22.929624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee8d73-86af-4876-a502-5ae58f37777d None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:23.029193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:23.053874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee8d73-86af-4876-a502-5ae58f37777d None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:23.101959 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cacc8-e09e-4d87-9bf4-4e2a7037b5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:23.102617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cacc8-e09e-4d87-9bf4-4e2a7037b5da None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:23.102905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cacc8-e09e-4d87-9bf4-4e2a7037b5da None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:23.103182 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cacc8-e09e-4d87-9bf4-4e2a7037b5da None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:23.103901 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cacc8-e09e-4d87-9bf4-4e2a7037b5da None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:23.104208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cacc8-e09e-4d87-9bf4-4e2a7037b5da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:23.105597 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cacc8-e09e-4d87-9bf4-4e2a7037b5da None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:23.114692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 158/338] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:23.121042 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b1b0f-2b05-43dc-96bb-7fbb8d551759 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:23.176930 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed871d45-1839-459d-b446-8efe6dd01461 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:23.177232 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed871d45-1839-459d-b446-8efe6dd01461 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:23.177481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed871d45-1839-459d-b446-8efe6dd01461 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:23.179581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 159/339] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:12:23.184289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763be9d6-96a2-49ac-8efd-47a255b0dfb2 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:23.184568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763be9d6-96a2-49ac-8efd-47a255b0dfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:23.184842 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763be9d6-96a2-49ac-8efd-47a255b0dfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:23.219862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-763be9d6-96a2-49ac-8efd-47a255b0dfb2 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:23.221247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-763be9d6-96a2-49ac-8efd-47a255b0dfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:23.297052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b1b0f-2b05-43dc-96bb-7fbb8d551759 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:23.362533 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 160/340] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:23.367177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399ecd6-85d1-4068-bf0f-2c0f40f9e044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:23.367825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ecd6-85d1-4068-bf0f-2c0f40f9e044 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:23.368110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ecd6-85d1-4068-bf0f-2c0f40f9e044 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:23.368388 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ecd6-85d1-4068-bf0f-2c0f40f9e044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:23.402312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763be9d6-96a2-49ac-8efd-47a255b0dfb2 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:23.452593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:23.466975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399ecd6-85d1-4068-bf0f-2c0f40f9e044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:23.468455 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399ecd6-85d1-4068-bf0f-2c0f40f9e044 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:23.534775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:23.563830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763be9d6-96a2-49ac-8efd-47a255b0dfb2 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:23.583454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 181/341] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:23.585328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57e901-1880-4187-b8af-52e1da754206 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:23.585871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57e901-1880-4187-b8af-52e1da754206 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:23.585871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57e901-1880-4187-b8af-52e1da754206 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:23.587173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 182/342] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:23.591063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57e901-1880-4187-b8af-52e1da754206 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:23.616109 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c10b0b-5362-440b-a35b-8992e181ad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:23.623173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c10b0b-5362-440b-a35b-8992e181ad8b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:23.623620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c10b0b-5362-440b-a35b-8992e181ad8b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:23.624041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c10b0b-5362-440b-a35b-8992e181ad8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:23.635507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c10b0b-5362-440b-a35b-8992e181ad8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-21c10b0b-5362-440b-a35b-8992e181ad8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:23.640741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:23.641832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:23.642892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:23.642892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:23.642892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:23.642892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:23.642892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:23.642892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:23.642892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:23.642892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:23.642892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:23.642892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:23.642892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:23.642892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:23.645417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 161/343] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:12:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:23.651330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174d1e0-7f12-4492-be55-e41c1402fb62 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:23.651792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174d1e0-7f12-4492-be55-e41c1402fb62 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:23.652207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174d1e0-7f12-4492-be55-e41c1402fb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:23.678632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-d174d1e0-7f12-4492-be55-e41c1402fb62 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:23.680045 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d174d1e0-7f12-4492-be55-e41c1402fb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:23.714672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:23.739157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57e901-1880-4187-b8af-52e1da754206 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:23.776498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 162/344] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:23.776742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174d1e0-7f12-4492-be55-e41c1402fb62 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:23.792849 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d5597-8471-4d74-9e63-ca4859949be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:23.793731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d5597-8471-4d74-9e63-ca4859949be9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:23.794162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d5597-8471-4d74-9e63-ca4859949be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:23.794613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d5597-8471-4d74-9e63-ca4859949be9 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:23.797632 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d5597-8471-4d74-9e63-ca4859949be9 None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:23.799315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d5597-8471-4d74-9e63-ca4859949be9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:23.802451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 183/345] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:23 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:23.813337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d5597-8471-4d74-9e63-ca4859949be9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:23.901119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:23.957425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174d1e0-7f12-4492-be55-e41c1402fb62 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:23.975763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d5597-8471-4d74-9e63-ca4859949be9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:24.017000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06526d4f-40ea-456c-ba23-767c662b4ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:24.018350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06526d4f-40ea-456c-ba23-767c662b4ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:24.018891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06526d4f-40ea-456c-ba23-767c662b4ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:24.019383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06526d4f-40ea-456c-ba23-767c662b4ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:24.020638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06526d4f-40ea-456c-ba23-767c662b4ed4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:24.021300 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06526d4f-40ea-456c-ba23-767c662b4ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:24.023136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06526d4f-40ea-456c-ba23-767c662b4ed4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:24.032976 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a7510-ecd9-427c-9337-4cb182e2d04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:24.034135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a7510-ecd9-427c-9337-4cb182e2d04b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:24.036170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 163/346] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:24.036745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a7510-ecd9-427c-9337-4cb182e2d04b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:24.037331 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a7510-ecd9-427c-9337-4cb182e2d04b None admin] PATH_INFO: `/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:24.038991 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06526d4f-40ea-456c-ba23-767c662b4ed4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:24.048940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a7510-ecd9-427c-9337-4cb182e2d04b None admin] RBAC: Authorizing `identity:get_group(group_id=9d3a54e026b64d73baa7a90e60cc6f3a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:24.050737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a7510-ecd9-427c-9337-4cb182e2d04b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:24.057588 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 184/347] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:23 2022] GET /identity/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:24.060921 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a7510-ecd9-427c-9337-4cb182e2d04b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:24.088436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:24.183212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a7510-ecd9-427c-9337-4cb182e2d04b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:24.223017 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa80009-4b60-487b-bc02-a8c966314994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:24.224002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa80009-4b60-487b-bc02-a8c966314994 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:24.224490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa80009-4b60-487b-bc02-a8c966314994 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:24.225039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa80009-4b60-487b-bc02-a8c966314994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:24.286282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06526d4f-40ea-456c-ba23-767c662b4ed4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:24.301274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa80009-4b60-487b-bc02-a8c966314994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:24.303618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa80009-4b60-487b-bc02-a8c966314994 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:24.327342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:24.339977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:24.360488 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa44d6c-50b5-48d5-b3f3-3eb229064015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:24.361150 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa44d6c-50b5-48d5-b3f3-3eb229064015 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:24.361422 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa44d6c-50b5-48d5-b3f3-3eb229064015 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:24.361716 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa44d6c-50b5-48d5-b3f3-3eb229064015 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:24.381906 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa44d6c-50b5-48d5-b3f3-3eb229064015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-2aa44d6c-50b5-48d5-b3f3-3eb229064015 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:24.387399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:24.388400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:24.389208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:24.389208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:24.389208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:24.389208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:24.389208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:24.389208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:24.389208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:24.389208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:24.389208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:24.389208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:24.389208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:24.389208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:24.389208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 164/348] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:24.389871 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa44d6c-50b5-48d5-b3f3-3eb229064015 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:24.421897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 185/349] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:24.423261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa80009-4b60-487b-bc02-a8c966314994 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:24.532453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa80009-4b60-487b-bc02-a8c966314994 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:24.555159 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:24.571889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f8029-f17f-4c87-bd61-eeaa953641ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:24.572783 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f8029-f17f-4c87-bd61-eeaa953641ce None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:24.573168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f8029-f17f-4c87-bd61-eeaa953641ce None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:24.573547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f8029-f17f-4c87-bd61-eeaa953641ce None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:24.574447 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f8029-f17f-4c87-bd61-eeaa953641ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:24.575932 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f8029-f17f-4c87-bd61-eeaa953641ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:24.577564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f8029-f17f-4c87-bd61-eeaa953641ce None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:24.579278 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa44d6c-50b5-48d5-b3f3-3eb229064015 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:24.587176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 186/350] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:24.588108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f8029-f17f-4c87-bd61-eeaa953641ce None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:24.615234 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f31f9-b20a-449c-82ae-cd97277e32df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:24.616183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f31f9-b20a-449c-82ae-cd97277e32df None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:24.617020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f31f9-b20a-449c-82ae-cd97277e32df None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:24.617429 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f31f9-b20a-449c-82ae-cd97277e32df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:24.618355 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f31f9-b20a-449c-82ae-cd97277e32df None admin] RBAC: Adding query filter params (group.id=9d3a54e026b64d73baa7a90e60cc6f3a, role.id=d295e312e144479ca8f748650ac995a4, scope.project.id=7bd58a62525c46c888f56577918c1637) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:24.618865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f31f9-b20a-449c-82ae-cd97277e32df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:24.620493 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f31f9-b20a-449c-82ae-cd97277e32df None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:24.626695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 165/351] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 4 22:12:24 2022] GET /identity/v3/role_assignments?group.id=9d3a54e026b64d73baa7a90e60cc6f3a&scope.project.id=7bd58a62525c46c888f56577918c1637&role.id=d295e312e144479ca8f748650ac995a4 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:24.630431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bf31e-4b24-43fc-b65a-446bc8c795c8 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:24.631543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bf31e-4b24-43fc-b65a-446bc8c795c8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:24.632016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bf31e-4b24-43fc-b65a-446bc8c795c8 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:24.633522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 166/352] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:24.634433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bf31e-4b24-43fc-b65a-446bc8c795c8 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:24.703397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f8029-f17f-4c87-bd61-eeaa953641ce None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:24.720823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:24.745285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30a0ae-773b-4bd9-af01-51bf7dcd26db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:24.746466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30a0ae-773b-4bd9-af01-51bf7dcd26db None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:24.746940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30a0ae-773b-4bd9-af01-51bf7dcd26db None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:24.747528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30a0ae-773b-4bd9-af01-51bf7dcd26db None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:24.748938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30a0ae-773b-4bd9-af01-51bf7dcd26db None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:24.750797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30a0ae-773b-4bd9-af01-51bf7dcd26db None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:24.752759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 187/353] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:24 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:24.754300 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54e20e-d691-43e5-8911-bfb52c36af57 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:24.754835 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54e20e-d691-43e5-8911-bfb52c36af57 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:24.755322 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54e20e-d691-43e5-8911-bfb52c36af57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:24.792824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5e54e20e-d691-43e5-8911-bfb52c36af57 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:24.798656 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5e54e20e-d691-43e5-8911-bfb52c36af57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:24.827220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bf31e-4b24-43fc-b65a-446bc8c795c8 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:24.878083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f683d-661c-4973-9ba6-fa9408f2bd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:24.879106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f683d-661c-4973-9ba6-fa9408f2bd31 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:24.879595 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f683d-661c-4973-9ba6-fa9408f2bd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:24.880100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f683d-661c-4973-9ba6-fa9408f2bd31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:24.901703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:24.940828 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 188/354] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:24.941751 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54e20e-d691-43e5-8911-bfb52c36af57 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:25.022615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f683d-661c-4973-9ba6-fa9408f2bd31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:25.024281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f683d-661c-4973-9ba6-fa9408f2bd31 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:25.060622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54e20e-d691-43e5-8911-bfb52c36af57 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:25.091518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:25.108513 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45219b95-23bc-4e3d-8e2c-8cba31e4cf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:25.109656 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219b95-23bc-4e3d-8e2c-8cba31e4cf40 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:25.109943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219b95-23bc-4e3d-8e2c-8cba31e4cf40 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:25.110224 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219b95-23bc-4e3d-8e2c-8cba31e4cf40 None admin] PATH_INFO: `/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:25.111724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45219b95-23bc-4e3d-8e2c-8cba31e4cf40 None admin] RBAC: Authorizing `identity:get_group(group_id=9d3a54e026b64d73baa7a90e60cc6f3a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:25.114176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45219b95-23bc-4e3d-8e2c-8cba31e4cf40 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:25.117804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 189/355] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:24 2022] GET /identity/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:25.119040 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2b41f-a4be-4412-87be-9b6d5e653bcd None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:25.122681 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2b41f-a4be-4412-87be-9b6d5e653bcd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:25.122987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2b41f-a4be-4412-87be-9b6d5e653bcd None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:25.124365 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 190/356] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:25.127088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2b41f-a4be-4412-87be-9b6d5e653bcd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:25.162983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 167/357] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:25.164332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f683d-661c-4973-9ba6-fa9408f2bd31 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:25.194041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:25.253142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2b41f-a4be-4412-87be-9b6d5e653bcd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:25.304168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f683d-661c-4973-9ba6-fa9408f2bd31 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:25.306632 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdf088-4c53-4393-b7de-1af084ff2ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:25.307295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdf088-4c53-4393-b7de-1af084ff2ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:25.308443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdf088-4c53-4393-b7de-1af084ff2ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:25.308723 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdf088-4c53-4393-b7de-1af084ff2ab6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:25.322116 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdf088-4c53-4393-b7de-1af084ff2ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-63bdf088-4c53-4393-b7de-1af084ff2ab6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:25.328691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:25.329597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:25.330376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:25.330376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:25.330376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:25.330376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:25.330376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:25.330376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:25.330376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:25.330376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:25.330376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:25.330376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:25.330376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:25.330376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:25.330376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 191/358] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:12:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:25.330376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8509d4-1073-44d1-8a65-fa22fd6c7ddd None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:25.331101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8509d4-1073-44d1-8a65-fa22fd6c7ddd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:25.331101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8509d4-1073-44d1-8a65-fa22fd6c7ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:25.348311 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2a017-0de5-4524-b0f0-f6c80c64d089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:25.348941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2a017-0de5-4524-b0f0-f6c80c64d089 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:25.349226 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2a017-0de5-4524-b0f0-f6c80c64d089 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:25.349504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2a017-0de5-4524-b0f0-f6c80c64d089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:25.351419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2a017-0de5-4524-b0f0-f6c80c64d089 None admin] RBAC: Adding query filter params (group.id=9d3a54e026b64d73baa7a90e60cc6f3a, role.id=b371b8f12e7348e8b01784eeddeca2ac, scope.project.id=7bd58a62525c46c888f56577918c1637) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:25.351419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2a017-0de5-4524-b0f0-f6c80c64d089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:25.352597 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2a017-0de5-4524-b0f0-f6c80c64d089 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:25.354110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ad8509d4-1073-44d1-8a65-fa22fd6c7ddd None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:25.355751 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ad8509d4-1073-44d1-8a65-fa22fd6c7ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:25.358393 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 168/359] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 4 22:12:25 2022] GET /identity/v3/role_assignments?group.id=9d3a54e026b64d73baa7a90e60cc6f3a&scope.project.id=7bd58a62525c46c888f56577918c1637&role.id=b371b8f12e7348e8b01784eeddeca2ac => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:25.359057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2a017-0de5-4524-b0f0-f6c80c64d089 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:25.378704 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:25.441420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 192/360] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:25.444482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3d910-cb8a-4a4c-8b1f-fa76914ae6d8 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:25.444878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3d910-cb8a-4a4c-8b1f-fa76914ae6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:25.445321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3d910-cb8a-4a4c-8b1f-fa76914ae6d8 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:25.447272 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 193/361] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:25.447723 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3d910-cb8a-4a4c-8b1f-fa76914ae6d8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:25.497739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:25.503243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2a017-0de5-4524-b0f0-f6c80c64d089 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:25.550579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e35544-9ae7-4665-83db-e3aafeb32398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:25.551068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35544-9ae7-4665-83db-e3aafeb32398 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:25.551354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35544-9ae7-4665-83db-e3aafeb32398 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:25.551633 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e35544-9ae7-4665-83db-e3aafeb32398 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:25.553449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e35544-9ae7-4665-83db-e3aafeb32398 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:25.555174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e35544-9ae7-4665-83db-e3aafeb32398 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:25.562543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 169/362] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:25 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:25.562543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b19d9-0933-43b7-80af-6b828f5f3c19 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:25.562543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b19d9-0933-43b7-80af-6b828f5f3c19 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:25.562543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b19d9-0933-43b7-80af-6b828f5f3c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:25.577083 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3d910-cb8a-4a4c-8b1f-fa76914ae6d8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:25.585014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-ad1b19d9-0933-43b7-80af-6b828f5f3c19 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:25.586881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ad1b19d9-0933-43b7-80af-6b828f5f3c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:25.619083 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988390b-f260-4b6a-9332-e92f9a911be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:25.620332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988390b-f260-4b6a-9332-e92f9a911be3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:25.620818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988390b-f260-4b6a-9332-e92f9a911be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:25.621269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988390b-f260-4b6a-9332-e92f9a911be3 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:25.622172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988390b-f260-4b6a-9332-e92f9a911be3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:25.622647 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988390b-f260-4b6a-9332-e92f9a911be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:25.624195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988390b-f260-4b6a-9332-e92f9a911be3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:25.632853 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 194/363] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:25.634115 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988390b-f260-4b6a-9332-e92f9a911be3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:25.680373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 170/364] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:25.681698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b19d9-0933-43b7-80af-6b828f5f3c19 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:25.698063 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:25.743501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:25.746811 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988390b-f260-4b6a-9332-e92f9a911be3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:25.797301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867853d9-74e3-4df3-91ce-7d4e721f29d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:25.797959 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867853d9-74e3-4df3-91ce-7d4e721f29d0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:25.798244 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867853d9-74e3-4df3-91ce-7d4e721f29d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:25.798590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867853d9-74e3-4df3-91ce-7d4e721f29d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:25.808937 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b19d9-0933-43b7-80af-6b828f5f3c19 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:25.811264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867853d9-74e3-4df3-91ce-7d4e721f29d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-867853d9-74e3-4df3-91ce-7d4e721f29d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:25.816953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:25.817836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:25.818686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:25.818686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:25.818686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:25.818686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:25.818686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:25.818686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:25.818686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:25.818686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:25.818686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:25.818686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:25.818686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 04 22:12:25.818686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:25.818686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 195/365] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:25.819372 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867853d9-74e3-4df3-91ce-7d4e721f29d0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:25.860279 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f205caa-9991-4015-82cd-2b78fc99f189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:25.861184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f205caa-9991-4015-82cd-2b78fc99f189 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:25.861473 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f205caa-9991-4015-82cd-2b78fc99f189 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:25.861753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f205caa-9991-4015-82cd-2b78fc99f189 None admin] PATH_INFO: `/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:25.863865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f205caa-9991-4015-82cd-2b78fc99f189 None admin] RBAC: Authorizing `identity:get_group(group_id=9d3a54e026b64d73baa7a90e60cc6f3a)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:25.865380 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f205caa-9991-4015-82cd-2b78fc99f189 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:25.867363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 171/366] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:25 2022] GET /identity/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:25.868707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f205caa-9991-4015-82cd-2b78fc99f189 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:25.947029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867853d9-74e3-4df3-91ce-7d4e721f29d0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:25.974108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:25.983582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe2677-1242-49c0-97f4-2a9c8e3a1e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:25.984214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe2677-1242-49c0-97f4-2a9c8e3a1e85 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:25.984501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe2677-1242-49c0-97f4-2a9c8e3a1e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:25.984780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe2677-1242-49c0-97f4-2a9c8e3a1e85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:26.010780 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f205caa-9991-4015-82cd-2b78fc99f189 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:26.023413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:26.061550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7940afe-508a-4da8-8ea0-bd4978471841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:26.062120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940afe-508a-4da8-8ea0-bd4978471841 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:26.062420 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940afe-508a-4da8-8ea0-bd4978471841 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:26.062701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940afe-508a-4da8-8ea0-bd4978471841 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:26.077951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7940afe-508a-4da8-8ea0-bd4978471841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:26.083075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe2677-1242-49c0-97f4-2a9c8e3a1e85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a7940afe-508a-4da8-8ea0-bd4978471841 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:26.084819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:26.085925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:26.086938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:26.086938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:26.086938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:26.086938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:26.086938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:26.086938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:26.086938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:26.086938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:26.086938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:26.086938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:26.086938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:12:26.086938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:26.086938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 172/367] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:12:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:26.087871 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7940afe-508a-4da8-8ea0-bd4978471841 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:26.088606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe2677-1242-49c0-97f4-2a9c8e3a1e85 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:26.213206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 196/368] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:26.213206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe2677-1242-49c0-97f4-2a9c8e3a1e85 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:26.226015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7940afe-508a-4da8-8ea0-bd4978471841 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:26.266927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5dcacd-829f-4d63-8ab4-7333e6dd04e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:26.267902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dcacd-829f-4d63-8ab4-7333e6dd04e7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:26.268387 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dcacd-829f-4d63-8ab4-7333e6dd04e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:26.268856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5dcacd-829f-4d63-8ab4-7333e6dd04e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:26.270324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5dcacd-829f-4d63-8ab4-7333e6dd04e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:26.271151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5dcacd-829f-4d63-8ab4-7333e6dd04e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:26.273402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5dcacd-829f-4d63-8ab4-7333e6dd04e7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:26.276731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:26.287009 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 173/369] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:26.288457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5dcacd-829f-4d63-8ab4-7333e6dd04e7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:26.292460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:26.343579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe2677-1242-49c0-97f4-2a9c8e3a1e85 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:26.394365 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82834d-ae43-49a1-b7d0-cee55b75a087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:26.395722 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82834d-ae43-49a1-b7d0-cee55b75a087 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:26.396225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82834d-ae43-49a1-b7d0-cee55b75a087 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:26.398583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82834d-ae43-49a1-b7d0-cee55b75a087 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:26.399396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82834d-ae43-49a1-b7d0-cee55b75a087 None admin] RBAC: Adding query filter params (group.id=9d3a54e026b64d73baa7a90e60cc6f3a, role.id=d295e312e144479ca8f748650ac995a4, scope.project.id=a33fb2c471ff405e8562d6379c3558bd) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:26.399708 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82834d-ae43-49a1-b7d0-cee55b75a087 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:26.401158 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82834d-ae43-49a1-b7d0-cee55b75a087 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:26.407378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 197/370] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 4 22:12:26 2022] GET /identity/v3/role_assignments?group.id=9d3a54e026b64d73baa7a90e60cc6f3a&scope.project.id=a33fb2c471ff405e8562d6379c3558bd&role.id=d295e312e144479ca8f748650ac995a4 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:26.408286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82834d-ae43-49a1-b7d0-cee55b75a087 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:26.422015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5dcacd-829f-4d63-8ab4-7333e6dd04e7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:26.487950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bfa7e-0fb9-4996-bfb3-a797e6b42023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:26.488830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bfa7e-0fb9-4996-bfb3-a797e6b42023 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:26.489289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bfa7e-0fb9-4996-bfb3-a797e6b42023 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:26.489710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bfa7e-0fb9-4996-bfb3-a797e6b42023 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:26.491214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bfa7e-0fb9-4996-bfb3-a797e6b42023 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:26.491834 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bfa7e-0fb9-4996-bfb3-a797e6b42023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:26.493756 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bfa7e-0fb9-4996-bfb3-a797e6b42023 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:26.507816 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 174/371] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:26.509157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bfa7e-0fb9-4996-bfb3-a797e6b42023 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:26.550007 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82834d-ae43-49a1-b7d0-cee55b75a087 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:26.580795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:26.595950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b291c50-6a28-4ec6-91ac-7c38fc624789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:26.596676 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b291c50-6a28-4ec6-91ac-7c38fc624789 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:26.597058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b291c50-6a28-4ec6-91ac-7c38fc624789 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:26.597432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b291c50-6a28-4ec6-91ac-7c38fc624789 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:26.598900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b291c50-6a28-4ec6-91ac-7c38fc624789 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:26.599614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:26.601419 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b291c50-6a28-4ec6-91ac-7c38fc624789 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:26.609615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 198/372] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:26 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:26.610906 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b291c50-6a28-4ec6-91ac-7c38fc624789 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:26.652397 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bfa7e-0fb9-4996-bfb3-a797e6b42023 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:26.711104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb9240-f52c-432b-bf21-b831b3c98177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:26.711874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb9240-f52c-432b-bf21-b831b3c98177 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:26.712059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb9240-f52c-432b-bf21-b831b3c98177 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:26.712335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb9240-f52c-432b-bf21-b831b3c98177 None admin] PATH_INFO: `/v3/users/a84454d600cf46bea7ab3e62947a1f1a` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:26.715038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb9240-f52c-432b-bf21-b831b3c98177 None admin] RBAC: Authorizing `identity:get_user(user_id=a84454d600cf46bea7ab3e62947a1f1a)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:26.717541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb9240-f52c-432b-bf21-b831b3c98177 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:26.719272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 175/373] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:12:26 2022] GET /identity/v3/users/a84454d600cf46bea7ab3e62947a1f1a => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:26.721261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb9240-f52c-432b-bf21-b831b3c98177 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:26.745735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b291c50-6a28-4ec6-91ac-7c38fc624789 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:26.799880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e8a90-4ee6-45c8-bb0c-9afb7032ad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:26.800656 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e8a90-4ee6-45c8-bb0c-9afb7032ad38 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:26.801038 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e8a90-4ee6-45c8-bb0c-9afb7032ad38 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:26.801453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e8a90-4ee6-45c8-bb0c-9afb7032ad38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:26.868051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:26.878942 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e8a90-4ee6-45c8-bb0c-9afb7032ad38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:26.880545 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e8a90-4ee6-45c8-bb0c-9afb7032ad38 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:26.918145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb9240-f52c-432b-bf21-b831b3c98177 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:26.990987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 199/374] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:26.991903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e8a90-4ee6-45c8-bb0c-9afb7032ad38 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:26.995133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:27.004318 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e5230-7700-4a59-a5a4-d66cf62108cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:27.005623 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e5230-7700-4a59-a5a4-d66cf62108cb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:27.005958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e5230-7700-4a59-a5a4-d66cf62108cb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:27.006248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e5230-7700-4a59-a5a4-d66cf62108cb None admin] PATH_INFO: `/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:27.007577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e5230-7700-4a59-a5a4-d66cf62108cb None admin] RBAC: Authorizing `identity:get_group(group_id=9d3a54e026b64d73baa7a90e60cc6f3a)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:27.009338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e5230-7700-4a59-a5a4-d66cf62108cb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:27.015503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 176/375] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:26 2022] GET /identity/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:27.016499 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e5230-7700-4a59-a5a4-d66cf62108cb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:27.155871 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e5230-7700-4a59-a5a4-d66cf62108cb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:27.183510 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:27.194221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62038d-5449-471b-b69e-d2f517e62626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:27.195167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62038d-5449-471b-b69e-d2f517e62626 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:27.195275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e8a90-4ee6-45c8-bb0c-9afb7032ad38 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:27.195753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62038d-5449-471b-b69e-d2f517e62626 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:27.196225 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62038d-5449-471b-b69e-d2f517e62626 None admin] PATH_INFO: `/v3/projects/0bdfa7558ab048ecad90e7cc85494da9` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:27.197895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62038d-5449-471b-b69e-d2f517e62626 None admin] RBAC: Authorizing `identity:get_project(project_id=0bdfa7558ab048ecad90e7cc85494da9)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:27.199558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62038d-5449-471b-b69e-d2f517e62626 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:27.202879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 177/376] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:27 2022] GET /identity/v3/projects/0bdfa7558ab048ecad90e7cc85494da9 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:27.203953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62038d-5449-471b-b69e-d2f517e62626 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:27.245621 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98a8b6-5e58-4f28-a7a4-8ad46879956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:27.246607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98a8b6-5e58-4f28-a7a4-8ad46879956f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:27.246892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98a8b6-5e58-4f28-a7a4-8ad46879956f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:27.247164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98a8b6-5e58-4f28-a7a4-8ad46879956f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:27.248240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98a8b6-5e58-4f28-a7a4-8ad46879956f None admin] RBAC: Adding query filter params (role.id=fdbe1fc69914484591390937886dfbfa, user.id=a84454d600cf46bea7ab3e62947a1f1a, scope.system=all) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:27.248552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98a8b6-5e58-4f28-a7a4-8ad46879956f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:27.250012 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98a8b6-5e58-4f28-a7a4-8ad46879956f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:27.267452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 200/377] 10.222.0.27 () {56 vars in 1308 bytes} [Thu Aug 4 22:12:26 2022] GET /identity/v3/role_assignments?user.id=a84454d600cf46bea7ab3e62947a1f1a&scope.system=all&role.id=fdbe1fc69914484591390937886dfbfa => generated 510 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:27.268943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda2ab3-4ee5-4475-8e35-94d59ceaa0cd None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:27.269235 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda2ab3-4ee5-4475-8e35-94d59ceaa0cd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:27.269512 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda2ab3-4ee5-4475-8e35-94d59ceaa0cd None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:27.271583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 201/378] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:27.272290 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda2ab3-4ee5-4475-8e35-94d59ceaa0cd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:27.319349 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:27.375497 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62038d-5449-471b-b69e-d2f517e62626 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:27.427074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7288789-ce28-4c16-9862-55b126c575f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:27.427941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7288789-ce28-4c16-9862-55b126c575f4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:27.428872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7288789-ce28-4c16-9862-55b126c575f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:27.429533 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7288789-ce28-4c16-9862-55b126c575f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:27.431096 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7288789-ce28-4c16-9862-55b126c575f4 None admin] RBAC: Adding query filter params (group.id=9d3a54e026b64d73baa7a90e60cc6f3a, role.id=b371b8f12e7348e8b01784eeddeca2ac, scope.project.id=a33fb2c471ff405e8562d6379c3558bd) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:27.431698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7288789-ce28-4c16-9862-55b126c575f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:27.433768 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7288789-ce28-4c16-9862-55b126c575f4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:27.442291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 178/379] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 4 22:12:27 2022] GET /identity/v3/role_assignments?group.id=9d3a54e026b64d73baa7a90e60cc6f3a&scope.project.id=a33fb2c471ff405e8562d6379c3558bd&role.id=b371b8f12e7348e8b01784eeddeca2ac => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:27.445829 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6e687-4b32-4ef6-a4ab-4235b19c03c0 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:27.446110 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6e687-4b32-4ef6-a4ab-4235b19c03c0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:27.446378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6e687-4b32-4ef6-a4ab-4235b19c03c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:27.453081 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda2ab3-4ee5-4475-8e35-94d59ceaa0cd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:27.479884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5ff6e687-4b32-4ef6-a4ab-4235b19c03c0 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:27.481658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5ff6e687-4b32-4ef6-a4ab-4235b19c03c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:27.509998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b4af3-3869-4b33-96d2-f2f1bca35503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:27.510701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b4af3-3869-4b33-96d2-f2f1bca35503 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:27.510982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b4af3-3869-4b33-96d2-f2f1bca35503 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:27.511257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b4af3-3869-4b33-96d2-f2f1bca35503 None admin] PATH_INFO: `/v3/groups/61c15b18c38746a6ae53e5426d7070a9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:27.519169 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b4af3-3869-4b33-96d2-f2f1bca35503 None admin] RBAC: Authorizing `identity:get_group(group_id=61c15b18c38746a6ae53e5426d7070a9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:27.520707 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b4af3-3869-4b33-96d2-f2f1bca35503 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:27.523391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 202/380] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:27 2022] GET /identity/v3/groups/61c15b18c38746a6ae53e5426d7070a9 => generated 229 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:27.529361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b4af3-3869-4b33-96d2-f2f1bca35503 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:27.566015 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:27.615574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 179/381] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:27.653711 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6e687-4b32-4ef6-a4ab-4235b19c03c0 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:27.699973 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b4af3-3869-4b33-96d2-f2f1bca35503 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:27.739025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:27.757297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6165a36-37f2-415c-af38-d16777933b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:27.757955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6165a36-37f2-415c-af38-d16777933b5b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:27.758198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6165a36-37f2-415c-af38-d16777933b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:27.758504 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6165a36-37f2-415c-af38-d16777933b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:27.759300 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6165a36-37f2-415c-af38-d16777933b5b None admin] RBAC: Adding query filter params (group.id=61c15b18c38746a6ae53e5426d7070a9, role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=0bdfa7558ab048ecad90e7cc85494da9) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:27.759607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6165a36-37f2-415c-af38-d16777933b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:27.761041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6165a36-37f2-415c-af38-d16777933b5b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:27.768667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 203/382] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 4 22:12:27 2022] GET /identity/v3/role_assignments?group.id=61c15b18c38746a6ae53e5426d7070a9&scope.project.id=0bdfa7558ab048ecad90e7cc85494da9&role.id=0053c24ce06147938dbb61657a531c94 => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:27.808263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6e687-4b32-4ef6-a4ab-4235b19c03c0 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:27.852024 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3049c36-0eef-47e9-9c11-e757349f8541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:27.852681 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3049c36-0eef-47e9-9c11-e757349f8541 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:27.852967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3049c36-0eef-47e9-9c11-e757349f8541 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:27.853243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3049c36-0eef-47e9-9c11-e757349f8541 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:27.865071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3049c36-0eef-47e9-9c11-e757349f8541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-c3049c36-0eef-47e9-9c11-e757349f8541 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:27.873699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:27.874664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:27.875454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:27.875454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:27.875454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:27.875454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:27.875454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:27.875454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:27.875454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:27.875454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:27.875454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:27.875454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:27.875454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:27.875454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:27.875454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 180/383] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:12:27.883359 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6165a36-37f2-415c-af38-d16777933b5b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:28.010946 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:28.034860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6165a36-37f2-415c-af38-d16777933b5b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:28.071491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f3190-9c56-4fcd-8d68-9ebcd5540d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:28.072133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3190-9c56-4fcd-8d68-9ebcd5540d19 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:28.072414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3190-9c56-4fcd-8d68-9ebcd5540d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:28.072690 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3190-9c56-4fcd-8d68-9ebcd5540d19 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:28.073434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f3190-9c56-4fcd-8d68-9ebcd5540d19 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:28.073743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f3190-9c56-4fcd-8d68-9ebcd5540d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:28.075208 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f3190-9c56-4fcd-8d68-9ebcd5540d19 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:28.086393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 204/384] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:28.092327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3049c36-0eef-47e9-9c11-e757349f8541 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:28.237903 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3049c36-0eef-47e9-9c11-e757349f8541 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:28.263457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:28.278204 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bad55-d07a-4fde-9dc5-f6df1f838572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:28.279292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bad55-d07a-4fde-9dc5-f6df1f838572 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:28.279785 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bad55-d07a-4fde-9dc5-f6df1f838572 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:28.280301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bad55-d07a-4fde-9dc5-f6df1f838572 None admin] PATH_INFO: `/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:28.281695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bad55-d07a-4fde-9dc5-f6df1f838572 None admin] RBAC: Authorizing `identity:get_group(group_id=9d3a54e026b64d73baa7a90e60cc6f3a)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:28.283374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bad55-d07a-4fde-9dc5-f6df1f838572 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:28.285511 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 181/385] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:28 2022] GET /identity/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:28.290929 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f3190-9c56-4fcd-8d68-9ebcd5540d19 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:28.415048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f3190-9c56-4fcd-8d68-9ebcd5540d19 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:28.453794 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12075d5c-ae21-49ff-846d-0be1c8db252e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:28.454477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12075d5c-ae21-49ff-846d-0be1c8db252e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:28.454767 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12075d5c-ae21-49ff-846d-0be1c8db252e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:28.455049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12075d5c-ae21-49ff-846d-0be1c8db252e None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:28.459705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12075d5c-ae21-49ff-846d-0be1c8db252e None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:28.461196 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12075d5c-ae21-49ff-846d-0be1c8db252e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:28.463310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 205/386] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:28 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:28.475521 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bad55-d07a-4fde-9dc5-f6df1f838572 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:28.522397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7ac90-76fb-4f83-9ff7-346a07ed671d None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:28.522735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7ac90-76fb-4f83-9ff7-346a07ed671d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:28.522939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7ac90-76fb-4f83-9ff7-346a07ed671d None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:28.524513 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 206/387] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:12:28.529557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661f1ee-a7d8-4f9e-bae2-07d8faaf777a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:28.529849 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661f1ee-a7d8-4f9e-bae2-07d8faaf777a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:28.530129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661f1ee-a7d8-4f9e-bae2-07d8faaf777a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:28.563522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6661f1ee-a7d8-4f9e-bae2-07d8faaf777a None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:28.566626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6661f1ee-a7d8-4f9e-bae2-07d8faaf777a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:28.571621 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:28.630499 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bad55-d07a-4fde-9dc5-f6df1f838572 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:28.691541 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 207/388] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:28.709378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1561ec-b98d-4ec1-a4e0-f44b02fdf6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:28.710071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1561ec-b98d-4ec1-a4e0-f44b02fdf6ec None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:28.710366 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1561ec-b98d-4ec1-a4e0-f44b02fdf6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:28.710671 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1561ec-b98d-4ec1-a4e0-f44b02fdf6ec None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637/groups/9d3a54e026b64d73baa7a90e60cc6f3a/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:28.714906 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1561ec-b98d-4ec1-a4e0-f44b02fdf6ec None admin] RBAC: Authorizing `identity:create_grant(project_id=7bd58a62525c46c888f56577918c1637, group_id=9d3a54e026b64d73baa7a90e60cc6f3a, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:28.715271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661f1ee-a7d8-4f9e-bae2-07d8faaf777a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:28.716366 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1561ec-b98d-4ec1-a4e0-f44b02fdf6ec None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:28.733267 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 182/389] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Aug 4 22:12:28 2022] PUT /identity/v3/projects/7bd58a62525c46c888f56577918c1637/groups/9d3a54e026b64d73baa7a90e60cc6f3a/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:12:28.839136 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661f1ee-a7d8-4f9e-bae2-07d8faaf777a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:28.879158 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950847f-4f24-4c99-8605-e1368f72d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:28.879819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950847f-4f24-4c99-8605-e1368f72d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:28.880102 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950847f-4f24-4c99-8605-e1368f72d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:28.880377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950847f-4f24-4c99-8605-e1368f72d2b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:28.888556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:28.893196 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950847f-4f24-4c99-8605-e1368f72d2b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-4950847f-4f24-4c99-8605-e1368f72d2b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:28.900289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:28.901172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:28.901980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:28.901980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:28.901980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:28.901980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:28.901980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:28.901980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:28.901980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:28.901980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:28.901980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:28.901980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:28.901980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:28.901980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:28.901980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 208/390] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:12:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:12:28.907886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1561ec-b98d-4ec1-a4e0-f44b02fdf6ec None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:28.965277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:29.023521 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1561ec-b98d-4ec1-a4e0-f44b02fdf6ec None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:29.062435 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a959aee-118a-4803-a512-f07b18b798f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:29.063073 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a959aee-118a-4803-a512-f07b18b798f2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:29.063356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a959aee-118a-4803-a512-f07b18b798f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:29.063633 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a959aee-118a-4803-a512-f07b18b798f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:29.064354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a959aee-118a-4803-a512-f07b18b798f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:29.064660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a959aee-118a-4803-a512-f07b18b798f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:29.066053 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a959aee-118a-4803-a512-f07b18b798f2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:29.074909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 183/391] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:29.080818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950847f-4f24-4c99-8605-e1368f72d2b2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:29.192955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950847f-4f24-4c99-8605-e1368f72d2b2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:29.229276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477e12a-9c95-4a03-a6b0-c626da16da78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:29.229927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477e12a-9c95-4a03-a6b0-c626da16da78 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:29.230213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477e12a-9c95-4a03-a6b0-c626da16da78 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:29.230519 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477e12a-9c95-4a03-a6b0-c626da16da78 None admin] PATH_INFO: `/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:29.231692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477e12a-9c95-4a03-a6b0-c626da16da78 None admin] RBAC: Authorizing `identity:get_group(group_id=9d3a54e026b64d73baa7a90e60cc6f3a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:29.233154 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477e12a-9c95-4a03-a6b0-c626da16da78 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:29.238536 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 209/392] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:29 2022] GET /identity/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:29.240772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a959aee-118a-4803-a512-f07b18b798f2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:29.289146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8510e-a2f8-4349-bf1e-e91b01d8c9b9 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:29.289739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8510e-a2f8-4349-bf1e-e91b01d8c9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:29.290026 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8510e-a2f8-4349-bf1e-e91b01d8c9b9 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:29.291934 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 210/393] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:29.298518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7ee81-b630-42cd-92b2-8831c8b3b73d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:29.298811 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7ee81-b630-42cd-92b2-8831c8b3b73d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:29.299097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7ee81-b630-42cd-92b2-8831c8b3b73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:29.335016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-50e7ee81-b630-42cd-92b2-8831c8b3b73d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:29.336227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-50e7ee81-b630-42cd-92b2-8831c8b3b73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:29.390100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a959aee-118a-4803-a512-f07b18b798f2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:29.414839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:29.429388 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:29.445349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 211/394] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:29.454133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169cd1-8bc5-4322-84f5-2982a732f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:29.455150 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169cd1-8bc5-4322-84f5-2982a732f329 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:29.455639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169cd1-8bc5-4322-84f5-2982a732f329 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:29.456127 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169cd1-8bc5-4322-84f5-2982a732f329 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:29.460851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f169cd1-8bc5-4322-84f5-2982a732f329 None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:29.462558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f169cd1-8bc5-4322-84f5-2982a732f329 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:29.464450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 184/395] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:29 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:29.470582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7ee81-b630-42cd-92b2-8831c8b3b73d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:29.485510 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169cd1-8bc5-4322-84f5-2982a732f329 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:29.613779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7ee81-b630-42cd-92b2-8831c8b3b73d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:29.656534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ab924-7c0d-4d4e-aec9-5d7383ec99b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:29.658264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ab924-7c0d-4d4e-aec9-5d7383ec99b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:29.660452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ab924-7c0d-4d4e-aec9-5d7383ec99b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:29.661115 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ab924-7c0d-4d4e-aec9-5d7383ec99b5 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637/groups/9d3a54e026b64d73baa7a90e60cc6f3a/roles/b371b8f12e7348e8b01784eeddeca2ac` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:29.663254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169cd1-8bc5-4322-84f5-2982a732f329 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:29.668011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ab924-7c0d-4d4e-aec9-5d7383ec99b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bd58a62525c46c888f56577918c1637, group_id=9d3a54e026b64d73baa7a90e60cc6f3a, role_id=b371b8f12e7348e8b01784eeddeca2ac)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:29.669704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ab924-7c0d-4d4e-aec9-5d7383ec99b5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:29.704162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 212/396] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Aug 4 22:12:29 2022] PUT /identity/v3/projects/7bd58a62525c46c888f56577918c1637/groups/9d3a54e026b64d73baa7a90e60cc6f3a/roles/b371b8f12e7348e8b01784eeddeca2ac => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:12:29.714458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12756db5-7a07-4fa5-a7c8-7467f4198da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:29.715130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12756db5-7a07-4fa5-a7c8-7467f4198da6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:29.715408 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12756db5-7a07-4fa5-a7c8-7467f4198da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:29.715678 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12756db5-7a07-4fa5-a7c8-7467f4198da6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:29.728197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12756db5-7a07-4fa5-a7c8-7467f4198da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-12756db5-7a07-4fa5-a7c8-7467f4198da6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:29.733689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:29.734656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:29.735492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:29.735492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:29.735492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:29.735492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:29.735492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:29.735492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:29.735492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:29.735492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:29.735492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:29.735492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:29.735492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:29.735492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:29.735492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 185/397] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:29.743051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ab924-7c0d-4d4e-aec9-5d7383ec99b5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:29.837476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:29.901126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ab924-7c0d-4d4e-aec9-5d7383ec99b5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:29.955030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952f2bf-e108-4d6f-a0d2-0e63aa35a9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:29.955646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952f2bf-e108-4d6f-a0d2-0e63aa35a9ea None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:29.955870 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952f2bf-e108-4d6f-a0d2-0e63aa35a9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:29.956146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952f2bf-e108-4d6f-a0d2-0e63aa35a9ea None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:29.956874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952f2bf-e108-4d6f-a0d2-0e63aa35a9ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:29.957184 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952f2bf-e108-4d6f-a0d2-0e63aa35a9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:29.958611 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952f2bf-e108-4d6f-a0d2-0e63aa35a9ea None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:29.968696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 213/398] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:29.974359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12756db5-7a07-4fa5-a7c8-7467f4198da6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:30.027006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:30.107934 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12756db5-7a07-4fa5-a7c8-7467f4198da6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:30.152028 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459caef-d89a-4477-b906-21539d36791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:30.152746 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459caef-d89a-4477-b906-21539d36791d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:30.153033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459caef-d89a-4477-b906-21539d36791d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:30.153666 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459caef-d89a-4477-b906-21539d36791d None admin] PATH_INFO: `/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:30.154517 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459caef-d89a-4477-b906-21539d36791d None admin] RBAC: Authorizing `identity:get_group(group_id=9d3a54e026b64d73baa7a90e60cc6f3a)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:30.156398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459caef-d89a-4477-b906-21539d36791d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:30.157867 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 186/399] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:29 2022] GET /identity/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:30.163683 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952f2bf-e108-4d6f-a0d2-0e63aa35a9ea None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:30.237693 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256acd18-9f14-4d6a-89b4-16d376cda264 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:30.238012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256acd18-9f14-4d6a-89b4-16d376cda264 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:30.238181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256acd18-9f14-4d6a-89b4-16d376cda264 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:30.239776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 187/400] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:30.252051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24a1d-712e-48eb-8397-f4b0f2e25867 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:30.252703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24a1d-712e-48eb-8397-f4b0f2e25867 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:30.253196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24a1d-712e-48eb-8397-f4b0f2e25867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:30.291446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-3de24a1d-712e-48eb-8397-f4b0f2e25867 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:30.292902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3de24a1d-712e-48eb-8397-f4b0f2e25867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:30.306108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952f2bf-e108-4d6f-a0d2-0e63aa35a9ea None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:30.327071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:30.346488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e4e7f-3e4a-43a3-a0e3-334462bad1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:30.347232 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e4e7f-3e4a-43a3-a0e3-334462bad1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:30.347521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e4e7f-3e4a-43a3-a0e3-334462bad1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:30.347798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e4e7f-3e4a-43a3-a0e3-334462bad1e1 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:30.348995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e4e7f-3e4a-43a3-a0e3-334462bad1e1 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:30.351028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e4e7f-3e4a-43a3-a0e3-334462bad1e1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:30.353256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 214/401] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:30 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:30.361227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e4e7f-3e4a-43a3-a0e3-334462bad1e1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:30.412889 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 188/402] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:30.437522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24a1d-712e-48eb-8397-f4b0f2e25867 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:30.514843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:30.542357 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e4e7f-3e4a-43a3-a0e3-334462bad1e1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:30.583314 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46e8ed-36bb-4293-9039-497e50faa91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:30.584022 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e8ed-36bb-4293-9039-497e50faa91c None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:30.584305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e8ed-36bb-4293-9039-497e50faa91c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:30.584576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46e8ed-36bb-4293-9039-497e50faa91c None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd/groups/9d3a54e026b64d73baa7a90e60cc6f3a/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:30.592431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46e8ed-36bb-4293-9039-497e50faa91c None admin] RBAC: Authorizing `identity:create_grant(project_id=a33fb2c471ff405e8562d6379c3558bd, group_id=9d3a54e026b64d73baa7a90e60cc6f3a, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:30.593929 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46e8ed-36bb-4293-9039-497e50faa91c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:30.625546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 215/403] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Aug 4 22:12:30 2022] PUT /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd/groups/9d3a54e026b64d73baa7a90e60cc6f3a/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:12:30.634698 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c1cd4-65f8-4192-99e5-9bf2cebb0001 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:30.635008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c1cd4-65f8-4192-99e5-9bf2cebb0001 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:30.635730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c1cd4-65f8-4192-99e5-9bf2cebb0001 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:30.637566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 216/404] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:30.645190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98db08-2dba-4d51-a2ba-0df91f38dd39 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:30.645524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98db08-2dba-4d51-a2ba-0df91f38dd39 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:30.645742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98db08-2dba-4d51-a2ba-0df91f38dd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:30.646054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24a1d-712e-48eb-8397-f4b0f2e25867 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:30.678513 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5f98db08-2dba-4d51-a2ba-0df91f38dd39 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:30.681487 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5f98db08-2dba-4d51-a2ba-0df91f38dd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:30.720958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d11f14-9c27-4269-8f57-259d34f242be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:30.721628 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d11f14-9c27-4269-8f57-259d34f242be None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:30.721914 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d11f14-9c27-4269-8f57-259d34f242be None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:30.722189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d11f14-9c27-4269-8f57-259d34f242be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:30.747689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d11f14-9c27-4269-8f57-259d34f242be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-91d11f14-9c27-4269-8f57-259d34f242be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:30.753894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:30.754833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:30.756205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:30.756205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:30.756205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:30.756205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:30.756205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:30.756205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:30.756205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:30.756205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:30.756205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:30.756205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:30.756205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:30.756205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:30.756205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 189/405] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:12:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:12:30.761950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d11f14-9c27-4269-8f57-259d34f242be None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:30.776622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:30.815874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 217/406] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:30.857065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98db08-2dba-4d51-a2ba-0df91f38dd39 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:30.904343 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:30.909967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d11f14-9c27-4269-8f57-259d34f242be None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:30.954549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83417a9f-7e60-47df-b615-d01f700700b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:30.955180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83417a9f-7e60-47df-b615-d01f700700b4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:30.955508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83417a9f-7e60-47df-b615-d01f700700b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:30.956149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83417a9f-7e60-47df-b615-d01f700700b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:30.956872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83417a9f-7e60-47df-b615-d01f700700b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:30.957495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83417a9f-7e60-47df-b615-d01f700700b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:30.959728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83417a9f-7e60-47df-b615-d01f700700b4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:30.970598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 190/407] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:30.977565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83417a9f-7e60-47df-b615-d01f700700b4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:30.995406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98db08-2dba-4d51-a2ba-0df91f38dd39 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:31.032664 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ee75b-af9e-4ada-812b-57f1c85d5a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:31.033239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ee75b-af9e-4ada-812b-57f1c85d5a9a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:31.033523 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ee75b-af9e-4ada-812b-57f1c85d5a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:31.033801 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ee75b-af9e-4ada-812b-57f1c85d5a9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:31.046961 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ee75b-af9e-4ada-812b-57f1c85d5a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2a9ee75b-af9e-4ada-812b-57f1c85d5a9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:31.052186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:31.053135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:31.058877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:31.058877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:31.058877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:31.058877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:31.058877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:31.058877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:31.058877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:31.058877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:31.058877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:31.058877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:31.058877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:12:31.058877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:31.058877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 218/408] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:12:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:31.059570 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ee75b-af9e-4ada-812b-57f1c85d5a9a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:31.121305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:31.191370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83417a9f-7e60-47df-b615-d01f700700b4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:31.194457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ee75b-af9e-4ada-812b-57f1c85d5a9a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:31.227811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365121f0-bff6-45dc-b1bb-905c234602a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:31.228459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365121f0-bff6-45dc-b1bb-905c234602a7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:31.228737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365121f0-bff6-45dc-b1bb-905c234602a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:31.229006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365121f0-bff6-45dc-b1bb-905c234602a7 None admin] PATH_INFO: `/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:31.230147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365121f0-bff6-45dc-b1bb-905c234602a7 None admin] RBAC: Authorizing `identity:get_group(group_id=9d3a54e026b64d73baa7a90e60cc6f3a)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:31.231614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365121f0-bff6-45dc-b1bb-905c234602a7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:31.233499 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 191/409] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:30 2022] GET /identity/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:31.239705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365121f0-bff6-45dc-b1bb-905c234602a7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:31.266377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f85e3-97f7-45df-9f01-6902bbea77ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:31.267028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f85e3-97f7-45df-9f01-6902bbea77ab None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:31.268142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f85e3-97f7-45df-9f01-6902bbea77ab None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:31.269730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f85e3-97f7-45df-9f01-6902bbea77ab None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:31.270484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f85e3-97f7-45df-9f01-6902bbea77ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:31.270800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f85e3-97f7-45df-9f01-6902bbea77ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:31.272998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f85e3-97f7-45df-9f01-6902bbea77ab None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:31.291410 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:31.292319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 219/410] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:31.297202 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f85e3-97f7-45df-9f01-6902bbea77ab None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:31.415098 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365121f0-bff6-45dc-b1bb-905c234602a7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:31.487037 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9976ee9-bfb9-450f-8508-228373eae376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:31.487684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9976ee9-bfb9-450f-8508-228373eae376 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:31.487962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9976ee9-bfb9-450f-8508-228373eae376 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:31.488231 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9976ee9-bfb9-450f-8508-228373eae376 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:31.490079 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9976ee9-bfb9-450f-8508-228373eae376 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:31.492076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9976ee9-bfb9-450f-8508-228373eae376 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:31.495917 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 192/411] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:31 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:31.502053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f85e3-97f7-45df-9f01-6902bbea77ab None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:31.503782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:31.504218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9976ee9-bfb9-450f-8508-228373eae376 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:31.544120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d4cf3-e3e1-4a83-b06c-2bc4c7a00730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:31.544992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d4cf3-e3e1-4a83-b06c-2bc4c7a00730 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:31.545441 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d4cf3-e3e1-4a83-b06c-2bc4c7a00730 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:31.545874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d4cf3-e3e1-4a83-b06c-2bc4c7a00730 None admin] PATH_INFO: `/v3/groups/61c15b18c38746a6ae53e5426d7070a9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:31.547212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d4cf3-e3e1-4a83-b06c-2bc4c7a00730 None admin] RBAC: Authorizing `identity:get_group(group_id=61c15b18c38746a6ae53e5426d7070a9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:31.548811 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d4cf3-e3e1-4a83-b06c-2bc4c7a00730 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:31.550915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 220/412] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:31 2022] GET /identity/v3/groups/61c15b18c38746a6ae53e5426d7070a9 => generated 229 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:31.552273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea3a46-b066-43a4-9223-0ba961ea5eb3 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:31.553226 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea3a46-b066-43a4-9223-0ba961ea5eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:31.553650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea3a46-b066-43a4-9223-0ba961ea5eb3 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:31.555283 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 221/413] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:31.557935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea3a46-b066-43a4-9223-0ba961ea5eb3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:31.639853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:31.646507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9976ee9-bfb9-450f-8508-228373eae376 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:31.683200 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea3a46-b066-43a4-9223-0ba961ea5eb3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:31.683712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2304773-eeb8-4ad7-abcb-4341dbb3ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:31.684569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2304773-eeb8-4ad7-abcb-4341dbb3ede8 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:31.685110 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2304773-eeb8-4ad7-abcb-4341dbb3ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:31.685542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2304773-eeb8-4ad7-abcb-4341dbb3ede8 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd/groups/9d3a54e026b64d73baa7a90e60cc6f3a/roles/b371b8f12e7348e8b01784eeddeca2ac` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:31.688180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2304773-eeb8-4ad7-abcb-4341dbb3ede8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a33fb2c471ff405e8562d6379c3558bd, group_id=9d3a54e026b64d73baa7a90e60cc6f3a, role_id=b371b8f12e7348e8b01784eeddeca2ac)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:31.689778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2304773-eeb8-4ad7-abcb-4341dbb3ede8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:31.705538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 193/414] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Aug 4 22:12:31 2022] PUT /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd/groups/9d3a54e026b64d73baa7a90e60cc6f3a/roles/b371b8f12e7348e8b01784eeddeca2ac => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:12:31.707293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d061-ff11-4b4e-8682-080d711b1a15 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:31.707843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d061-ff11-4b4e-8682-080d711b1a15 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:31.708375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d061-ff11-4b4e-8682-080d711b1a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:31.721760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e98b9-c8f0-4fd6-b07d-61e18176baad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:31.722471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e98b9-c8f0-4fd6-b07d-61e18176baad None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:31.722794 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e98b9-c8f0-4fd6-b07d-61e18176baad None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:31.723065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e98b9-c8f0-4fd6-b07d-61e18176baad None admin] PATH_INFO: `/v3/projects/0bdfa7558ab048ecad90e7cc85494da9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:31.724645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e98b9-c8f0-4fd6-b07d-61e18176baad None admin] RBAC: Authorizing `identity:get_project(project_id=0bdfa7558ab048ecad90e7cc85494da9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:31.726090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e98b9-c8f0-4fd6-b07d-61e18176baad None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:31.728277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 222/415] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:31 2022] GET /identity/v3/projects/0bdfa7558ab048ecad90e7cc85494da9 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:31.730660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6c75d061-ff11-4b4e-8682-080d711b1a15 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:31.732137 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6c75d061-ff11-4b4e-8682-080d711b1a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:31.733984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e98b9-c8f0-4fd6-b07d-61e18176baad None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:31.773935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:31.812362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 194/416] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:31.851932 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e98b9-c8f0-4fd6-b07d-61e18176baad None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:31.855791 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75d061-ff11-4b4e-8682-080d711b1a15 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:31.894434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51ec6e-9887-4f97-85d1-9648eb461550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:31.894434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51ec6e-9887-4f97-85d1-9648eb461550 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:31.894434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51ec6e-9887-4f97-85d1-9648eb461550 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:31.894434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51ec6e-9887-4f97-85d1-9648eb461550 None admin] PATH_INFO: `/v3/projects/0bdfa7558ab048ecad90e7cc85494da9/groups/61c15b18c38746a6ae53e5426d7070a9/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:31.895470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51ec6e-9887-4f97-85d1-9648eb461550 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bdfa7558ab048ecad90e7cc85494da9, group_id=61c15b18c38746a6ae53e5426d7070a9, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:31.898087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51ec6e-9887-4f97-85d1-9648eb461550 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:31.922329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 223/417] 10.222.0.27 () {58 vars in 1442 bytes} [Thu Aug 4 22:12:31 2022] PUT /identity/v3/projects/0bdfa7558ab048ecad90e7cc85494da9/groups/61c15b18c38746a6ae53e5426d7070a9/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:12:32.003690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:32.025528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75d061-ff11-4b4e-8682-080d711b1a15 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:32.070694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70dbfa-abcf-4353-9166-90b6e947a169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:32.071274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70dbfa-abcf-4353-9166-90b6e947a169 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:32.071550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70dbfa-abcf-4353-9166-90b6e947a169 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:32.071886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70dbfa-abcf-4353-9166-90b6e947a169 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:32.087656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70dbfa-abcf-4353-9166-90b6e947a169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-2f70dbfa-abcf-4353-9166-90b6e947a169 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:32.092949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:32.093877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:32.095133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:32.095133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:32.095133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:32.095133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:32.095133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:32.095133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:32.095133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:32.095133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:32.095133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:32.095133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:32.095133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:32.095133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:32.095133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 195/418] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:12:32.100917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51ec6e-9887-4f97-85d1-9648eb461550 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:32.219236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:32.226376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51ec6e-9887-4f97-85d1-9648eb461550 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:32.263319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534b771-8842-4e82-ba88-8671059e440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:32.264057 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534b771-8842-4e82-ba88-8671059e440e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:32.264339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534b771-8842-4e82-ba88-8671059e440e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:32.264612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534b771-8842-4e82-ba88-8671059e440e None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:32.265328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534b771-8842-4e82-ba88-8671059e440e None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:32.265636 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534b771-8842-4e82-ba88-8671059e440e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:32.267049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534b771-8842-4e82-ba88-8671059e440e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:32.276326 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 224/419] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:32.281901 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70dbfa-abcf-4353-9166-90b6e947a169 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:32.364523 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa73bdb-6176-4d84-bd3a-06d580bd0d3b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:32.364712 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa73bdb-6176-4d84-bd3a-06d580bd0d3b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:32.364997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa73bdb-6176-4d84-bd3a-06d580bd0d3b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:32.367636 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 225/420] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:12:32.372591 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c111d-8a27-4f9f-82fa-d6a8891118e5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:32.372939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c111d-8a27-4f9f-82fa-d6a8891118e5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:32.373556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c111d-8a27-4f9f-82fa-d6a8891118e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:32.409695 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-572c111d-8a27-4f9f-82fa-d6a8891118e5 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:32.412660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-572c111d-8a27-4f9f-82fa-d6a8891118e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:32.457538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70dbfa-abcf-4353-9166-90b6e947a169 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:32.511957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176df3fb-834c-4236-80f8-20fb2a4b2ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:32.512647 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176df3fb-834c-4236-80f8-20fb2a4b2ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:32.512913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176df3fb-834c-4236-80f8-20fb2a4b2ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:32.513185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176df3fb-834c-4236-80f8-20fb2a4b2ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:32.531873 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:32.580776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 226/421] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:32.583755 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176df3fb-834c-4236-80f8-20fb2a4b2ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:32.585277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176df3fb-834c-4236-80f8-20fb2a4b2ae2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:32.631736 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c111d-8a27-4f9f-82fa-d6a8891118e5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:32.689287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 196/422] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:32.697760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176df3fb-834c-4236-80f8-20fb2a4b2ae2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:32.766785 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:32.838779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:32.847445 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176df3fb-834c-4236-80f8-20fb2a4b2ae2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:32.860826 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c111d-8a27-4f9f-82fa-d6a8891118e5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:32.914273 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1eb78-829f-4c02-bce0-e1e657d7f705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:32.914861 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1eb78-829f-4c02-bce0-e1e657d7f705 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:32.915138 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1eb78-829f-4c02-bce0-e1e657d7f705 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:32.915407 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1eb78-829f-4c02-bce0-e1e657d7f705 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:32.916657 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1eb78-829f-4c02-bce0-e1e657d7f705 None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:32.918733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1eb78-829f-4c02-bce0-e1e657d7f705 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:32.925684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 197/423] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:32 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:32.929011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991be9e-06a3-43c3-9b03-895a39f30e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:32.929890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991be9e-06a3-43c3-9b03-895a39f30e39 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:32.930931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991be9e-06a3-43c3-9b03-895a39f30e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:32.933976 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991be9e-06a3-43c3-9b03-895a39f30e39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:32.934087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1eb78-829f-4c02-bce0-e1e657d7f705 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:32.954318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991be9e-06a3-43c3-9b03-895a39f30e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-f991be9e-06a3-43c3-9b03-895a39f30e39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:32.959817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:32.960688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:32.961489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:32.961489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:32.961489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:32.961489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:32.961489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:32.961489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:32.961489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:32.961489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:32.961489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:32.961489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:32.961489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:32.961489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:32.972092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 227/424] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:12:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:32.973075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991be9e-06a3-43c3-9b03-895a39f30e39 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:33.066669 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1eb78-829f-4c02-bce0-e1e657d7f705 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:33.087618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:33.142184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d81421-2f09-4e6d-9ca8-4761b5648441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:33.143038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d81421-2f09-4e6d-9ca8-4761b5648441 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:33.143673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d81421-2f09-4e6d-9ca8-4761b5648441 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:33.143955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d81421-2f09-4e6d-9ca8-4761b5648441 None admin] PATH_INFO: `/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:33.145612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d81421-2f09-4e6d-9ca8-4761b5648441 None admin] RBAC: Authorizing `identity:get_group(group_id=9d3a54e026b64d73baa7a90e60cc6f3a)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:33.148252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d81421-2f09-4e6d-9ca8-4761b5648441 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:33.149538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991be9e-06a3-43c3-9b03-895a39f30e39 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:33.150204 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 198/425] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:32 2022] GET /identity/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:33.151681 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0055-309e-4532-bc26-aeaf760f735d None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:33.151970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0055-309e-4532-bc26-aeaf760f735d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:33.153097 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea0055-309e-4532-bc26-aeaf760f735d None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:33.154639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 199/426] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:33.155984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea0055-309e-4532-bc26-aeaf760f735d None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:33.189949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e211e2b-7734-4ae0-8fad-ba0153daeae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:33.190880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e211e2b-7734-4ae0-8fad-ba0153daeae2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:33.191459 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e211e2b-7734-4ae0-8fad-ba0153daeae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:33.191800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e211e2b-7734-4ae0-8fad-ba0153daeae2 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:33.192886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e211e2b-7734-4ae0-8fad-ba0153daeae2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:33.193626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e211e2b-7734-4ae0-8fad-ba0153daeae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:33.195507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e211e2b-7734-4ae0-8fad-ba0153daeae2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:33.205950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 228/427] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:33.207379 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e326558-b286-4bae-a4f8-311768e042c6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:33.207716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e326558-b286-4bae-a4f8-311768e042c6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:33.208041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e326558-b286-4bae-a4f8-311768e042c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:33.230758 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7e326558-b286-4bae-a4f8-311768e042c6 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:33.232325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7e326558-b286-4bae-a4f8-311768e042c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:33.241316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:33.280376 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea0055-309e-4532-bc26-aeaf760f735d None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:33.324571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 229/428] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:33.330447 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e326558-b286-4bae-a4f8-311768e042c6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:33.331087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faab17-e1d9-418b-8e8f-68865ed82bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:33.332541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faab17-e1d9-418b-8e8f-68865ed82bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:33.333388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faab17-e1d9-418b-8e8f-68865ed82bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:33.333875 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faab17-e1d9-418b-8e8f-68865ed82bd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:33.339039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45faab17-e1d9-418b-8e8f-68865ed82bd1 None admin] RBAC: Adding query filter params (group.id=9d3a54e026b64d73baa7a90e60cc6f3a, role.id=d295e312e144479ca8f748650ac995a4, scope.project.id=7bd58a62525c46c888f56577918c1637) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:33.339558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45faab17-e1d9-418b-8e8f-68865ed82bd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:33.341209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45faab17-e1d9-418b-8e8f-68865ed82bd1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:33.352142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 200/429] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 4 22:12:33 2022] GET /identity/v3/role_assignments?group.id=9d3a54e026b64d73baa7a90e60cc6f3a&scope.project.id=7bd58a62525c46c888f56577918c1637&role.id=d295e312e144479ca8f748650ac995a4 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:33.354547 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faab17-e1d9-418b-8e8f-68865ed82bd1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:33.426971 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:33.474608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e326558-b286-4bae-a4f8-311768e042c6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:33.506690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faab17-e1d9-418b-8e8f-68865ed82bd1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:33.538796 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0ee96-dceb-4c05-be66-4d031008ba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:33.539439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ee96-dceb-4c05-be66-4d031008ba93 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:33.539718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ee96-dceb-4c05-be66-4d031008ba93 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:33.539992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ee96-dceb-4c05-be66-4d031008ba93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:33.558701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:33.571844 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134a022-238c-4d92-9982-6563322a656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:33.572520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134a022-238c-4d92-9982-6563322a656b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:33.572802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134a022-238c-4d92-9982-6563322a656b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:33.573078 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134a022-238c-4d92-9982-6563322a656b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:33.596358 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134a022-238c-4d92-9982-6563322a656b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a134a022-238c-4d92-9982-6563322a656b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:33.602508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:33.603383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:33.604181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:33.604181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:33.604181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:33.604181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:33.604181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:33.604181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:33.604181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:33.604181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:33.604181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:33.604181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:33.604181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 04 22:12:33.604181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:33.604181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 201/430] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:33.610535 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134a022-238c-4d92-9982-6563322a656b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:33.659974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0ee96-dceb-4c05-be66-4d031008ba93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:33.661855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0ee96-dceb-4c05-be66-4d031008ba93 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:33.724439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134a022-238c-4d92-9982-6563322a656b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:33.733341 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:33.769637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99e44e-2c54-4db1-939d-fb0b1bb63a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:33.770366 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99e44e-2c54-4db1-939d-fb0b1bb63a32 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:33.770754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99e44e-2c54-4db1-939d-fb0b1bb63a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:33.771096 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99e44e-2c54-4db1-939d-fb0b1bb63a32 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:33.772098 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99e44e-2c54-4db1-939d-fb0b1bb63a32 None admin] RBAC: Adding query filter params (name=member) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:33.772475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99e44e-2c54-4db1-939d-fb0b1bb63a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:33.774680 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99e44e-2c54-4db1-939d-fb0b1bb63a32 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:33.784214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 230/431] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:33.788081 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 202/432] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:12:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:33.789825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0ee96-dceb-4c05-be66-4d031008ba93 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:33.794828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99e44e-2c54-4db1-939d-fb0b1bb63a32 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:33.839597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:33.915840 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0ee96-dceb-4c05-be66-4d031008ba93 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:33.921048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99e44e-2c54-4db1-939d-fb0b1bb63a32 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:33.957940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f14ab6-adfe-42e0-af96-bc66cbd08ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:33.959031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f14ab6-adfe-42e0-af96-bc66cbd08ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:33.959516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f14ab6-adfe-42e0-af96-bc66cbd08ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:33.960101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f14ab6-adfe-42e0-af96-bc66cbd08ff3 None admin] PATH_INFO: `/v3/projects/7bd58a62525c46c888f56577918c1637` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:33.961592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f14ab6-adfe-42e0-af96-bc66cbd08ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=7bd58a62525c46c888f56577918c1637)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:33.963323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f14ab6-adfe-42e0-af96-bc66cbd08ff3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:33.965518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 231/433] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:33 2022] GET /identity/v3/projects/7bd58a62525c46c888f56577918c1637 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:33.970645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f14ab6-adfe-42e0-af96-bc66cbd08ff3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:33.972608 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa1718-b3ea-4d13-bb30-795ee4b86768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:33.973252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa1718-b3ea-4d13-bb30-795ee4b86768 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:33.973532 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa1718-b3ea-4d13-bb30-795ee4b86768 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:33.973807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa1718-b3ea-4d13-bb30-795ee4b86768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:34.023597 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:34.065180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa1718-b3ea-4d13-bb30-795ee4b86768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:34.067096 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa1718-b3ea-4d13-bb30-795ee4b86768 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:34.121439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f14ab6-adfe-42e0-af96-bc66cbd08ff3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:34.132034 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:34.167177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcb5c7-da08-47e7-b3a3-c21eb35d3672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:34.167800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb5c7-da08-47e7-b3a3-c21eb35d3672 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:34.168033 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb5c7-da08-47e7-b3a3-c21eb35d3672 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:34.168263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb5c7-da08-47e7-b3a3-c21eb35d3672 None admin] PATH_INFO: `/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:34.169604 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcb5c7-da08-47e7-b3a3-c21eb35d3672 None admin] RBAC: Authorizing `identity:get_group(group_id=9d3a54e026b64d73baa7a90e60cc6f3a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:34.170981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcb5c7-da08-47e7-b3a3-c21eb35d3672 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:34.177511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 232/434] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:33 2022] GET /identity/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:34.179281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcb5c7-da08-47e7-b3a3-c21eb35d3672 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:34.190914 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 203/435] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 22:12:34.196242 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa1718-b3ea-4d13-bb30-795ee4b86768 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:34.274333 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:34.298263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcb5c7-da08-47e7-b3a3-c21eb35d3672 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:34.311855 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa1718-b3ea-4d13-bb30-795ee4b86768 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:34.335833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccd6d7-acc8-4eb9-957e-7c88188f7430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:34.336459 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccd6d7-acc8-4eb9-957e-7c88188f7430 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:34.336743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccd6d7-acc8-4eb9-957e-7c88188f7430 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:34.337012 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccd6d7-acc8-4eb9-957e-7c88188f7430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:34.337957 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccd6d7-acc8-4eb9-957e-7c88188f7430 None admin] RBAC: Adding query filter params (group.id=9d3a54e026b64d73baa7a90e60cc6f3a, role.id=b371b8f12e7348e8b01784eeddeca2ac, scope.project.id=7bd58a62525c46c888f56577918c1637) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:34.338272 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccd6d7-acc8-4eb9-957e-7c88188f7430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:34.339746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccd6d7-acc8-4eb9-957e-7c88188f7430 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:34.348046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 233/436] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 4 22:12:34 2022] GET /identity/v3/role_assignments?group.id=9d3a54e026b64d73baa7a90e60cc6f3a&scope.project.id=7bd58a62525c46c888f56577918c1637&role.id=b371b8f12e7348e8b01784eeddeca2ac => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:34.349172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a7687-43c3-4499-a0f5-85eea0fe436e None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:34.349455 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a7687-43c3-4499-a0f5-85eea0fe436e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:34.350267 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a7687-43c3-4499-a0f5-85eea0fe436e None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:34.351740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 234/437] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:34.357101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c415634-524d-41ab-8d36-83311b4781e3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:34.357390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c415634-524d-41ab-8d36-83311b4781e3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:34.357650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c415634-524d-41ab-8d36-83311b4781e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:34.362951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a73d27-e5f9-4238-b55b-ce2de73e9612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:34.364096 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a73d27-e5f9-4238-b55b-ce2de73e9612 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:34.364527 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a73d27-e5f9-4238-b55b-ce2de73e9612 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:34.364951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a73d27-e5f9-4238-b55b-ce2de73e9612 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:34.367142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a73d27-e5f9-4238-b55b-ce2de73e9612 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:34.368817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a73d27-e5f9-4238-b55b-ce2de73e9612 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:34.371166 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 204/438] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:34 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:34.376924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a73d27-e5f9-4238-b55b-ce2de73e9612 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:34.383636 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7c415634-524d-41ab-8d36-83311b4781e3 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:34.385113 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7c415634-524d-41ab-8d36-83311b4781e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:34.422701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:34.478437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 235/439] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:34.478437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74977150-54c0-4fea-9f0e-dc69b58de1ef None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:34.478437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74977150-54c0-4fea-9f0e-dc69b58de1ef None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:34.478437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74977150-54c0-4fea-9f0e-dc69b58de1ef None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:34.478830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 236/440] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:34.484857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca60242-55cd-48d3-bf0c-66feb041dcb8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:34.485150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca60242-55cd-48d3-bf0c-66feb041dcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:34.485428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca60242-55cd-48d3-bf0c-66feb041dcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:34.503676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a73d27-e5f9-4238-b55b-ce2de73e9612 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:34.507328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8ca60242-55cd-48d3-bf0c-66feb041dcb8 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:34.508313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8ca60242-55cd-48d3-bf0c-66feb041dcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:34.543437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5796f8-54c8-4cc8-9940-022dc90c6a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:34.544000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5796f8-54c8-4cc8-9940-022dc90c6a29 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:34.544286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5796f8-54c8-4cc8-9940-022dc90c6a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:34.544567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5796f8-54c8-4cc8-9940-022dc90c6a29 None admin] PATH_INFO: `/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:34.545737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5796f8-54c8-4cc8-9940-022dc90c6a29 None admin] RBAC: Authorizing `identity:get_group(group_id=9d3a54e026b64d73baa7a90e60cc6f3a)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:34.547215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5796f8-54c8-4cc8-9940-022dc90c6a29 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:34.548829 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 205/441] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:34 2022] GET /identity/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:34.553922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5796f8-54c8-4cc8-9940-022dc90c6a29 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:34.557279 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:34.587756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 237/442] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:34.588618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca60242-55cd-48d3-bf0c-66feb041dcb8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:34.686652 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5796f8-54c8-4cc8-9940-022dc90c6a29 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:34.708332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:34.713095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca60242-55cd-48d3-bf0c-66feb041dcb8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:34.730238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b30fa-2491-4d46-9c54-857aab04df5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:34.730975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b30fa-2491-4d46-9c54-857aab04df5f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:34.731265 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b30fa-2491-4d46-9c54-857aab04df5f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:34.731541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b30fa-2491-4d46-9c54-857aab04df5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:34.742428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b30fa-2491-4d46-9c54-857aab04df5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-e52b30fa-2491-4d46-9c54-857aab04df5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:34.747767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:34.748663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:34.749474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:34.749474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:34.749474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:34.749474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:34.749474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:34.749474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:34.749474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:34.749474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:34.749474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:34.749474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:34.749474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:34.749474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:34.749474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 206/443] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:12:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:34.750125 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b30fa-2491-4d46-9c54-857aab04df5f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:34.756202 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed17abb-f309-4543-a78e-024053ec24bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:34.756823 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed17abb-f309-4543-a78e-024053ec24bc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:34.757104 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed17abb-f309-4543-a78e-024053ec24bc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:34.757377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed17abb-f309-4543-a78e-024053ec24bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:34.758584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed17abb-f309-4543-a78e-024053ec24bc None admin] RBAC: Adding query filter params (group.id=9d3a54e026b64d73baa7a90e60cc6f3a, role.id=d295e312e144479ca8f748650ac995a4, scope.project.id=a33fb2c471ff405e8562d6379c3558bd) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:34.758916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed17abb-f309-4543-a78e-024053ec24bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:34.760360 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed17abb-f309-4543-a78e-024053ec24bc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:34.767122 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 238/444] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 4 22:12:34 2022] GET /identity/v3/role_assignments?group.id=9d3a54e026b64d73baa7a90e60cc6f3a&scope.project.id=a33fb2c471ff405e8562d6379c3558bd&role.id=d295e312e144479ca8f748650ac995a4 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:34.767748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed17abb-f309-4543-a78e-024053ec24bc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:34.820699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:34.864106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b30fa-2491-4d46-9c54-857aab04df5f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:34.890620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed17abb-f309-4543-a78e-024053ec24bc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:34.900214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf1353-2835-496c-b9c7-a0f4a9dd4954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:34.900863 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf1353-2835-496c-b9c7-a0f4a9dd4954 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:34.901148 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf1353-2835-496c-b9c7-a0f4a9dd4954 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:34.901420 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf1353-2835-496c-b9c7-a0f4a9dd4954 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:34.912584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf1353-2835-496c-b9c7-a0f4a9dd4954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-fbcf1353-2835-496c-b9c7-a0f4a9dd4954 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:34.918371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:34.919301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:34.920093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:34.920093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:34.920093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:34.920093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:34.920093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:34.920093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:34.920093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:34.920093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:34.920093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:34.920093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:34.920093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:12:34.920093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:34.920093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 207/445] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:12:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:34.925385 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf1353-2835-496c-b9c7-a0f4a9dd4954 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:34.940196 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb82aaa-836e-46bd-8fa2-f8cf68b7f6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:34.940823 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82aaa-836e-46bd-8fa2-f8cf68b7f6ac None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:34.941112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82aaa-836e-46bd-8fa2-f8cf68b7f6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:34.941392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82aaa-836e-46bd-8fa2-f8cf68b7f6ac None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:34.942117 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb82aaa-836e-46bd-8fa2-f8cf68b7f6ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:34.942445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb82aaa-836e-46bd-8fa2-f8cf68b7f6ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:34.944383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb82aaa-836e-46bd-8fa2-f8cf68b7f6ac None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:34.953315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 239/446] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:34.958688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb82aaa-836e-46bd-8fa2-f8cf68b7f6ac None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:34.990265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:35.041978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf1353-2835-496c-b9c7-a0f4a9dd4954 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:35.071053 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:35.085679 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40baa66-41b3-457c-8e06-66a6bfbf42bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:35.086302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40baa66-41b3-457c-8e06-66a6bfbf42bd None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:35.086613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40baa66-41b3-457c-8e06-66a6bfbf42bd None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:35.086885 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40baa66-41b3-457c-8e06-66a6bfbf42bd None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:35.087606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40baa66-41b3-457c-8e06-66a6bfbf42bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:35.088029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40baa66-41b3-457c-8e06-66a6bfbf42bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:35.089287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40baa66-41b3-457c-8e06-66a6bfbf42bd None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:35.090104 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb82aaa-836e-46bd-8fa2-f8cf68b7f6ac None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:35.100359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 208/447] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:35.106176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40baa66-41b3-457c-8e06-66a6bfbf42bd None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:35.132090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0d5a4-a426-44ff-b5f5-1209ec5e1726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:35.132716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0d5a4-a426-44ff-b5f5-1209ec5e1726 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:35.132995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0d5a4-a426-44ff-b5f5-1209ec5e1726 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:35.133264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0d5a4-a426-44ff-b5f5-1209ec5e1726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:35.200294 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0d5a4-a426-44ff-b5f5-1209ec5e1726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:35.202349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0d5a4-a426-44ff-b5f5-1209ec5e1726 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:35.206652 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40baa66-41b3-457c-8e06-66a6bfbf42bd None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:35.227622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:35.240445 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df18013-5edb-4a40-a82c-15cec5f0fa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:35.241059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df18013-5edb-4a40-a82c-15cec5f0fa87 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:35.241343 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df18013-5edb-4a40-a82c-15cec5f0fa87 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:35.241620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df18013-5edb-4a40-a82c-15cec5f0fa87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:35.294553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:35.301321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 240/448] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 22:12:35.307030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0d5a4-a426-44ff-b5f5-1209ec5e1726 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:35.308467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df18013-5edb-4a40-a82c-15cec5f0fa87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:35.309936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df18013-5edb-4a40-a82c-15cec5f0fa87 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:35.408423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0d5a4-a426-44ff-b5f5-1209ec5e1726 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:35.419290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 209/449] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 22:12:35.425225 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df18013-5edb-4a40-a82c-15cec5f0fa87 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:35.432815 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:35.443857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823a647-ca0c-4c56-8033-8c4123a4b1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:35.444487 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823a647-ca0c-4c56-8033-8c4123a4b1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:35.444765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823a647-ca0c-4c56-8033-8c4123a4b1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:35.445034 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823a647-ca0c-4c56-8033-8c4123a4b1a5 None admin] PATH_INFO: `/v3/projects/a33fb2c471ff405e8562d6379c3558bd` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:35.446186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823a647-ca0c-4c56-8033-8c4123a4b1a5 None admin] RBAC: Authorizing `identity:get_project(project_id=a33fb2c471ff405e8562d6379c3558bd)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:35.447742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823a647-ca0c-4c56-8033-8c4123a4b1a5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:35.449623 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 241/450] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:35 2022] GET /identity/v3/projects/a33fb2c471ff405e8562d6379c3558bd => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:35.455756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823a647-ca0c-4c56-8033-8c4123a4b1a5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:35.512053 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:35.524913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df18013-5edb-4a40-a82c-15cec5f0fa87 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:35.555319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823a647-ca0c-4c56-8033-8c4123a4b1a5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:35.558516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9533803-1bae-43c8-9a22-c634f3175b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:35.559149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9533803-1bae-43c8-9a22-c634f3175b5b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:35.559426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9533803-1bae-43c8-9a22-c634f3175b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:35.559694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9533803-1bae-43c8-9a22-c634f3175b5b None admin] PATH_INFO: `/v3/projects/0bdfa7558ab048ecad90e7cc85494da9` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:35.560842 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9533803-1bae-43c8-9a22-c634f3175b5b None admin] RBAC: Authorizing `identity:get_project(project_id=0bdfa7558ab048ecad90e7cc85494da9)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:35.562262 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9533803-1bae-43c8-9a22-c634f3175b5b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:35.564540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 210/451] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:12:35 2022] GET /identity/v3/projects/0bdfa7558ab048ecad90e7cc85494da9 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:35.569780 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9533803-1bae-43c8-9a22-c634f3175b5b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:35.589042 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7066605-bb06-47b0-8745-bfbdff0c3da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:35.589675 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7066605-bb06-47b0-8745-bfbdff0c3da0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:35.589952 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7066605-bb06-47b0-8745-bfbdff0c3da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:35.590223 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7066605-bb06-47b0-8745-bfbdff0c3da0 None admin] PATH_INFO: `/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:35.591388 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7066605-bb06-47b0-8745-bfbdff0c3da0 None admin] RBAC: Authorizing `identity:get_group(group_id=9d3a54e026b64d73baa7a90e60cc6f3a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:35.592837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7066605-bb06-47b0-8745-bfbdff0c3da0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:35.594394 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 242/452] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:35 2022] GET /identity/v3/groups/9d3a54e026b64d73baa7a90e60cc6f3a => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:35.600872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7066605-bb06-47b0-8745-bfbdff0c3da0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:35.658581 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:35.667200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9533803-1bae-43c8-9a22-c634f3175b5b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:35.699101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7066605-bb06-47b0-8745-bfbdff0c3da0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:35.699908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56b075-997c-4794-b7e7-5b3c91dba7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:35.700583 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b075-997c-4794-b7e7-5b3c91dba7ce None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:35.701178 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b075-997c-4794-b7e7-5b3c91dba7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:35.701473 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56b075-997c-4794-b7e7-5b3c91dba7ce None admin] PATH_INFO: `/v3/groups/61c15b18c38746a6ae53e5426d7070a9` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:35.702632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56b075-997c-4794-b7e7-5b3c91dba7ce None admin] RBAC: Authorizing `identity:get_group(group_id=61c15b18c38746a6ae53e5426d7070a9)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:35.704046 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56b075-997c-4794-b7e7-5b3c91dba7ce None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:35.705619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 211/453] 10.222.0.27 () {56 vars in 1180 bytes} [Thu Aug 4 22:12:35 2022] GET /identity/v3/groups/61c15b18c38746a6ae53e5426d7070a9 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:35.711931 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56b075-997c-4794-b7e7-5b3c91dba7ce None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:35.733617 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29ef4e-4b1a-4cf0-8d57-cbaa31704dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:35.734383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29ef4e-4b1a-4cf0-8d57-cbaa31704dbc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:35.734705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29ef4e-4b1a-4cf0-8d57-cbaa31704dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:35.734981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29ef4e-4b1a-4cf0-8d57-cbaa31704dbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:35.735327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:35.736030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29ef4e-4b1a-4cf0-8d57-cbaa31704dbc None admin] RBAC: Adding query filter params (group.id=9d3a54e026b64d73baa7a90e60cc6f3a, role.id=b371b8f12e7348e8b01784eeddeca2ac, scope.project.id=a33fb2c471ff405e8562d6379c3558bd) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:35.736151 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29ef4e-4b1a-4cf0-8d57-cbaa31704dbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:35.737702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29ef4e-4b1a-4cf0-8d57-cbaa31704dbc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:35.743795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 243/454] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 4 22:12:35 2022] GET /identity/v3/role_assignments?group.id=9d3a54e026b64d73baa7a90e60cc6f3a&scope.project.id=a33fb2c471ff405e8562d6379c3558bd&role.id=b371b8f12e7348e8b01784eeddeca2ac => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:35.817675 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56b075-997c-4794-b7e7-5b3c91dba7ce None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:35.855510 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c62c0-f861-4d84-8029-9312cdb556f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:35.856141 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c62c0-f861-4d84-8029-9312cdb556f5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:35.856418 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c62c0-f861-4d84-8029-9312cdb556f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:35.856686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c62c0-f861-4d84-8029-9312cdb556f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:35.857487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c62c0-f861-4d84-8029-9312cdb556f5 None admin] RBAC: Adding query filter params (group.id=61c15b18c38746a6ae53e5426d7070a9, role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=0bdfa7558ab048ecad90e7cc85494da9) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:35.857797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c62c0-f861-4d84-8029-9312cdb556f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:35.859276 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c62c0-f861-4d84-8029-9312cdb556f5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:35.866285 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 212/455] 10.222.0.27 () {56 vars in 1376 bytes} [Thu Aug 4 22:12:35 2022] GET /identity/v3/role_assignments?group.id=61c15b18c38746a6ae53e5426d7070a9&scope.project.id=0bdfa7558ab048ecad90e7cc85494da9&role.id=0053c24ce06147938dbb61657a531c94 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:38.491112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd88f5-e147-4b1c-9685-7687091a4dad None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:38.491598 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd88f5-e147-4b1c-9685-7687091a4dad None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:38.491672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd88f5-e147-4b1c-9685-7687091a4dad None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:38.493219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 244/456] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:38.508955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfe407-472c-4ae7-beb8-3667e993a3c7 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:38.509492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfe407-472c-4ae7-beb8-3667e993a3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:38.509769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfe407-472c-4ae7-beb8-3667e993a3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:38.530796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-70dfe407-472c-4ae7-beb8-3667e993a3c7 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:38.532011 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-70dfe407-472c-4ae7-beb8-3667e993a3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:38.535139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d225b-cf9f-4a4f-bfcb-5e4d0cf76946 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:38.535429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d225b-cf9f-4a4f-bfcb-5e4d0cf76946 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:38.535710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d225b-cf9f-4a4f-bfcb-5e4d0cf76946 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:38.537357 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 245/457] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:12:38.542210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af190cd-2f3c-44ec-af43-22ebbd83ce24 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:38.542524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af190cd-2f3c-44ec-af43-22ebbd83ce24 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:38.542805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af190cd-2f3c-44ec-af43-22ebbd83ce24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:38.561584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0af190cd-2f3c-44ec-af43-22ebbd83ce24 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:38.562827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0af190cd-2f3c-44ec-af43-22ebbd83ce24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:38.635722 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 213/458] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:38.646159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2a621-1558-4f40-bc57-71a27c7eb3ca None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:38.646332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2a621-1558-4f40-bc57-71a27c7eb3ca None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:38.646623 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2a621-1558-4f40-bc57-71a27c7eb3ca None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:38.648253 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 214/459] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:38.656144 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a2f0b-8a0c-4070-b339-2e79e066a100 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:38.656474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a2f0b-8a0c-4070-b339-2e79e066a100 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:38.656700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a2f0b-8a0c-4070-b339-2e79e066a100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:38.664843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 246/460] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:38.672191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af190cd-2f3c-44ec-af43-22ebbd83ce24 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:38.703479 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-ea8a2f0b-8a0c-4070-b339-2e79e066a100 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:38.704694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ea8a2f0b-8a0c-4070-b339-2e79e066a100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:38.716387 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:38.734088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:38.779686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af190cd-2f3c-44ec-af43-22ebbd83ce24 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:38.790474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 215/461] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:38.790474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a2f0b-8a0c-4070-b339-2e79e066a100 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:38.838759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f448c2c-86b4-4b46-8330-bec31ddf1b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:38.839756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f448c2c-86b4-4b46-8330-bec31ddf1b1c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:38.840263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f448c2c-86b4-4b46-8330-bec31ddf1b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:38.840743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f448c2c-86b4-4b46-8330-bec31ddf1b1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:38.851873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f448c2c-86b4-4b46-8330-bec31ddf1b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:38.853595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f448c2c-86b4-4b46-8330-bec31ddf1b1c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-8f448c2c-86b4-4b46-8330-bec31ddf1b1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:38.870339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:38.871247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:38.872153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:38.872153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:38.872153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:38.872153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:38.879019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 247/462] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:38.880088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f448c2c-86b4-4b46-8330-bec31ddf1b1c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:38.906374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a2f0b-8a0c-4070-b339-2e79e066a100 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:38.954053 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684cd89-e64f-46e9-b2d8-7eae1f1fe82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:38.954736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684cd89-e64f-46e9-b2d8-7eae1f1fe82b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:38.955018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684cd89-e64f-46e9-b2d8-7eae1f1fe82b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:38.955292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684cd89-e64f-46e9-b2d8-7eae1f1fe82b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:38.969450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684cd89-e64f-46e9-b2d8-7eae1f1fe82b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:38.971126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684cd89-e64f-46e9-b2d8-7eae1f1fe82b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:38.984247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a684cd89-e64f-46e9-b2d8-7eae1f1fe82b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:38.993016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:38.993874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:38.994753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:38.994753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:38.994753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:38.994753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:38.995354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f448c2c-86b4-4b46-8330-bec31ddf1b1c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:38.997033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 216/463] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:38.998010 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684cd89-e64f-46e9-b2d8-7eae1f1fe82b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:39.009055 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:39.047854 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dc724-4a44-4d65-83f8-3a2b8a4f1629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:39.048507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dc724-4a44-4d65-83f8-3a2b8a4f1629 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:39.048791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dc724-4a44-4d65-83f8-3a2b8a4f1629 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:39.049070 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dc724-4a44-4d65-83f8-3a2b8a4f1629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:39.063219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dc724-4a44-4d65-83f8-3a2b8a4f1629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:39.065405 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dc724-4a44-4d65-83f8-3a2b8a4f1629 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-146dc724-4a44-4d65-83f8-3a2b8a4f1629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:39.086049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:39.087256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:39.088127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:39.088127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:39.088127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:39.088127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:39.094484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 248/464] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:39.095566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dc724-4a44-4d65-83f8-3a2b8a4f1629 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:39.116606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684cd89-e64f-46e9-b2d8-7eae1f1fe82b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:39.163641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abae5b-c8c9-4fb3-9e57-4b239863e175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:39.164331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abae5b-c8c9-4fb3-9e57-4b239863e175 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:39.164615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abae5b-c8c9-4fb3-9e57-4b239863e175 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:39.164887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abae5b-c8c9-4fb3-9e57-4b239863e175 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:39.165878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abae5b-c8c9-4fb3-9e57-4b239863e175 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:39.166192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abae5b-c8c9-4fb3-9e57-4b239863e175 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:39.168263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5abae5b-c8c9-4fb3-9e57-4b239863e175 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:39.182092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 217/465] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:39.183337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abae5b-c8c9-4fb3-9e57-4b239863e175 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:39.211899 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dc724-4a44-4d65-83f8-3a2b8a4f1629 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:39.243748 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:39.252155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978845cc-d6c6-4046-99c6-5bf383431ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:39.252773 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978845cc-d6c6-4046-99c6-5bf383431ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:39.253053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978845cc-d6c6-4046-99c6-5bf383431ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:39.253321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978845cc-d6c6-4046-99c6-5bf383431ea8 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:39.254013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978845cc-d6c6-4046-99c6-5bf383431ea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:39.254316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978845cc-d6c6-4046-99c6-5bf383431ea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:39.255752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978845cc-d6c6-4046-99c6-5bf383431ea8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:39.273806 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 249/466] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:39.275054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac130a-604a-4e7a-8c0a-fcf4594cd5b7 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:39.275330 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac130a-604a-4e7a-8c0a-fcf4594cd5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:39.275602 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac130a-604a-4e7a-8c0a-fcf4594cd5b7 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:39.280691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 250/467] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:39.280691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac130a-604a-4e7a-8c0a-fcf4594cd5b7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:39.297658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5abae5b-c8c9-4fb3-9e57-4b239863e175 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:39.298096 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:39.337955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909180d-ea95-404e-88c3-b49dee9f76dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:39.338597 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909180d-ea95-404e-88c3-b49dee9f76dc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:39.338914 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909180d-ea95-404e-88c3-b49dee9f76dc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:39.339143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909180d-ea95-404e-88c3-b49dee9f76dc None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:39.339819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909180d-ea95-404e-88c3-b49dee9f76dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:39.340286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909180d-ea95-404e-88c3-b49dee9f76dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:39.341477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909180d-ea95-404e-88c3-b49dee9f76dc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:39.358114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 218/468] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:39.358990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909180d-ea95-404e-88c3-b49dee9f76dc None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:39.387768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac130a-604a-4e7a-8c0a-fcf4594cd5b7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:39.425190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8bbce-b603-484e-96ae-26a496506e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:39.425809 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8bbce-b603-484e-96ae-26a496506e60 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:39.426085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8bbce-b603-484e-96ae-26a496506e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:39.426356 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8bbce-b603-484e-96ae-26a496506e60 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:39.427056 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8bbce-b603-484e-96ae-26a496506e60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:39.429041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8bbce-b603-484e-96ae-26a496506e60 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:39.457659 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 251/469] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:12:39 2022] POST /identity/v3/users => generated 248 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:12:39.459577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4579f-dc72-42fc-a783-79bc6ef0d942 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:39.459874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4579f-dc72-42fc-a783-79bc6ef0d942 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:39.460152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4579f-dc72-42fc-a783-79bc6ef0d942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:39.479434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909180d-ea95-404e-88c3-b49dee9f76dc None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:39.484174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e6c4579f-dc72-42fc-a783-79bc6ef0d942 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:39.485432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e6c4579f-dc72-42fc-a783-79bc6ef0d942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:39.504214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:39.520162 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d06345-9668-48cb-bcaa-cfacefdce351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:39.522325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d06345-9668-48cb-bcaa-cfacefdce351 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:39.522856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d06345-9668-48cb-bcaa-cfacefdce351 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:39.523318 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d06345-9668-48cb-bcaa-cfacefdce351 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:39.524260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d06345-9668-48cb-bcaa-cfacefdce351 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:39.526019 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d06345-9668-48cb-bcaa-cfacefdce351 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:39.552848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 219/470] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:12:39 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:12:39.554107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d06345-9668-48cb-bcaa-cfacefdce351 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:39.581592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 252/471] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:39.588075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131952e-da3a-4637-ad4f-bb5b84d7efa2 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:39.588359 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131952e-da3a-4637-ad4f-bb5b84d7efa2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:39.588638 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131952e-da3a-4637-ad4f-bb5b84d7efa2 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:39.590919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 253/472] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:12:39.600065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb230d-1c0e-4a1f-8897-8573923e5cf1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:39.600369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb230d-1c0e-4a1f-8897-8573923e5cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:39.600593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb230d-1c0e-4a1f-8897-8573923e5cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:39.614800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:39.633799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e8cb230d-1c0e-4a1f-8897-8573923e5cf1 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:39.635472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e8cb230d-1c0e-4a1f-8897-8573923e5cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:39.698108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d06345-9668-48cb-bcaa-cfacefdce351 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:39.741029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 254/473] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:39.741609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcf374-df55-4924-ae12-61261df72dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:39.741891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb230d-1c0e-4a1f-8897-8573923e5cf1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:39.742717 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcf374-df55-4924-ae12-61261df72dba None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:39.743201 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcf374-df55-4924-ae12-61261df72dba None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:39.743684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcf374-df55-4924-ae12-61261df72dba None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:39.744783 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcf374-df55-4924-ae12-61261df72dba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:39.746582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcf374-df55-4924-ae12-61261df72dba None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:39.773632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 220/474] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:12:39 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:12:39.774504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcf374-df55-4924-ae12-61261df72dba None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:39.814359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:39.898332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb230d-1c0e-4a1f-8897-8573923e5cf1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:39.908879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcf374-df55-4924-ae12-61261df72dba None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:39.957149 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cded0-1149-4300-8e60-87e4c6ca46f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:39.957809 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cded0-1149-4300-8e60-87e4c6ca46f5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:39.958086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cded0-1149-4300-8e60-87e4c6ca46f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:39.958358 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cded0-1149-4300-8e60-87e4c6ca46f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:39.961224 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:39.967748 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6ecf0-e3a3-4c60-84cf-8c63775e77bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:39.968386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6ecf0-e3a3-4c60-84cf-8c63775e77bd None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:39.968663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6ecf0-e3a3-4c60-84cf-8c63775e77bd None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:39.968933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6ecf0-e3a3-4c60-84cf-8c63775e77bd None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:39.969657 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6ecf0-e3a3-4c60-84cf-8c63775e77bd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:39.971124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6ecf0-e3a3-4c60-84cf-8c63775e77bd None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:39.973709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cded0-1149-4300-8e60-87e4c6ca46f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:39.975266 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cded0-1149-4300-8e60-87e4c6ca46f5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:39.979908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.sql.core [None req-17d6ecf0-e3a3-4c60-84cf-8c63775e77bd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 22:12:39.979908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 22:12:39.979908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [parameters: {'id': 'bb70f176bb3a4182b489fbd626f8556c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 22:12:39.979908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80284) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-9c4cded0-1149-4300-8e60-87e4c6ca46f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:39.993531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:39.994579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:39.995406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:39.995406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:39.995406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:39.995406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:39.995406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 255/475] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-17d6ecf0-e3a3-4c60-84cf-8c63775e77bd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application conn.query(q) Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application result.read() Aug 04 22:12:39.998916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return ref.to_dict() Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 22:12:39.999801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application next(self.gen) Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application yield resource Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application next(self.gen) Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise self.value Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application session.commit() Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 22:12:40.001270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.session.flush() Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application compat.raise_( Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 22:12:40.003556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 22:12:40.007409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application conn.query(q) Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application result.read() Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 22:12:40.009419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [parameters: {'id': 'bb70f176bb3a4182b489fbd626f8556c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:40.019649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 04 22:12:40.021676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:40.023703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cded0-1149-4300-8e60-87e4c6ca46f5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:40.023878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 221/476] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Aug 4 22:12:39 2022] POST /identity/v3/roles => generated 144 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:40.023878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6ecf0-e3a3-4c60-84cf-8c63775e77bd None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:40.112680 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cded0-1149-4300-8e60-87e4c6ca46f5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:40.113962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:40.123364 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6ecf0-e3a3-4c60-84cf-8c63775e77bd None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:40.149289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809281d-3f15-4051-b170-1a8392bbef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:40.149911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809281d-3f15-4051-b170-1a8392bbef7e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:40.150193 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809281d-3f15-4051-b170-1a8392bbef7e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:40.150495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809281d-3f15-4051-b170-1a8392bbef7e None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:40.151249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809281d-3f15-4051-b170-1a8392bbef7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:40.151558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809281d-3f15-4051-b170-1a8392bbef7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:40.152938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809281d-3f15-4051-b170-1a8392bbef7e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:40.161579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4ad79-80b5-4af8-a5d5-71b57dfc971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:40.162920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4ad79-80b5-4af8-a5d5-71b57dfc971d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:40.163202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4ad79-80b5-4af8-a5d5-71b57dfc971d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:40.163473 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4ad79-80b5-4af8-a5d5-71b57dfc971d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:40.166429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 256/477] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:40.171780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809281d-3f15-4051-b170-1a8392bbef7e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:40.176157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4ad79-80b5-4af8-a5d5-71b57dfc971d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d0b4ad79-80b5-4af8-a5d5-71b57dfc971d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:40.181876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:40.182851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:40.183673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:40.183673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:40.183673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:40.183673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:40.183673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:40.183673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:40.183673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:40.183673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:40.183673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:40.183673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:40.183673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 04 22:12:40.183673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:40.183673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 222/478] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:12:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:40.190881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4ad79-80b5-4af8-a5d5-71b57dfc971d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:40.223049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:40.280793 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809281d-3f15-4051-b170-1a8392bbef7e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:40.326153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2335d-6d49-4893-aa5e-0d5ce7c357ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:40.326836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2335d-6d49-4893-aa5e-0d5ce7c357ef None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:40.329022 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2335d-6d49-4893-aa5e-0d5ce7c357ef None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:40.329307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2335d-6d49-4893-aa5e-0d5ce7c357ef None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:40.330007 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2335d-6d49-4893-aa5e-0d5ce7c357ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:40.331605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2335d-6d49-4893-aa5e-0d5ce7c357ef None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:40.361226 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 257/479] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:12:40 2022] POST /identity/v3/users => generated 249 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:12:40.418118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4ad79-80b5-4af8-a5d5-71b57dfc971d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:40.468800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d603f1d-d726-47a8-a84e-4ee6eae4090d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:40.469453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d603f1d-d726-47a8-a84e-4ee6eae4090d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:40.469742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d603f1d-d726-47a8-a84e-4ee6eae4090d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:40.470005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d603f1d-d726-47a8-a84e-4ee6eae4090d None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:40.470780 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d603f1d-d726-47a8-a84e-4ee6eae4090d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:40.471090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d603f1d-d726-47a8-a84e-4ee6eae4090d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:40.472518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d603f1d-d726-47a8-a84e-4ee6eae4090d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:40.482353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 223/480] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:42.090694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f81850-5e6b-4b96-b05b-c7dd22fd00ef None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:42.091552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f81850-5e6b-4b96-b05b-c7dd22fd00ef None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:42.092000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f81850-5e6b-4b96-b05b-c7dd22fd00ef None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:42.097708 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 258/481] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:42.104171 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c5e96-d56c-4f29-bbd8-39c5ee202401 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:42.104602 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c5e96-d56c-4f29-bbd8-39c5ee202401 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:42.104799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c5e96-d56c-4f29-bbd8-39c5ee202401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:42.135412 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-e00c5e96-d56c-4f29-bbd8-39c5ee202401 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:42.136629 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e00c5e96-d56c-4f29-bbd8-39c5ee202401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:42.148251 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:42.224815 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 224/482] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:42.250031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f81850-5e6b-4b96-b05b-c7dd22fd00ef None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:42.310434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c0682-08a8-477f-9928-926e405cad6d None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:42.310797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c0682-08a8-477f-9928-926e405cad6d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:42.312992 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c0682-08a8-477f-9928-926e405cad6d None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:42.313512 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 225/483] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:42.326311 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562660d-1d17-467b-b889-c6244c5d8428 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:42.327341 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562660d-1d17-467b-b889-c6244c5d8428 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:42.327825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562660d-1d17-467b-b889-c6244c5d8428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:42.347484 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2562660d-1d17-467b-b889-c6244c5d8428 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:42.348990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2562660d-1d17-467b-b889-c6244c5d8428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:42.493310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f81850-5e6b-4b96-b05b-c7dd22fd00ef None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:42.496248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:42.507249 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 226/484] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:42.508553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea721d96-93d2-46c2-90d7-491d596090bc None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:42.508835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea721d96-93d2-46c2-90d7-491d596090bc None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:42.509106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea721d96-93d2-46c2-90d7-491d596090bc None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:42.517555 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 227/485] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:42.522495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c343ea-431d-4ea2-81a2-5f38d758fd1b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:42.522495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c343ea-431d-4ea2-81a2-5f38d758fd1b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:42.522495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c343ea-431d-4ea2-81a2-5f38d758fd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:42.550666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df4a77-155b-42c9-ba66-e678f0d7bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:42.551020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-31c343ea-431d-4ea2-81a2-5f38d758fd1b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:42.551364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df4a77-155b-42c9-ba66-e678f0d7bfda None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:42.551646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df4a77-155b-42c9-ba66-e678f0d7bfda None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:42.551967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df4a77-155b-42c9-ba66-e678f0d7bfda None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:42.552136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-31c343ea-431d-4ea2-81a2-5f38d758fd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:42.563609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df4a77-155b-42c9-ba66-e678f0d7bfda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-a7df4a77-155b-42c9-ba66-e678f0d7bfda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:42.569124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:42.569997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:42.571274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:42.571274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:42.571274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:42.571274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:42.571274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:42.571274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:42.571274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:42.571274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:42.571274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:42.571274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:42.571274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:42.571274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:42.571274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 259/486] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:42.572185 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df4a77-155b-42c9-ba66-e678f0d7bfda None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:42.654581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 228/487] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:42.655453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c343ea-431d-4ea2-81a2-5f38d758fd1b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:42.670612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:42.707906 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df4a77-155b-42c9-ba66-e678f0d7bfda None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:42.755588 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20fe77-ee44-4a73-b8fc-974273123d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:42.757729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20fe77-ee44-4a73-b8fc-974273123d61 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:42.758212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20fe77-ee44-4a73-b8fc-974273123d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:42.758698 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20fe77-ee44-4a73-b8fc-974273123d61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:42.772713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c343ea-431d-4ea2-81a2-5f38d758fd1b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:42.773444 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20fe77-ee44-4a73-b8fc-974273123d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2b20fe77-ee44-4a73-b8fc-974273123d61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:42.780756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:42.781628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:42.782443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:42.782443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:42.782443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:42.782443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:42.782443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:42.782443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:42.782443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:42.782443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:42.782443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:42.782443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:42.782443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:42.782443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:42.786486 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 260/488] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:42.787539 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20fe77-ee44-4a73-b8fc-974273123d61 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:42.815924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca84f7-ad96-46e3-a6e0-fc94c5a29adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:42.816622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca84f7-ad96-46e3-a6e0-fc94c5a29adf None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:42.816914 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca84f7-ad96-46e3-a6e0-fc94c5a29adf None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:42.817187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca84f7-ad96-46e3-a6e0-fc94c5a29adf None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:42.818208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca84f7-ad96-46e3-a6e0-fc94c5a29adf None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:42.818208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca84f7-ad96-46e3-a6e0-fc94c5a29adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:42.820167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca84f7-ad96-46e3-a6e0-fc94c5a29adf None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:42.822007 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:42.835333 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 229/489] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:42.835333 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca84f7-ad96-46e3-a6e0-fc94c5a29adf None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:42.914164 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:42.934042 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20fe77-ee44-4a73-b8fc-974273123d61 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:42.955806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca84f7-ad96-46e3-a6e0-fc94c5a29adf None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:42.971396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532320f-db92-4f9b-ab18-0fa0cbdd8139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:42.972000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532320f-db92-4f9b-ab18-0fa0cbdd8139 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:42.972281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532320f-db92-4f9b-ab18-0fa0cbdd8139 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:42.972603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532320f-db92-4f9b-ab18-0fa0cbdd8139 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:42.983915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532320f-db92-4f9b-ab18-0fa0cbdd8139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-a532320f-db92-4f9b-ab18-0fa0cbdd8139 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:42.989748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:42.991257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:42.992027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:42.992027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:42.992027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:42.992027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:42.992027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:42.992027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:42.992027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:42.992027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:42.992027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:42.992027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:42.992027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:42.992027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:42.992027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 261/490] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:42.992676 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532320f-db92-4f9b-ab18-0fa0cbdd8139 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:43.007332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab084873-dd46-4d78-9032-55b2dc512737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:43.008706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab084873-dd46-4d78-9032-55b2dc512737 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.009190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab084873-dd46-4d78-9032-55b2dc512737 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.009931 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab084873-dd46-4d78-9032-55b2dc512737 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.010885 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab084873-dd46-4d78-9032-55b2dc512737 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:43.011629 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab084873-dd46-4d78-9032-55b2dc512737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:43.013969 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab084873-dd46-4d78-9032-55b2dc512737 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:43.025828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 230/491] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:43.026941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab084873-dd46-4d78-9032-55b2dc512737 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:43.091062 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:43.110669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532320f-db92-4f9b-ab18-0fa0cbdd8139 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:43.141017 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab084873-dd46-4d78-9032-55b2dc512737 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:43.143923 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603d552-1bfb-452a-9026-ab1179975e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:43.144563 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603d552-1bfb-452a-9026-ab1179975e6d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.144847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603d552-1bfb-452a-9026-ab1179975e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.145131 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603d552-1bfb-452a-9026-ab1179975e6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.155550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603d552-1bfb-452a-9026-ab1179975e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:43.157025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603d552-1bfb-452a-9026-ab1179975e6d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:43.169021 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e603d552-1bfb-452a-9026-ab1179975e6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:43.171553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:43.172371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:43.173218 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:43.173218 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:43.173218 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:43.173218 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:43.173218 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 262/492] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:43.173486 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603d552-1bfb-452a-9026-ab1179975e6d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:43.179274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7651d8-ceb2-4be8-aae9-fb6cc682ae5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:43.180123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7651d8-ceb2-4be8-aae9-fb6cc682ae5f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.180409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7651d8-ceb2-4be8-aae9-fb6cc682ae5f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.180685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7651d8-ceb2-4be8-aae9-fb6cc682ae5f None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.181400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7651d8-ceb2-4be8-aae9-fb6cc682ae5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:43.181709 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7651d8-ceb2-4be8-aae9-fb6cc682ae5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:43.183112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7651d8-ceb2-4be8-aae9-fb6cc682ae5f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:43.196055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 231/493] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:43.196055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213aaf9-0075-401a-9c3d-acf2eb0358e5 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.196055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213aaf9-0075-401a-9c3d-acf2eb0358e5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.196055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213aaf9-0075-401a-9c3d-acf2eb0358e5 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.196055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 232/494] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:43.196055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90423a13-5029-47b2-857a-9eb7046b9dec None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.196575 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90423a13-5029-47b2-857a-9eb7046b9dec None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.196656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90423a13-5029-47b2-857a-9eb7046b9dec None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.197817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 233/495] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:43.198558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90423a13-5029-47b2-857a-9eb7046b9dec None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:43.282736 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603d552-1bfb-452a-9026-ab1179975e6d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:43.301942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90423a13-5029-47b2-857a-9eb7046b9dec None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:43.315040 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21222b4-78dd-4bde-bdb5-b6bb5ce165c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:43.315882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21222b4-78dd-4bde-bdb5-b6bb5ce165c3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.316158 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21222b4-78dd-4bde-bdb5-b6bb5ce165c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.316427 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21222b4-78dd-4bde-bdb5-b6bb5ce165c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.318780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:43.328157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21222b4-78dd-4bde-bdb5-b6bb5ce165c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:43.329609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21222b4-78dd-4bde-bdb5-b6bb5ce165c3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:43.336910 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973ef1a-bc41-4582-9c3f-75a3e05248c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:43.337516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973ef1a-bc41-4582-9c3f-75a3e05248c0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.337801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973ef1a-bc41-4582-9c3f-75a3e05248c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.338079 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973ef1a-bc41-4582-9c3f-75a3e05248c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.338794 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973ef1a-bc41-4582-9c3f-75a3e05248c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:43.339104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973ef1a-bc41-4582-9c3f-75a3e05248c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:43.340461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973ef1a-bc41-4582-9c3f-75a3e05248c0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b21222b4-78dd-4bde-bdb5-b6bb5ce165c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:43.343928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:43.345645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:43.347508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:43.347508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:43.347508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:43.347508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:43.347508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 263/496] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:43.347508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21222b4-78dd-4bde-bdb5-b6bb5ce165c3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:43.355901 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 234/497] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:43.357206 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef4b44-a6d5-402b-b4bc-3040a845e565 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.357501 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef4b44-a6d5-402b-b4bc-3040a845e565 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.357778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef4b44-a6d5-402b-b4bc-3040a845e565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.374886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-edef4b44-a6d5-402b-b4bc-3040a845e565 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:43.376050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-edef4b44-a6d5-402b-b4bc-3040a845e565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:43.423352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:43.443035 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 235/498] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:43.444749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cbbc7-a429-4e99-b204-6f4062de44df None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.445032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cbbc7-a429-4e99-b204-6f4062de44df None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.445130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21222b4-78dd-4bde-bdb5-b6bb5ce165c3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:43.445306 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cbbc7-a429-4e99-b204-6f4062de44df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.463236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b84cbbc7-a429-4e99-b204-6f4062de44df None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:43.464435 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b84cbbc7-a429-4e99-b204-6f4062de44df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:43.484998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ed10b-f171-48dc-b5b3-5008f7c3c372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:43.485638 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ed10b-f171-48dc-b5b3-5008f7c3c372 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.485922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ed10b-f171-48dc-b5b3-5008f7c3c372 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.486214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ed10b-f171-48dc-b5b3-5008f7c3c372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.497605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ed10b-f171-48dc-b5b3-5008f7c3c372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:43.499292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ed10b-f171-48dc-b5b3-5008f7c3c372 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-ff5ed10b-f171-48dc-b5b3-5008f7c3c372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:43.514876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:43.515914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:43.516781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:43.516781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:43.516781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:43.516781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:43.516781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 264/499] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:43.517156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ed10b-f171-48dc-b5b3-5008f7c3c372 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:43.544501 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 236/500] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:43.545347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cbbc7-a429-4e99-b204-6f4062de44df None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:43.564223 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:43.625597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ed10b-f171-48dc-b5b3-5008f7c3c372 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:43.653643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cbbc7-a429-4e99-b204-6f4062de44df None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:43.658347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85da79-898c-40ba-a24e-5412271f0051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:43.658996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85da79-898c-40ba-a24e-5412271f0051 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.659272 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85da79-898c-40ba-a24e-5412271f0051 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.659542 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85da79-898c-40ba-a24e-5412271f0051 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.660219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85da79-898c-40ba-a24e-5412271f0051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:43.660520 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85da79-898c-40ba-a24e-5412271f0051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:43.661888 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85da79-898c-40ba-a24e-5412271f0051 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:43.666661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:43.674169 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 265/501] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:43.675023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85da79-898c-40ba-a24e-5412271f0051 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:43.688885 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08571128-449c-43f2-910e-5aab60bec9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:43.689525 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08571128-449c-43f2-910e-5aab60bec9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.689803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08571128-449c-43f2-910e-5aab60bec9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.690077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08571128-449c-43f2-910e-5aab60bec9f1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.697885 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08571128-449c-43f2-910e-5aab60bec9f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:43.699363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08571128-449c-43f2-910e-5aab60bec9f1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-08571128-449c-43f2-910e-5aab60bec9f1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:12:43.712373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:43.713309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:43.714197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:43.714197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:43.714197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:12:43.714197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:12:43.714197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:12:43.714197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:12:43.714197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:12:43.714197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:12:43.714197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 22:12:43.714197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:43.714197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 237/502] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:43.715371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08571128-449c-43f2-910e-5aab60bec9f1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:43.771077 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:43.775239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85da79-898c-40ba-a24e-5412271f0051 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:43.810269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432c5fa-cebd-4167-a4ab-b8381f51c071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:43.810926 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432c5fa-cebd-4167-a4ab-b8381f51c071 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.811209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432c5fa-cebd-4167-a4ab-b8381f51c071 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.811481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432c5fa-cebd-4167-a4ab-b8381f51c071 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.815581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08571128-449c-43f2-910e-5aab60bec9f1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:43.822243 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432c5fa-cebd-4167-a4ab-b8381f51c071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-f432c5fa-cebd-4167-a4ab-b8381f51c071 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:43.827347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:43.828409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:43.829199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:43.829199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:43.829199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:43.829199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:43.829199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:43.829199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:43.829199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:43.829199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:43.829199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:43.829199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:43.829199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:43.829199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:43.829199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 266/503] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:43.829847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432c5fa-cebd-4167-a4ab-b8381f51c071 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:43.851761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac5490-0104-46cc-8ab8-ee66deae5012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:43.852363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac5490-0104-46cc-8ab8-ee66deae5012 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.852643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac5490-0104-46cc-8ab8-ee66deae5012 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.852916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac5490-0104-46cc-8ab8-ee66deae5012 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.853594 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac5490-0104-46cc-8ab8-ee66deae5012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:43.853893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac5490-0104-46cc-8ab8-ee66deae5012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:43.855279 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac5490-0104-46cc-8ab8-ee66deae5012 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:43.867468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 238/504] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:43.868263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac5490-0104-46cc-8ab8-ee66deae5012 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:43.897678 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:43.933758 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432c5fa-cebd-4167-a4ab-b8381f51c071 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:43.968281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24df227-76f0-46f6-96ef-dd51f069c58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:43.968967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24df227-76f0-46f6-96ef-dd51f069c58b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:43.969251 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24df227-76f0-46f6-96ef-dd51f069c58b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:43.969524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24df227-76f0-46f6-96ef-dd51f069c58b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:43.969732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac5490-0104-46cc-8ab8-ee66deae5012 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:43.980015 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24df227-76f0-46f6-96ef-dd51f069c58b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:43.981482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24df227-76f0-46f6-96ef-dd51f069c58b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b24df227-76f0-46f6-96ef-dd51f069c58b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:43.996366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:43.997302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:43.998262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:43.998262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:43.998262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:43.998262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:43.998262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 267/505] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:43.998575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24df227-76f0-46f6-96ef-dd51f069c58b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:44.010437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af279ca9-21ef-4154-aa89-40dbc0038e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:44.010620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:44.011176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279ca9-21ef-4154-aa89-40dbc0038e57 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:44.011461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279ca9-21ef-4154-aa89-40dbc0038e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:44.011747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279ca9-21ef-4154-aa89-40dbc0038e57 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:44.019186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af279ca9-21ef-4154-aa89-40dbc0038e57 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:44.020643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af279ca9-21ef-4154-aa89-40dbc0038e57 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-af279ca9-21ef-4154-aa89-40dbc0038e57 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:12:44.032229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:44.033147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:44.034059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:44.034059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:44.034059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:12:44.034059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:12:44.034059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:12:44.034059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:12:44.034059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:12:44.034059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:12:44.034059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:12:44.034059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:44.034059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 239/506] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 4 22:12:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:44.034659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af279ca9-21ef-4154-aa89-40dbc0038e57 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:44.101050 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24df227-76f0-46f6-96ef-dd51f069c58b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:44.124085 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:44.133257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af279ca9-21ef-4154-aa89-40dbc0038e57 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:44.134123 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fc8f7-b668-4a54-9206-953df8f52692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:44.134763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fc8f7-b668-4a54-9206-953df8f52692 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:44.135047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fc8f7-b668-4a54-9206-953df8f52692 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:44.135319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fc8f7-b668-4a54-9206-953df8f52692 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:44.136117 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fc8f7-b668-4a54-9206-953df8f52692 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:44.136426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fc8f7-b668-4a54-9206-953df8f52692 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:44.137859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fc8f7-b668-4a54-9206-953df8f52692 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:44.166039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba04e9-4095-405e-8f58-f165079b7135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:44.166677 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba04e9-4095-405e-8f58-f165079b7135 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:44.166956 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba04e9-4095-405e-8f58-f165079b7135 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:44.167231 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba04e9-4095-405e-8f58-f165079b7135 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:44.167933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba04e9-4095-405e-8f58-f165079b7135 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:44.168235 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba04e9-4095-405e-8f58-f165079b7135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:44.169583 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba04e9-4095-405e-8f58-f165079b7135 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:44.173708 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 268/507] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Aug 4 22:12:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:44.174560 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fc8f7-b668-4a54-9206-953df8f52692 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:44.186692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 240/508] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:44.186692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba04e9-4095-405e-8f58-f165079b7135 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:44.247351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:44.280925 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fc8f7-b668-4a54-9206-953df8f52692 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:44.289101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba04e9-4095-405e-8f58-f165079b7135 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:44.315321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e3d45-f7b1-4bfe-a53c-93c7a3f328cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:44.315961 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e3d45-f7b1-4bfe-a53c-93c7a3f328cb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:44.316245 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e3d45-f7b1-4bfe-a53c-93c7a3f328cb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:44.316524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e3d45-f7b1-4bfe-a53c-93c7a3f328cb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:44.322195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0e96c-d857-4f73-b378-7cecf6f8f522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:44.322835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e96c-d857-4f73-b378-7cecf6f8f522 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:44.323112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e96c-d857-4f73-b378-7cecf6f8f522 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:44.323381 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e96c-d857-4f73-b378-7cecf6f8f522 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:44.324016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e3d45-f7b1-4bfe-a53c-93c7a3f328cb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:44.324107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0e96c-d857-4f73-b378-7cecf6f8f522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:44.324348 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0e96c-d857-4f73-b378-7cecf6f8f522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:44.325489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e3d45-f7b1-4bfe-a53c-93c7a3f328cb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:44.325678 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0e96c-d857-4f73-b378-7cecf6f8f522 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:44.337509 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 241/509] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:44.338308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0e96c-d857-4f73-b378-7cecf6f8f522 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-5a2e3d45-f7b1-4bfe-a53c-93c7a3f328cb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:12:44.338532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:44.339392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:44.340303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:44.340303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:44.340303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:12:44.340303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:12:44.340303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:12:44.340303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:12:44.340303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:12:44.340303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:12:44.340303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 22:12:44.340303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:44.340303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 269/510] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:44.340843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e3d45-f7b1-4bfe-a53c-93c7a3f328cb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:44.356013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:44.437616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0e96c-d857-4f73-b378-7cecf6f8f522 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:44.440697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e3d45-f7b1-4bfe-a53c-93c7a3f328cb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:44.469902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:44.471903 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b70225-cd78-4923-b062-875a3e44e4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:44.472583 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b70225-cd78-4923-b062-875a3e44e4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:44.472869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b70225-cd78-4923-b062-875a3e44e4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:44.473149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b70225-cd78-4923-b062-875a3e44e4c8 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:44.473951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b70225-cd78-4923-b062-875a3e44e4c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:44.474260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b70225-cd78-4923-b062-875a3e44e4c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:44.475781 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b70225-cd78-4923-b062-875a3e44e4c8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:44.478019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0974ad0-b164-4551-8582-f6c894b42444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:44.478664 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0974ad0-b164-4551-8582-f6c894b42444 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:44.478950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0974ad0-b164-4551-8582-f6c894b42444 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:44.479225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0974ad0-b164-4551-8582-f6c894b42444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:44.512437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 242/511] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 4 22:12:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:44.513327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b70225-cd78-4923-b062-875a3e44e4c8 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:44.547827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0974ad0-b164-4551-8582-f6c894b42444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:44.549290 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0974ad0-b164-4551-8582-f6c894b42444 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:44.583691 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:44.613465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b70225-cd78-4923-b062-875a3e44e4c8 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:44.645983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ab1a0-59d4-438a-9b5c-3454043c6476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:44.646666 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ab1a0-59d4-438a-9b5c-3454043c6476 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:44.646940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ab1a0-59d4-438a-9b5c-3454043c6476 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:44.647210 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ab1a0-59d4-438a-9b5c-3454043c6476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:44.650550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 270/512] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:44.651541 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0974ad0-b164-4551-8582-f6c894b42444 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:44.657897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ab1a0-59d4-438a-9b5c-3454043c6476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:44.659364 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ab1a0-59d4-438a-9b5c-3454043c6476 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-254ab1a0-59d4-438a-9b5c-3454043c6476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:44.673983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:44.674972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:44.675826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:44.675826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:44.675826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:44.675826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:44.675826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 243/513] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:44.676113 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ab1a0-59d4-438a-9b5c-3454043c6476 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:44.682160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:44.758672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0974ad0-b164-4551-8582-f6c894b42444 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:44.777714 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ab1a0-59d4-438a-9b5c-3454043c6476 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:44.792268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fd304-3d16-4001-b22a-e5ca972d2998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:44.792881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fd304-3d16-4001-b22a-e5ca972d2998 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:44.793165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fd304-3d16-4001-b22a-e5ca972d2998 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:44.793441 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fd304-3d16-4001-b22a-e5ca972d2998 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:44.794120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fd304-3d16-4001-b22a-e5ca972d2998 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:44.795665 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fd304-3d16-4001-b22a-e5ca972d2998 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:44.800797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:44.813320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae4b5-9ca8-4198-8234-d1453c758d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:44.813939 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae4b5-9ca8-4198-8234-d1453c758d7c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:44.814221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae4b5-9ca8-4198-8234-d1453c758d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:44.814532 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae4b5-9ca8-4198-8234-d1453c758d7c None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:44.815329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ae4b5-9ca8-4198-8234-d1453c758d7c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:44.815639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ae4b5-9ca8-4198-8234-d1453c758d7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:44.816486 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 271/514] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:12:44 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:12:44.817064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ae4b5-9ca8-4198-8234-d1453c758d7c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:44.817283 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fd304-3d16-4001-b22a-e5ca972d2998 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:44.836602 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 244/515] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Aug 4 22:12:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:44.837541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae4b5-9ca8-4198-8234-d1453c758d7c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:44.928287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:44.949442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fd304-3d16-4001-b22a-e5ca972d2998 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:44.953847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae4b5-9ca8-4198-8234-d1453c758d7c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:44.989658 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4ad8d-c576-47d7-bc5a-ac47a024980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:44.990835 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4ad8d-c576-47d7-bc5a-ac47a024980c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:44.991802 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4ad8d-c576-47d7-bc5a-ac47a024980c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:44.992080 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4ad8d-c576-47d7-bc5a-ac47a024980c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:44.996302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e86a4d-9223-4bcb-8aa2-c5f9a319dbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:44.997058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e86a4d-9223-4bcb-8aa2-c5f9a319dbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:44.997455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e86a4d-9223-4bcb-8aa2-c5f9a319dbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:44.997833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e86a4d-9223-4bcb-8aa2-c5f9a319dbb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:45.009320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e86a4d-9223-4bcb-8aa2-c5f9a319dbb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:45.010972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e86a4d-9223-4bcb-8aa2-c5f9a319dbb5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-75e86a4d-9223-4bcb-8aa2-c5f9a319dbb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:45.026196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:45.027310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:45.028373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:45.028373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:45.028373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:45.028373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:45.028373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 245/516] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:45.028690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e86a4d-9223-4bcb-8aa2-c5f9a319dbb5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:45.065432 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:45.074706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4ad8d-c576-47d7-bc5a-ac47a024980c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:45.076433 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4ad8d-c576-47d7-bc5a-ac47a024980c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:45.142147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e86a4d-9223-4bcb-8aa2-c5f9a319dbb5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:45.162271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:45.178508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbaba5-3ae2-4524-9899-c6140deadf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:45.179214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbaba5-3ae2-4524-9899-c6140deadf71 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:45.179565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbaba5-3ae2-4524-9899-c6140deadf71 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:45.179905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbaba5-3ae2-4524-9899-c6140deadf71 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:45.180666 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbaba5-3ae2-4524-9899-c6140deadf71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:45.181047 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbaba5-3ae2-4524-9899-c6140deadf71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:45.182320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 272/517] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:45.183067 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4ad8d-c576-47d7-bc5a-ac47a024980c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:45.186975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbaba5-3ae2-4524-9899-c6140deadf71 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:45.200389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 246/518] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:45.201470 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbaba5-3ae2-4524-9899-c6140deadf71 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:45.290507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4ad8d-c576-47d7-bc5a-ac47a024980c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:45.299424 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:45.307885 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbaba5-3ae2-4524-9899-c6140deadf71 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:45.327435 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cae870-2592-49af-9dc3-107b9ac214c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:45.328141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cae870-2592-49af-9dc3-107b9ac214c6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:45.328499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cae870-2592-49af-9dc3-107b9ac214c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:45.328859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cae870-2592-49af-9dc3-107b9ac214c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:45.343336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3467a68-6148-422f-adea-18081c228d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:45.344053 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3467a68-6148-422f-adea-18081c228d9e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:45.344392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3467a68-6148-422f-adea-18081c228d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:45.344734 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3467a68-6148-422f-adea-18081c228d9e None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:45.345495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3467a68-6148-422f-adea-18081c228d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:45.345869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3467a68-6148-422f-adea-18081c228d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:45.347338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3467a68-6148-422f-adea-18081c228d9e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:45.364058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 247/519] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:45.364058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3467a68-6148-422f-adea-18081c228d9e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:45.387875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:45.404962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cae870-2592-49af-9dc3-107b9ac214c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:45.406576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cae870-2592-49af-9dc3-107b9ac214c6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:45.472667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3467a68-6148-422f-adea-18081c228d9e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:45.508585 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aceac-1d5a-4e55-9b66-e3bb50b79eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:45.509225 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aceac-1d5a-4e55-9b66-e3bb50b79eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:45.509509 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aceac-1d5a-4e55-9b66-e3bb50b79eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:45.509789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aceac-1d5a-4e55-9b66-e3bb50b79eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:45.522783 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 273/520] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:45.522783 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cae870-2592-49af-9dc3-107b9ac214c6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:45.525824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985aceac-1d5a-4e55-9b66-e3bb50b79eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:45.527327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985aceac-1d5a-4e55-9b66-e3bb50b79eb4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-985aceac-1d5a-4e55-9b66-e3bb50b79eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:45.542958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:45.543840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:45.544667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:45.544667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:45.544667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:45.544667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:45.544667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 248/521] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:45.549236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aceac-1d5a-4e55-9b66-e3bb50b79eb4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:45.559244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:45.610721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:45.629086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cae870-2592-49af-9dc3-107b9ac214c6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:45.656654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aceac-1d5a-4e55-9b66-e3bb50b79eb4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:45.665406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7615c-2fc2-4804-8a18-80ca45f7f8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:45.666619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7615c-2fc2-4804-8a18-80ca45f7f8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:45.667043 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7615c-2fc2-4804-8a18-80ca45f7f8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:45.667754 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7615c-2fc2-4804-8a18-80ca45f7f8b3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:45.675834 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7615c-2fc2-4804-8a18-80ca45f7f8b3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:45.677286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7615c-2fc2-4804-8a18-80ca45f7f8b3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-cee7615c-2fc2-4804-8a18-80ca45f7f8b3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:12:45.689453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:45.690315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:45.691626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:45.691626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:45.691626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:12:45.691626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:12:45.691626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:12:45.691626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:12:45.691626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:12:45.691626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:12:45.691626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 22:12:45.691626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:45.691626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 274/522] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:45.691626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7615c-2fc2-4804-8a18-80ca45f7f8b3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:45.696640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a84d7-6c84-499e-bdee-08b048351c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:45.697297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a84d7-6c84-499e-bdee-08b048351c2c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:45.697583 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a84d7-6c84-499e-bdee-08b048351c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:45.697862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a84d7-6c84-499e-bdee-08b048351c2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:45.706304 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a84d7-6c84-499e-bdee-08b048351c2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:45.707800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a84d7-6c84-499e-bdee-08b048351c2c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-545a84d7-6c84-499e-bdee-08b048351c2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:12:45.720180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:45.721023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:45.721835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:12:45.721835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:12:45.721835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:12:45.721835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:12:45.721835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:12:45.721835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:12:45.721835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:45.721835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:45.721835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 249/523] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:45.722456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a84d7-6c84-499e-bdee-08b048351c2c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:45.794733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:45.797702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7615c-2fc2-4804-8a18-80ca45f7f8b3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:45.832737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0574ada-8713-40a0-8913-826594945840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:45.833377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0574ada-8713-40a0-8913-826594945840 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:45.833664 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0574ada-8713-40a0-8913-826594945840 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:45.834374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a84d7-6c84-499e-bdee-08b048351c2c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:45.834536 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0574ada-8713-40a0-8913-826594945840 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:45.845467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0574ada-8713-40a0-8913-826594945840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:45.846975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0574ada-8713-40a0-8913-826594945840 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:45.850812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b0574ada-8713-40a0-8913-826594945840 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:45.863505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:45.864552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:45.870093 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:45.870093 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:45.870093 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:45.870093 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:45.870093 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 275/524] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:45.870093 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0574ada-8713-40a0-8913-826594945840 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:45.879137 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacfcda-1dcd-4003-b469-454c7e738d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:45.879755 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacfcda-1dcd-4003-b469-454c7e738d74 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:45.880036 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacfcda-1dcd-4003-b469-454c7e738d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:45.880310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacfcda-1dcd-4003-b469-454c7e738d74 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:45.881043 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacfcda-1dcd-4003-b469-454c7e738d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:45.881350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacfcda-1dcd-4003-b469-454c7e738d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:45.882754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacfcda-1dcd-4003-b469-454c7e738d74 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:45.895113 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 250/525] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:45.899874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacfcda-1dcd-4003-b469-454c7e738d74 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:45.977598 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0574ada-8713-40a0-8913-826594945840 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:46.008224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacfcda-1dcd-4003-b469-454c7e738d74 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:46.012717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d62f7-60ce-4c12-8369-5f4539352a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:46.013451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d62f7-60ce-4c12-8369-5f4539352a2e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:46.013832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d62f7-60ce-4c12-8369-5f4539352a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:46.014225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d62f7-60ce-4c12-8369-5f4539352a2e None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:46.015145 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d62f7-60ce-4c12-8369-5f4539352a2e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:46.015558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d62f7-60ce-4c12-8369-5f4539352a2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:46.017106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d62f7-60ce-4c12-8369-5f4539352a2e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:46.035335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 276/526] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Aug 4 22:12:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:46.035523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:46.036422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d62f7-60ce-4c12-8369-5f4539352a2e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:46.049934 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b044f9-5407-42cf-bbd8-deb2ba308003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:46.050493 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b044f9-5407-42cf-bbd8-deb2ba308003 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:46.050774 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b044f9-5407-42cf-bbd8-deb2ba308003 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:46.051045 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b044f9-5407-42cf-bbd8-deb2ba308003 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:46.051787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b044f9-5407-42cf-bbd8-deb2ba308003 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:46.052094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b044f9-5407-42cf-bbd8-deb2ba308003 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:46.053607 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b044f9-5407-42cf-bbd8-deb2ba308003 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:46.076820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 251/527] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:12:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:46.076820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b044f9-5407-42cf-bbd8-deb2ba308003 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:46.102892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:46.152828 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d62f7-60ce-4c12-8369-5f4539352a2e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:46.182105 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b044f9-5407-42cf-bbd8-deb2ba308003 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:46.186817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6f81e-a74e-4cfe-b4e3-0294686ea764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:46.187438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6f81e-a74e-4cfe-b4e3-0294686ea764 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:46.187725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6f81e-a74e-4cfe-b4e3-0294686ea764 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:46.188006 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6f81e-a74e-4cfe-b4e3-0294686ea764 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:46.188700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6f81e-a74e-4cfe-b4e3-0294686ea764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:46.189011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6f81e-a74e-4cfe-b4e3-0294686ea764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:46.190392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6f81e-a74e-4cfe-b4e3-0294686ea764 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:46.207953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 277/528] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:46.208645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6f81e-a74e-4cfe-b4e3-0294686ea764 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:46.218800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10ed33-0936-4d06-a5fd-a120ce5db493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:46.219589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10ed33-0936-4d06-a5fd-a120ce5db493 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:46.219968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10ed33-0936-4d06-a5fd-a120ce5db493 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:46.220341 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10ed33-0936-4d06-a5fd-a120ce5db493 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:46.228418 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10ed33-0936-4d06-a5fd-a120ce5db493 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:46.230233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10ed33-0936-4d06-a5fd-a120ce5db493 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-9b10ed33-0936-4d06-a5fd-a120ce5db493 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:12:46.245468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:46.246491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:46.247565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:12:46.247565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:12:46.247565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:12:46.247565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:12:46.247565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:12:46.247565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:12:46.247565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:46.247565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:46.250702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 252/529] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:46.251366 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10ed33-0936-4d06-a5fd-a120ce5db493 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:46.305283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:46.317075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6f81e-a74e-4cfe-b4e3-0294686ea764 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:46.336408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:46.362004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4cb8a-5750-4826-b87d-d98fe4a1393c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:46.362674 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10ed33-0936-4d06-a5fd-a120ce5db493 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:46.362889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4cb8a-5750-4826-b87d-d98fe4a1393c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:46.363277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4cb8a-5750-4826-b87d-d98fe4a1393c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:46.363644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4cb8a-5750-4826-b87d-d98fe4a1393c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:46.398849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6567baa-7caa-473c-bb99-1a5a381d01a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:46.399467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6567baa-7caa-473c-bb99-1a5a381d01a4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:46.399847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6567baa-7caa-473c-bb99-1a5a381d01a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:46.400023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6567baa-7caa-473c-bb99-1a5a381d01a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:46.400805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6567baa-7caa-473c-bb99-1a5a381d01a4 None admin] RBAC: Adding query filter params (role.id=aed7c83a35d741538254f3d4775f4a0e, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=fce7db16c4904fb1b75ac7910f4470f8) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:46.401122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6567baa-7caa-473c-bb99-1a5a381d01a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:46.402574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6567baa-7caa-473c-bb99-1a5a381d01a4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:46.418437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 253/530] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:46 2022] GET /identity/v3/role_assignments?user.id=fce7db16c4904fb1b75ac7910f4470f8&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=aed7c83a35d741538254f3d4775f4a0e => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:46.418437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6567baa-7caa-473c-bb99-1a5a381d01a4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:46.454320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4cb8a-5750-4826-b87d-d98fe4a1393c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:46.456002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4cb8a-5750-4826-b87d-d98fe4a1393c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:46.545967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6567baa-7caa-473c-bb99-1a5a381d01a4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:46.559431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:46.587144 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc803317-c0d4-492a-9550-dd8226cf0a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:46.587144 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc803317-c0d4-492a-9550-dd8226cf0a48 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:46.587471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc803317-c0d4-492a-9550-dd8226cf0a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:46.587796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc803317-c0d4-492a-9550-dd8226cf0a48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:46.598466 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc803317-c0d4-492a-9550-dd8226cf0a48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:46.602674 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 278/531] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:46.603660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4cb8a-5750-4826-b87d-d98fe4a1393c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:46.603781 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc803317-c0d4-492a-9550-dd8226cf0a48 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-dc803317-c0d4-492a-9550-dd8226cf0a48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:12:46.617963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:46.619042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:46.619888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:12:46.619888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:12:46.619888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:12:46.619888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:12:46.619888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:12:46.619888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:12:46.619888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:46.619888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:46.619888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 254/532] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:46.621120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc803317-c0d4-492a-9550-dd8226cf0a48 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:46.630269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:46.725496 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4cb8a-5750-4826-b87d-d98fe4a1393c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:46.726071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc803317-c0d4-492a-9550-dd8226cf0a48 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:46.761453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cd42b-3fcb-4616-8ece-d2f13014b3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:46.762097 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cd42b-3fcb-4616-8ece-d2f13014b3cd None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:46.762378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cd42b-3fcb-4616-8ece-d2f13014b3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:46.762678 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cd42b-3fcb-4616-8ece-d2f13014b3cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:46.763269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29fbfb-56c6-423e-9bac-03475ae10739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:46.763984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29fbfb-56c6-423e-9bac-03475ae10739 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:46.764273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29fbfb-56c6-423e-9bac-03475ae10739 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:46.764655 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29fbfb-56c6-423e-9bac-03475ae10739 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:46.765517 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29fbfb-56c6-423e-9bac-03475ae10739 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:46.765836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29fbfb-56c6-423e-9bac-03475ae10739 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:46.767420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29fbfb-56c6-423e-9bac-03475ae10739 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:46.773817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cd42b-3fcb-4616-8ece-d2f13014b3cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:46.775304 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cd42b-3fcb-4616-8ece-d2f13014b3cd None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-df8cd42b-3fcb-4616-8ece-d2f13014b3cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:46.790086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:46.791042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:46.791924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:46.791924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:46.791924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:46.791924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:46.792135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 279/533] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:12:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:46.792135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29fbfb-56c6-423e-9bac-03475ae10739 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:46.796130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 255/534] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:46.797044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cd42b-3fcb-4616-8ece-d2f13014b3cd None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:46.824471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:46.879353 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:46.906320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29fbfb-56c6-423e-9bac-03475ae10739 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:46.911324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cd42b-3fcb-4616-8ece-d2f13014b3cd None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:46.945034 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2618f9-bdfd-41cf-bc0e-094dd8658e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:46.945652 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2618f9-bdfd-41cf-bc0e-094dd8658e2d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:46.945929 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2618f9-bdfd-41cf-bc0e-094dd8658e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:46.946206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2618f9-bdfd-41cf-bc0e-094dd8658e2d None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:46.946979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2618f9-bdfd-41cf-bc0e-094dd8658e2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:46.947283 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2618f9-bdfd-41cf-bc0e-094dd8658e2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:46.947518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23dd25-bf8e-48f6-b22c-b45f741a18af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:46.948136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23dd25-bf8e-48f6-b22c-b45f741a18af None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:46.948421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23dd25-bf8e-48f6-b22c-b45f741a18af None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:46.948699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23dd25-bf8e-48f6-b22c-b45f741a18af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:46.948801 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2618f9-bdfd-41cf-bc0e-094dd8658e2d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:46.949481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23dd25-bf8e-48f6-b22c-b45f741a18af None admin] RBAC: Adding query filter params (role.id=aed7c83a35d741538254f3d4775f4a0e, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=04899781f67746e193a05bdc004804cc) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:46.949793 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23dd25-bf8e-48f6-b22c-b45f741a18af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:46.951592 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23dd25-bf8e-48f6-b22c-b45f741a18af None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:46.957425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 256/535] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:46 2022] GET /identity/v3/role_assignments?user.id=04899781f67746e193a05bdc004804cc&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=aed7c83a35d741538254f3d4775f4a0e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:46.958230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23dd25-bf8e-48f6-b22c-b45f741a18af None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:46.977308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 280/536] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:12:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:46.978830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4a54e-d743-4d17-bb25-dd02179b4a46 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:46.979400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4a54e-d743-4d17-bb25-dd02179b4a46 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:46.979678 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4a54e-d743-4d17-bb25-dd02179b4a46 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:46.982156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 281/537] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:46.983005 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4a54e-d743-4d17-bb25-dd02179b4a46 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:47.069007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:47.093927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23dd25-bf8e-48f6-b22c-b45f741a18af None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:47.120406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4a54e-d743-4d17-bb25-dd02179b4a46 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:47.139071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3603c-4837-4d21-b873-91778363cf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:47.140062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3603c-4837-4d21-b873-91778363cf39 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:47.140551 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3603c-4837-4d21-b873-91778363cf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:47.141042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3603c-4837-4d21-b873-91778363cf39 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:47.141858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3603c-4837-4d21-b873-91778363cf39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:47.142269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3603c-4837-4d21-b873-91778363cf39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:47.143772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3603c-4837-4d21-b873-91778363cf39 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:47.160846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 257/538] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:47.160846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bba13-76e3-48ff-94ff-5cd763de780d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:47.160846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bba13-76e3-48ff-94ff-5cd763de780d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:47.160846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bba13-76e3-48ff-94ff-5cd763de780d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:47.170084 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176d8dd-35e5-4405-ad06-0479485ce694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:47.170972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176d8dd-35e5-4405-ad06-0479485ce694 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:47.171396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176d8dd-35e5-4405-ad06-0479485ce694 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:47.171814 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176d8dd-35e5-4405-ad06-0479485ce694 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:47.172767 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176d8dd-35e5-4405-ad06-0479485ce694 None admin] RBAC: Adding query filter params (role.id=aed7c83a35d741538254f3d4775f4a0e, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=d3b29a204dff42c399f0d143b3d0189f) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:47.173791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176d8dd-35e5-4405-ad06-0479485ce694 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:47.175749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176d8dd-35e5-4405-ad06-0479485ce694 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:47.179838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-039bba13-76e3-48ff-94ff-5cd763de780d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:47.181168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-039bba13-76e3-48ff-94ff-5cd763de780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:47.183090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 282/539] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:46 2022] GET /identity/v3/role_assignments?user.id=d3b29a204dff42c399f0d143b3d0189f&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=aed7c83a35d741538254f3d4775f4a0e => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:47.185409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176d8dd-35e5-4405-ad06-0479485ce694 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:47.204913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:47.261260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 258/540] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:47.285160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bba13-76e3-48ff-94ff-5cd763de780d None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:47.313230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176d8dd-35e5-4405-ad06-0479485ce694 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:47.383192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0868f47-2f05-4525-adde-17b8093ae55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:47.383921 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0868f47-2f05-4525-adde-17b8093ae55c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:47.384307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0868f47-2f05-4525-adde-17b8093ae55c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:47.384686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0868f47-2f05-4525-adde-17b8093ae55c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:47.400199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0868f47-2f05-4525-adde-17b8093ae55c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:47.401695 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0868f47-2f05-4525-adde-17b8093ae55c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:47.405341 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-f0868f47-2f05-4525-adde-17b8093ae55c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:12:47.422374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:47.423299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:47.424557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:12:47.424557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:12:47.424557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:12:47.424557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:12:47.424557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:12:47.424557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:12:47.424557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:47.424557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:47.424557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 283/541] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:47.435390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0868f47-2f05-4525-adde-17b8093ae55c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:47.441281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bba13-76e3-48ff-94ff-5cd763de780d None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:47.507833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b6d00-8a94-4201-93ca-adfcc92ce0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:47.508785 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b6d00-8a94-4201-93ca-adfcc92ce0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:47.509248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b6d00-8a94-4201-93ca-adfcc92ce0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:47.509701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b6d00-8a94-4201-93ca-adfcc92ce0f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:47.528543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b6d00-8a94-4201-93ca-adfcc92ce0f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-4d5b6d00-8a94-4201-93ca-adfcc92ce0f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:47.534599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:47.535482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:47.536268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:47.536268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:47.536268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:47.536268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:47.536268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:47.536268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:47.536268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:47.536268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:47.536268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:47.536268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:47.536268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:47.536268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:47.543195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 259/542] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:12:47.548739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:47.549630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b6d00-8a94-4201-93ca-adfcc92ce0f6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:47.627520 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0868f47-2f05-4525-adde-17b8093ae55c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:47.692041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66421ccc-3547-4a4a-8f47-10394a3c569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:47.692578 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66421ccc-3547-4a4a-8f47-10394a3c569c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:47.692859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66421ccc-3547-4a4a-8f47-10394a3c569c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:47.693679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66421ccc-3547-4a4a-8f47-10394a3c569c None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:47.694460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66421ccc-3547-4a4a-8f47-10394a3c569c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:47.694776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66421ccc-3547-4a4a-8f47-10394a3c569c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:47.696237 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66421ccc-3547-4a4a-8f47-10394a3c569c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:47.720615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 284/543] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:12:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:47.728585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66421ccc-3547-4a4a-8f47-10394a3c569c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:47.737770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b6d00-8a94-4201-93ca-adfcc92ce0f6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:47.797858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f38cb-9df4-4880-8f75-67760537841d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:47.804186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f38cb-9df4-4880-8f75-67760537841d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:47.804661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f38cb-9df4-4880-8f75-67760537841d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:47.805112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f38cb-9df4-4880-8f75-67760537841d None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:47.806004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f38cb-9df4-4880-8f75-67760537841d None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:47.806472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f38cb-9df4-4880-8f75-67760537841d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:47.807985 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f38cb-9df4-4880-8f75-67760537841d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:47.813005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:47.824911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 260/544] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:47.830742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f38cb-9df4-4880-8f75-67760537841d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:47.938605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66421ccc-3547-4a4a-8f47-10394a3c569c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:47.967651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:47.998981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01460967-4931-49fe-8453-b2737b8e0903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:47.999790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01460967-4931-49fe-8453-b2737b8e0903 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:48.000173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01460967-4931-49fe-8453-b2737b8e0903 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:48.000569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01460967-4931-49fe-8453-b2737b8e0903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:48.001462 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01460967-4931-49fe-8453-b2737b8e0903 None admin] RBAC: Adding query filter params (role.id=aed7c83a35d741538254f3d4775f4a0e, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=9ee0de72ba804ba491342a8ae82a44f7) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:48.002205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f38cb-9df4-4880-8f75-67760537841d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:48.004209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01460967-4931-49fe-8453-b2737b8e0903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:48.006340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01460967-4931-49fe-8453-b2737b8e0903 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:48.021852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 285/545] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:47 2022] GET /identity/v3/role_assignments?user.id=9ee0de72ba804ba491342a8ae82a44f7&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=aed7c83a35d741538254f3d4775f4a0e => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:48.047113 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63858d63-3365-4862-8e71-e05cfcd47418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:48.047951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63858d63-3365-4862-8e71-e05cfcd47418 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:48.048355 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63858d63-3365-4862-8e71-e05cfcd47418 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:48.048762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63858d63-3365-4862-8e71-e05cfcd47418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:48.061491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63858d63-3365-4862-8e71-e05cfcd47418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:48.063306 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63858d63-3365-4862-8e71-e05cfcd47418 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-63858d63-3365-4862-8e71-e05cfcd47418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:48.079837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:48.080742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:48.081567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:48.081567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:48.081567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:48.081567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:48.081880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 261/546] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:48.087482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01460967-4931-49fe-8453-b2737b8e0903 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:48.216296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01460967-4931-49fe-8453-b2737b8e0903 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:48.271166 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5d240-4fb3-4416-b92c-016005101ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:48.271749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5d240-4fb3-4416-b92c-016005101ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:48.272029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5d240-4fb3-4416-b92c-016005101ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:48.272303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5d240-4fb3-4416-b92c-016005101ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:48.273002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5d240-4fb3-4416-b92c-016005101ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:48.273308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5d240-4fb3-4416-b92c-016005101ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:48.274704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5d240-4fb3-4416-b92c-016005101ec8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:48.291945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 286/547] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:48.297642 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63858d63-3365-4862-8e71-e05cfcd47418 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:48.355729 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:48.409002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63858d63-3365-4862-8e71-e05cfcd47418 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:48.444204 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3855bb9-6357-4293-8064-2583d06c9313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:48.444848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855bb9-6357-4293-8064-2583d06c9313 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:48.445130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855bb9-6357-4293-8064-2583d06c9313 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:48.445406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855bb9-6357-4293-8064-2583d06c9313 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:48.454426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3855bb9-6357-4293-8064-2583d06c9313 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:48.455235 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3855bb9-6357-4293-8064-2583d06c9313 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a3855bb9-6357-4293-8064-2583d06c9313 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:12:48.466832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:48.467699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:48.469126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:48.469126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:48.469126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:12:48.469126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:12:48.469126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:12:48.469126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:12:48.469126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:12:48.469126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:12:48.469126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 22:12:48.469126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:48.469126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 262/548] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:12:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:48.473533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5d240-4fb3-4416-b92c-016005101ec8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:48.534849 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:48.596848 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5d240-4fb3-4416-b92c-016005101ec8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:48.643063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838d498-9380-499d-b653-5589fe3f55bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:48.643692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838d498-9380-499d-b653-5589fe3f55bc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:48.644035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838d498-9380-499d-b653-5589fe3f55bc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:48.644312 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838d498-9380-499d-b653-5589fe3f55bc None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:48.645122 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838d498-9380-499d-b653-5589fe3f55bc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:48.645430 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838d498-9380-499d-b653-5589fe3f55bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:48.646929 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838d498-9380-499d-b653-5589fe3f55bc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:48.666605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 287/549] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Aug 4 22:12:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:48.675320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3855bb9-6357-4293-8064-2583d06c9313 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:48.829121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3855bb9-6357-4293-8064-2583d06c9313 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:48.845978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:48.859889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba9fe4-4f1a-4e85-b899-ca80a1cbf671 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:48.860191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba9fe4-4f1a-4e85-b899-ca80a1cbf671 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:48.860453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba9fe4-4f1a-4e85-b899-ca80a1cbf671 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:48.861957 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 288/550] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:48.868883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8657fc4-27cd-45c0-9015-6c0057a7974f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:48.869183 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8657fc4-27cd-45c0-9015-6c0057a7974f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:48.869453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8657fc4-27cd-45c0-9015-6c0057a7974f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:48.877377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036af01a-7a49-4ec5-9d3f-55d8f7657cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:48.877377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036af01a-7a49-4ec5-9d3f-55d8f7657cbf None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:48.877377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036af01a-7a49-4ec5-9d3f-55d8f7657cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:48.877377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036af01a-7a49-4ec5-9d3f-55d8f7657cbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:48.895386 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d8657fc4-27cd-45c0-9015-6c0057a7974f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:48.898788 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d8657fc4-27cd-45c0-9015-6c0057a7974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:49.027578 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 289/551] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:49.028932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036af01a-7a49-4ec5-9d3f-55d8f7657cbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:49.030631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036af01a-7a49-4ec5-9d3f-55d8f7657cbf None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:49.080921 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8657fc4-27cd-45c0-9015-6c0057a7974f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:49.130445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:49.206640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 263/552] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:49.208253 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d45cb-5970-42f3-a4b9-b643d39593dc None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:49.208827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d45cb-5970-42f3-a4b9-b643d39593dc None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:49.209801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d45cb-5970-42f3-a4b9-b643d39593dc None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:49.211551 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 264/553] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:49.212583 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d45cb-5970-42f3-a4b9-b643d39593dc None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:49.226925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:49.229896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8657fc4-27cd-45c0-9015-6c0057a7974f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:49.273321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124da4d1-a8fa-47b7-9eec-55786daaff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:49.274022 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124da4d1-a8fa-47b7-9eec-55786daaff24 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:49.274308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124da4d1-a8fa-47b7-9eec-55786daaff24 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:49.274595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124da4d1-a8fa-47b7-9eec-55786daaff24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:49.287352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124da4d1-a8fa-47b7-9eec-55786daaff24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-124da4d1-a8fa-47b7-9eec-55786daaff24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:49.296650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:49.297702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:49.298613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:49.298613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:49.298613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:49.298613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:49.298613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:49.298613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:49.298613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:49.298613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:49.298613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:49.298613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:49.298613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:49.298613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:49.298613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 290/554] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:49.299809 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24032223-6e6a-48ea-ae8e-28ed746b88a9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:49.299973 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24032223-6e6a-48ea-ae8e-28ed746b88a9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:49.300278 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24032223-6e6a-48ea-ae8e-28ed746b88a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:49.328944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-24032223-6e6a-48ea-ae8e-28ed746b88a9 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:49.330611 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-24032223-6e6a-48ea-ae8e-28ed746b88a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:49.344022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d45cb-5970-42f3-a4b9-b643d39593dc None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:49.390186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eae910-4e8d-4be7-a25a-0a6056bcfeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:49.391455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eae910-4e8d-4be7-a25a-0a6056bcfeee None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:49.392079 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eae910-4e8d-4be7-a25a-0a6056bcfeee None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:49.392641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eae910-4e8d-4be7-a25a-0a6056bcfeee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:49.405781 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eae910-4e8d-4be7-a25a-0a6056bcfeee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:49.408269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eae910-4e8d-4be7-a25a-0a6056bcfeee None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:49.412691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 291/555] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:49.413737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24032223-6e6a-48ea-ae8e-28ed746b88a9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-84eae910-4e8d-4be7-a25a-0a6056bcfeee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:49.427474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:49.428977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:49.429838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:49.429838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:49.429838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:49.429838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:49.432068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 265/556] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:49.437422 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eae910-4e8d-4be7-a25a-0a6056bcfeee None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:49.440660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:49.529976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:49.550354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24032223-6e6a-48ea-ae8e-28ed746b88a9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:49.584710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eae910-4e8d-4be7-a25a-0a6056bcfeee None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:49.604439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9c638-f3c1-43a7-9774-34ccfb05e8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:49.605421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9c638-f3c1-43a7-9774-34ccfb05e8fc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:49.605810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9c638-f3c1-43a7-9774-34ccfb05e8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:49.606221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9c638-f3c1-43a7-9774-34ccfb05e8fc None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:49.607097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9c638-f3c1-43a7-9774-34ccfb05e8fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:49.607594 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9c638-f3c1-43a7-9774-34ccfb05e8fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:49.609341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9c638-f3c1-43a7-9774-34ccfb05e8fc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:49.620752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 292/557] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:49.621685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9c638-f3c1-43a7-9774-34ccfb05e8fc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:49.630089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9da60-bd7a-47eb-bb40-27d563a0573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:49.630891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9da60-bd7a-47eb-bb40-27d563a0573d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:49.631680 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9da60-bd7a-47eb-bb40-27d563a0573d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:49.631966 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9da60-bd7a-47eb-bb40-27d563a0573d None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:49.632669 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9da60-bd7a-47eb-bb40-27d563a0573d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:49.632983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9da60-bd7a-47eb-bb40-27d563a0573d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:49.635063 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9da60-bd7a-47eb-bb40-27d563a0573d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:49.648876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 266/558] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:49.650451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b495a-c6f2-49d9-9d83-21d4800bb51f None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:49.650954 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b495a-c6f2-49d9-9d83-21d4800bb51f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:49.651572 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b495a-c6f2-49d9-9d83-21d4800bb51f None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:49.653551 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 267/559] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:49.654358 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b495a-c6f2-49d9-9d83-21d4800bb51f None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:49.719644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:49.740150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9c638-f3c1-43a7-9774-34ccfb05e8fc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:49.777066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80b9fb-ce17-4308-be7d-c3f4cd305344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:49.777389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b495a-c6f2-49d9-9d83-21d4800bb51f None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:49.777709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80b9fb-ce17-4308-be7d-c3f4cd305344 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:49.778204 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80b9fb-ce17-4308-be7d-c3f4cd305344 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:49.778355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80b9fb-ce17-4308-be7d-c3f4cd305344 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:49.789437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80b9fb-ce17-4308-be7d-c3f4cd305344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-dc80b9fb-ce17-4308-be7d-c3f4cd305344 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:49.794850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:49.795761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:49.796651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:49.796651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:49.796651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:49.796651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:49.796651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:49.796651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:49.796651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:49.796651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:49.796651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:49.796651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:49.796651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:49.796651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:49.796651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 293/560] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:49.797331 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80b9fb-ce17-4308-be7d-c3f4cd305344 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:49.808104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:49.818682 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab777c5-2d93-41f9-81b0-3a984a7d769d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:49.819372 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab777c5-2d93-41f9-81b0-3a984a7d769d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:49.819656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab777c5-2d93-41f9-81b0-3a984a7d769d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:49.820071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab777c5-2d93-41f9-81b0-3a984a7d769d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:49.830768 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab777c5-2d93-41f9-81b0-3a984a7d769d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:49.832452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab777c5-2d93-41f9-81b0-3a984a7d769d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-1ab777c5-2d93-41f9-81b0-3a984a7d769d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:49.847347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:49.848305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:49.849217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:49.849217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:49.849217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:49.849217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:49.849217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 268/561] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:49.850724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f600e-b099-43ae-acc2-1484a893c2d1 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:49.850724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f600e-b099-43ae-acc2-1484a893c2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:49.850724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f600e-b099-43ae-acc2-1484a893c2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:49.868264 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-fa8f600e-b099-43ae-acc2-1484a893c2d1 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:49.869364 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-fa8f600e-b099-43ae-acc2-1484a893c2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:49.911839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80b9fb-ce17-4308-be7d-c3f4cd305344 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:49.945953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b9975-6e93-4844-afe6-ed3335dae68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:49.946703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 269/562] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:49.946829 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b9975-6e93-4844-afe6-ed3335dae68a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:49.947085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b9975-6e93-4844-afe6-ed3335dae68a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:49.947436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b9975-6e93-4844-afe6-ed3335dae68a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:49.948422 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f600e-b099-43ae-acc2-1484a893c2d1 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:49.957284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b9975-6e93-4844-afe6-ed3335dae68a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:49.959725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b9975-6e93-4844-afe6-ed3335dae68a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-902b9975-6e93-4844-afe6-ed3335dae68a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:12:49.972124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:49.973053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:49.973998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:12:49.973998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:12:49.973998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:12:49.973998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:12:49.973998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:12:49.973998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:12:49.973998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:49.973998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:49.973998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 294/563] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:49.975364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b9975-6e93-4844-afe6-ed3335dae68a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:49.977094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:50.063474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f600e-b099-43ae-acc2-1484a893c2d1 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:50.065732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:50.083391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b9975-6e93-4844-afe6-ed3335dae68a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:50.106222 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aad44-455d-41c8-b337-cca591c6a3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:50.106877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aad44-455d-41c8-b337-cca591c6a3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:50.107349 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aad44-455d-41c8-b337-cca591c6a3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:50.107472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aad44-455d-41c8-b337-cca591c6a3b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:50.108121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658aad44-455d-41c8-b337-cca591c6a3b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:50.108427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658aad44-455d-41c8-b337-cca591c6a3b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:50.109784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658aad44-455d-41c8-b337-cca591c6a3b1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:50.122630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 270/564] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:50.122630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aad44-455d-41c8-b337-cca591c6a3b1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:50.123759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cab58-9d46-4f1a-816d-2bb57736fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:50.124437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cab58-9d46-4f1a-816d-2bb57736fcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:50.124723 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cab58-9d46-4f1a-816d-2bb57736fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:50.125002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cab58-9d46-4f1a-816d-2bb57736fcb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:50.125698 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cab58-9d46-4f1a-816d-2bb57736fcb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:50.126003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cab58-9d46-4f1a-816d-2bb57736fcb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:50.127415 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cab58-9d46-4f1a-816d-2bb57736fcb6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:50.140394 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 295/565] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:50.143781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cab58-9d46-4f1a-816d-2bb57736fcb6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:50.211288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:50.225074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aad44-455d-41c8-b337-cca591c6a3b1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:50.254384 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cab58-9d46-4f1a-816d-2bb57736fcb6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:50.260529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496fff3-3b6d-4103-9d44-1016417b680f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:50.261172 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496fff3-3b6d-4103-9d44-1016417b680f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:50.261448 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496fff3-3b6d-4103-9d44-1016417b680f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:50.261718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496fff3-3b6d-4103-9d44-1016417b680f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:50.271909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496fff3-3b6d-4103-9d44-1016417b680f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-4496fff3-3b6d-4103-9d44-1016417b680f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:50.277167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:50.278299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:50.279198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:50.279198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:50.279198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:50.279198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:50.279198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:50.279198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:50.279198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:50.279198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:50.279198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:50.279198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:50.279198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:50.279198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:50.279198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 271/566] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:50.279895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496fff3-3b6d-4103-9d44-1016417b680f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:50.298521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13b10c-959f-428f-949e-8cf93ed4694d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:50.299446 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13b10c-959f-428f-949e-8cf93ed4694d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:50.299934 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13b10c-959f-428f-949e-8cf93ed4694d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:50.300390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13b10c-959f-428f-949e-8cf93ed4694d None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:50.301440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13b10c-959f-428f-949e-8cf93ed4694d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:50.301932 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13b10c-959f-428f-949e-8cf93ed4694d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:50.304234 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13b10c-959f-428f-949e-8cf93ed4694d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:50.306852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:50.318156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 296/567] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:50.319719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13b10c-959f-428f-949e-8cf93ed4694d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:50.385644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496fff3-3b6d-4103-9d44-1016417b680f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:50.422017 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13b10c-959f-428f-949e-8cf93ed4694d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:50.422951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99750c28-25ee-4e80-9174-712d68882623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:50.423588 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99750c28-25ee-4e80-9174-712d68882623 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:50.423896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99750c28-25ee-4e80-9174-712d68882623 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:50.424189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99750c28-25ee-4e80-9174-712d68882623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:50.434895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99750c28-25ee-4e80-9174-712d68882623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:50.436374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99750c28-25ee-4e80-9174-712d68882623 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-99750c28-25ee-4e80-9174-712d68882623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:50.452082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:50.452994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:50.459396 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:50.459396 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:50.459396 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:50.459396 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:50.459624 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:50.459698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 272/568] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:50.459698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99750c28-25ee-4e80-9174-712d68882623 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:50.467504 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e5ca1-77af-41e6-8aaa-c91eebee17dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:50.468157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e5ca1-77af-41e6-8aaa-c91eebee17dc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:50.468871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e5ca1-77af-41e6-8aaa-c91eebee17dc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:50.469151 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e5ca1-77af-41e6-8aaa-c91eebee17dc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:50.477670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e5ca1-77af-41e6-8aaa-c91eebee17dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:50.479173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e5ca1-77af-41e6-8aaa-c91eebee17dc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-163e5ca1-77af-41e6-8aaa-c91eebee17dc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:12:50.491755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:50.492916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:50.493885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:50.493885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:50.493885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:12:50.493885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:12:50.493885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:12:50.493885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:12:50.493885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:12:50.493885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:12:50.493885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 22:12:50.493885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:50.493885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 297/569] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:50.494532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e5ca1-77af-41e6-8aaa-c91eebee17dc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:50.547761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:50.572258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99750c28-25ee-4e80-9174-712d68882623 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:50.597238 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e5ca1-77af-41e6-8aaa-c91eebee17dc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:50.606616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd726d-6279-44e4-9dbb-2fe9e1f96f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:50.607225 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd726d-6279-44e4-9dbb-2fe9e1f96f69 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:50.607560 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd726d-6279-44e4-9dbb-2fe9e1f96f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:50.607840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd726d-6279-44e4-9dbb-2fe9e1f96f69 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:50.608548 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd726d-6279-44e4-9dbb-2fe9e1f96f69 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:50.608858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd726d-6279-44e4-9dbb-2fe9e1f96f69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:50.610221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd726d-6279-44e4-9dbb-2fe9e1f96f69 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:50.619386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 273/570] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:50.620214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd726d-6279-44e4-9dbb-2fe9e1f96f69 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:50.634719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91baabb1-5688-4c51-b400-196c52c0c514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:50.635328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baabb1-5688-4c51-b400-196c52c0c514 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:50.635607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baabb1-5688-4c51-b400-196c52c0c514 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:50.635933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91baabb1-5688-4c51-b400-196c52c0c514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:50.636655 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91baabb1-5688-4c51-b400-196c52c0c514 None admin] RBAC: Adding query filter params (role.id=aed7c83a35d741538254f3d4775f4a0e, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=aa5bf773ed3a4f1e916671a22c65f031) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:50.636965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91baabb1-5688-4c51-b400-196c52c0c514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:50.638424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91baabb1-5688-4c51-b400-196c52c0c514 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:50.643828 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 298/571] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:50 2022] GET /identity/v3/role_assignments?user.id=aa5bf773ed3a4f1e916671a22c65f031&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=aed7c83a35d741538254f3d4775f4a0e => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:50.644914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91baabb1-5688-4c51-b400-196c52c0c514 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:50.698158 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:50.737080 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd726d-6279-44e4-9dbb-2fe9e1f96f69 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:50.757669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91baabb1-5688-4c51-b400-196c52c0c514 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:50.773015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbead4b-9da0-48de-bb6c-09af949e7ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:50.773644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbead4b-9da0-48de-bb6c-09af949e7ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:50.773923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbead4b-9da0-48de-bb6c-09af949e7ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:50.774196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbead4b-9da0-48de-bb6c-09af949e7ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:50.774928 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbead4b-9da0-48de-bb6c-09af949e7ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:50.775235 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbead4b-9da0-48de-bb6c-09af949e7ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:50.776612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbead4b-9da0-48de-bb6c-09af949e7ba0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:50.786209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:50.791127 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 274/572] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:50.792417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113e937-0e42-478b-ac7b-5ac6da002794 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:50.793739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113e937-0e42-478b-ac7b-5ac6da002794 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:50.794663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113e937-0e42-478b-ac7b-5ac6da002794 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:50.795437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 275/573] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:50.796398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113e937-0e42-478b-ac7b-5ac6da002794 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:50.804303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c440c-ae2e-4f46-91b9-f4f5a9d64162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:50.804947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c440c-ae2e-4f46-91b9-f4f5a9d64162 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:50.805229 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c440c-ae2e-4f46-91b9-f4f5a9d64162 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:50.805506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c440c-ae2e-4f46-91b9-f4f5a9d64162 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:50.806315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c440c-ae2e-4f46-91b9-f4f5a9d64162 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:50.806676 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c440c-ae2e-4f46-91b9-f4f5a9d64162 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:50.808204 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c440c-ae2e-4f46-91b9-f4f5a9d64162 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:50.833174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 299/574] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Aug 4 22:12:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:50.833174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c440c-ae2e-4f46-91b9-f4f5a9d64162 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:50.904727 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113e937-0e42-478b-ac7b-5ac6da002794 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:50.940356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c95633-0294-4154-8ab4-dbb57ceb4ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:50.941059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c95633-0294-4154-8ab4-dbb57ceb4ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:50.941338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c95633-0294-4154-8ab4-dbb57ceb4ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:50.941609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c95633-0294-4154-8ab4-dbb57ceb4ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:50.941940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c440c-ae2e-4f46-91b9-f4f5a9d64162 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:50.946230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:50.953828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c95633-0294-4154-8ab4-dbb57ceb4ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:50.955329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c95633-0294-4154-8ab4-dbb57ceb4ab2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-83c95633-0294-4154-8ab4-dbb57ceb4ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:50.977190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:50.978665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:50.979584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:50.979584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:50.979584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:50.979584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:50.979584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 276/575] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:50.979877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dc865-0d5c-4c79-bfe7-8594d8906508 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:50.979947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dc865-0d5c-4c79-bfe7-8594d8906508 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:50.980586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dc865-0d5c-4c79-bfe7-8594d8906508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:50.990816 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ec444-6940-46a4-bbe6-65a90f56cd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:50.991461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ec444-6940-46a4-bbe6-65a90f56cd96 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:50.991745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ec444-6940-46a4-bbe6-65a90f56cd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:50.992019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ec444-6940-46a4-bbe6-65a90f56cd96 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:50.998556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-026dc865-0d5c-4c79-bfe7-8594d8906508 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:50.999731 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-026dc865-0d5c-4c79-bfe7-8594d8906508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:50.999854 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ec444-6940-46a4-bbe6-65a90f56cd96 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:51.001247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ec444-6940-46a4-bbe6-65a90f56cd96 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-679ec444-6940-46a4-bbe6-65a90f56cd96 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:12:51.013350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:51.014281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:51.015537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:51.015537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:51.015537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:12:51.015537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:12:51.015537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:12:51.015537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:12:51.015537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:12:51.015537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:12:51.015537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:12:51.015537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:51.015537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 300/576] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 4 22:12:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:51.015537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ec444-6940-46a4-bbe6-65a90f56cd96 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:51.053944 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:51.078468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 277/577] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:51.078468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dc865-0d5c-4c79-bfe7-8594d8906508 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:51.131156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ec444-6940-46a4-bbe6-65a90f56cd96 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:51.168451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7cb86-b15c-4e05-af96-f42391a09a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:51.169130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7cb86-b15c-4e05-af96-f42391a09a52 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:51.169552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7cb86-b15c-4e05-af96-f42391a09a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:51.170250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7cb86-b15c-4e05-af96-f42391a09a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:51.181708 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7cb86-b15c-4e05-af96-f42391a09a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:51.183499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7cb86-b15c-4e05-af96-f42391a09a52 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:51.192450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dc865-0d5c-4c79-bfe7-8594d8906508 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-7ee7cb86-b15c-4e05-af96-f42391a09a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:51.198728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:51.199824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:51.205688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:51.205688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:51.205688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:51.205688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:51.205688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 301/578] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:51.205688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7cb86-b15c-4e05-af96-f42391a09a52 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:51.222780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:51.235983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff747d48-80b7-4332-a48d-450c3b9ec033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:51.236596 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff747d48-80b7-4332-a48d-450c3b9ec033 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:51.236869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff747d48-80b7-4332-a48d-450c3b9ec033 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:51.237137 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff747d48-80b7-4332-a48d-450c3b9ec033 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:51.237821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff747d48-80b7-4332-a48d-450c3b9ec033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:51.238117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff747d48-80b7-4332-a48d-450c3b9ec033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:51.239502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff747d48-80b7-4332-a48d-450c3b9ec033 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:51.255228 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 278/579] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:51.255228 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff747d48-80b7-4332-a48d-450c3b9ec033 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:51.304299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:51.321588 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7cb86-b15c-4e05-af96-f42391a09a52 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:51.360021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b538c8-21c9-44c6-9513-c73fadde0c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:51.360814 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b538c8-21c9-44c6-9513-c73fadde0c5f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:51.361132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b538c8-21c9-44c6-9513-c73fadde0c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:51.361406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b538c8-21c9-44c6-9513-c73fadde0c5f None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:51.362214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b538c8-21c9-44c6-9513-c73fadde0c5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:51.362556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b538c8-21c9-44c6-9513-c73fadde0c5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:51.364000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b538c8-21c9-44c6-9513-c73fadde0c5f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:51.371392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff747d48-80b7-4332-a48d-450c3b9ec033 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:51.383831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 302/580] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 4 22:12:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:51.384683 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b538c8-21c9-44c6-9513-c73fadde0c5f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:51.412928 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015f46e-9e26-4e2c-ba23-6fcdcc8b6a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:51.413563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015f46e-9e26-4e2c-ba23-6fcdcc8b6a2c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:51.413832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015f46e-9e26-4e2c-ba23-6fcdcc8b6a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:51.414103 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015f46e-9e26-4e2c-ba23-6fcdcc8b6a2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:51.424849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015f46e-9e26-4e2c-ba23-6fcdcc8b6a2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-6015f46e-9e26-4e2c-ba23-6fcdcc8b6a2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:51.430120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:51.431331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:51.432183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:51.432183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:51.432183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:51.432183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:51.432183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:51.432183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:51.432183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:51.432183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:51.432183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:51.432183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:51.432183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:51.432183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:51.432183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 279/581] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:51.432183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015f46e-9e26-4e2c-ba23-6fcdcc8b6a2c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:51.469810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:51.495649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b538c8-21c9-44c6-9513-c73fadde0c5f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:51.531183 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64627a12-f5c9-4cfa-b291-979b62352638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:51.531791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64627a12-f5c9-4cfa-b291-979b62352638 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:51.532068 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64627a12-f5c9-4cfa-b291-979b62352638 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:51.532338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64627a12-f5c9-4cfa-b291-979b62352638 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:51.533018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64627a12-f5c9-4cfa-b291-979b62352638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:51.533326 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64627a12-f5c9-4cfa-b291-979b62352638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:51.534725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64627a12-f5c9-4cfa-b291-979b62352638 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:51.546114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015f46e-9e26-4e2c-ba23-6fcdcc8b6a2c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:51.550695 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 303/582] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:51.550695 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64627a12-f5c9-4cfa-b291-979b62352638 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:51.551586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:51.590438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a78a01-606d-4656-a0f6-80da656505b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:51.591093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a78a01-606d-4656-a0f6-80da656505b2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:51.591378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a78a01-606d-4656-a0f6-80da656505b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:51.591656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a78a01-606d-4656-a0f6-80da656505b2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:51.601491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a78a01-606d-4656-a0f6-80da656505b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:51.603027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a78a01-606d-4656-a0f6-80da656505b2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-79a78a01-606d-4656-a0f6-80da656505b2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:12:51.614233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:51.615663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:51.616590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:51.616590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:51.616590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:12:51.616590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:12:51.616590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:12:51.616590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:12:51.616590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:12:51.616590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:12:51.616590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 22:12:51.616590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:51.616590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 280/583] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:51.616590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a78a01-606d-4656-a0f6-80da656505b2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:51.660475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64627a12-f5c9-4cfa-b291-979b62352638 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:51.698574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed78a2d-11f1-4058-94b2-fb594d3acd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:51.699140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed78a2d-11f1-4058-94b2-fb594d3acd03 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:51.699419 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed78a2d-11f1-4058-94b2-fb594d3acd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:51.699692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed78a2d-11f1-4058-94b2-fb594d3acd03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:51.702030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:51.711876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed78a2d-11f1-4058-94b2-fb594d3acd03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:51.713552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed78a2d-11f1-4058-94b2-fb594d3acd03 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1ed78a2d-11f1-4058-94b2-fb594d3acd03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:51.728851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:51.729817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:51.730740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:51.730740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:51.730740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:51.730740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:51.730740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 304/584] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:51.731609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed78a2d-11f1-4058-94b2-fb594d3acd03 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:51.753209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a78a01-606d-4656-a0f6-80da656505b2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:51.792061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2192e7-dc43-427f-a26b-ffa252695071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:51.793286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2192e7-dc43-427f-a26b-ffa252695071 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:51.793666 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2192e7-dc43-427f-a26b-ffa252695071 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:51.793945 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2192e7-dc43-427f-a26b-ffa252695071 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:51.794682 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2192e7-dc43-427f-a26b-ffa252695071 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:51.794989 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2192e7-dc43-427f-a26b-ffa252695071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:51.796614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2192e7-dc43-427f-a26b-ffa252695071 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:51.810503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 281/585] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:51.810503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2192e7-dc43-427f-a26b-ffa252695071 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:51.835607 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:51.847078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed78a2d-11f1-4058-94b2-fb594d3acd03 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:51.883342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff4f99-ae34-4532-ad8c-02802149b565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:51.883342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff4f99-ae34-4532-ad8c-02802149b565 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:51.883712 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff4f99-ae34-4532-ad8c-02802149b565 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:51.883915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff4f99-ae34-4532-ad8c-02802149b565 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:51.890588 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff4f99-ae34-4532-ad8c-02802149b565 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:51.892081 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff4f99-ae34-4532-ad8c-02802149b565 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-76ff4f99-ae34-4532-ad8c-02802149b565 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:12:51.905161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:51.906210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:51.907295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:12:51.907295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:12:51.907295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:12:51.907295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:12:51.907295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:12:51.907295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:12:51.907295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:51.907295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:51.907295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 305/586] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:51.911370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff4f99-ae34-4532-ad8c-02802149b565 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:51.917474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2192e7-dc43-427f-a26b-ffa252695071 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:51.951863 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22229d-e0d1-4dd3-ab61-3d6bc6389691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:51.952498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22229d-e0d1-4dd3-ab61-3d6bc6389691 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:51.952843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22229d-e0d1-4dd3-ab61-3d6bc6389691 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:51.953188 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22229d-e0d1-4dd3-ab61-3d6bc6389691 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:51.954046 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22229d-e0d1-4dd3-ab61-3d6bc6389691 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:51.954461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22229d-e0d1-4dd3-ab61-3d6bc6389691 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:51.955884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22229d-e0d1-4dd3-ab61-3d6bc6389691 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:51.962096 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:51.978785 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 282/587] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Aug 4 22:12:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:51.978785 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22229d-e0d1-4dd3-ab61-3d6bc6389691 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:52.038029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff4f99-ae34-4532-ad8c-02802149b565 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:52.062016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:52.075096 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b6e6f-9cb6-426b-b375-9a1b2ebdcf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:52.075804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6e6f-9cb6-426b-b375-9a1b2ebdcf24 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:52.076520 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6e6f-9cb6-426b-b375-9a1b2ebdcf24 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:52.076705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6e6f-9cb6-426b-b375-9a1b2ebdcf24 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:52.077378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b6e6f-9cb6-426b-b375-9a1b2ebdcf24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:52.077686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b6e6f-9cb6-426b-b375-9a1b2ebdcf24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:52.079111 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b6e6f-9cb6-426b-b375-9a1b2ebdcf24 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:52.082934 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22229d-e0d1-4dd3-ab61-3d6bc6389691 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:52.091771 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 306/588] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:52.096788 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b6e6f-9cb6-426b-b375-9a1b2ebdcf24 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:52.119647 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc20e0-9006-4e51-aa18-88dcced68e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:52.120283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc20e0-9006-4e51-aa18-88dcced68e58 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:52.120565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc20e0-9006-4e51-aa18-88dcced68e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:52.120841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc20e0-9006-4e51-aa18-88dcced68e58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:52.130822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc20e0-9006-4e51-aa18-88dcced68e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:52.132257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc20e0-9006-4e51-aa18-88dcced68e58 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-accc20e0-9006-4e51-aa18-88dcced68e58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:52.146753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:52.147767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:52.148656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:52.148656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:52.148656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:52.148656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:52.148656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 283/589] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:52.148656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc20e0-9006-4e51-aa18-88dcced68e58 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:52.208212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b6e6f-9cb6-426b-b375-9a1b2ebdcf24 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:52.217023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:52.247173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea343dd-68d8-4c22-84e6-cb1ff93c20c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:52.248143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea343dd-68d8-4c22-84e6-cb1ff93c20c1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:52.248461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea343dd-68d8-4c22-84e6-cb1ff93c20c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:52.248714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea343dd-68d8-4c22-84e6-cb1ff93c20c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:52.249464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea343dd-68d8-4c22-84e6-cb1ff93c20c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:52.249772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea343dd-68d8-4c22-84e6-cb1ff93c20c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:52.252220 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea343dd-68d8-4c22-84e6-cb1ff93c20c1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:52.255531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc20e0-9006-4e51-aa18-88dcced68e58 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:52.263719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 307/590] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:12:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:52.264525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea343dd-68d8-4c22-84e6-cb1ff93c20c1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:52.297282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302a13b-90a0-4b41-a8e4-8cd8a3d6d10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:52.298520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302a13b-90a0-4b41-a8e4-8cd8a3d6d10e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:52.298889 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302a13b-90a0-4b41-a8e4-8cd8a3d6d10e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:52.299232 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302a13b-90a0-4b41-a8e4-8cd8a3d6d10e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:52.301160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:52.312816 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302a13b-90a0-4b41-a8e4-8cd8a3d6d10e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:52.314522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302a13b-90a0-4b41-a8e4-8cd8a3d6d10e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-0302a13b-90a0-4b41-a8e4-8cd8a3d6d10e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:52.330640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:52.331737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:52.332925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:52.332925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:52.332925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:52.332925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:52.332925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 284/591] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:52.333208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302a13b-90a0-4b41-a8e4-8cd8a3d6d10e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:52.373493 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea343dd-68d8-4c22-84e6-cb1ff93c20c1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:52.408768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0171df-d628-4e93-aae9-f483857c8130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:52.409420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0171df-d628-4e93-aae9-f483857c8130 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:52.409705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0171df-d628-4e93-aae9-f483857c8130 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:52.409981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0171df-d628-4e93-aae9-f483857c8130 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:52.420592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0171df-d628-4e93-aae9-f483857c8130 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:52.422056 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0171df-d628-4e93-aae9-f483857c8130 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-6e0171df-d628-4e93-aae9-f483857c8130 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:12:52.434261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:52.435396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:52.436571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:12:52.436571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:12:52.436571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:12:52.436571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:12:52.436571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:12:52.436571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:12:52.436571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:52.436571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:52.436571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 308/592] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:52.437051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0171df-d628-4e93-aae9-f483857c8130 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:52.443847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302a13b-90a0-4b41-a8e4-8cd8a3d6d10e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:52.470950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:52.485513 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aece753-59c2-4860-9e1e-15cb8ad2c0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:52.486559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aece753-59c2-4860-9e1e-15cb8ad2c0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:52.486864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aece753-59c2-4860-9e1e-15cb8ad2c0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:52.487151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aece753-59c2-4860-9e1e-15cb8ad2c0e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:52.487885 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aece753-59c2-4860-9e1e-15cb8ad2c0e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:52.488195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aece753-59c2-4860-9e1e-15cb8ad2c0e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:52.490012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aece753-59c2-4860-9e1e-15cb8ad2c0e2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:52.503652 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 285/593] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:52.504466 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aece753-59c2-4860-9e1e-15cb8ad2c0e2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:52.555536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:52.557515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0171df-d628-4e93-aae9-f483857c8130 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:52.594917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad57a8-1af9-4faa-9605-505516080620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:52.595816 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad57a8-1af9-4faa-9605-505516080620 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:52.596344 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad57a8-1af9-4faa-9605-505516080620 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:52.596770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad57a8-1af9-4faa-9605-505516080620 None admin] PATH_INFO: `/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/fce7db16c4904fb1b75ac7910f4470f8/roles/aed7c83a35d741538254f3d4775f4a0e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:52.611879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aece753-59c2-4860-9e1e-15cb8ad2c0e2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:52.613495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad57a8-1af9-4faa-9605-505516080620 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe696ab97a143959fa7e33cda768cfc, user_id=fce7db16c4904fb1b75ac7910f4470f8, role_id=aed7c83a35d741538254f3d4775f4a0e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:52.615345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad57a8-1af9-4faa-9605-505516080620 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:52.633481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 309/594] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:12:52 2022] PUT /identity/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/fce7db16c4904fb1b75ac7910f4470f8/roles/aed7c83a35d741538254f3d4775f4a0e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:12:52.633481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad57a8-1af9-4faa-9605-505516080620 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:52.658020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e22b19-9dd9-47a8-a026-f38c109d4711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:52.658954 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e22b19-9dd9-47a8-a026-f38c109d4711 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:52.659345 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e22b19-9dd9-47a8-a026-f38c109d4711 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:52.659728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e22b19-9dd9-47a8-a026-f38c109d4711 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:52.660612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e22b19-9dd9-47a8-a026-f38c109d4711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:52.661041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e22b19-9dd9-47a8-a026-f38c109d4711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:52.663211 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e22b19-9dd9-47a8-a026-f38c109d4711 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:52.676284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 286/595] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:52.677168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e22b19-9dd9-47a8-a026-f38c109d4711 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:52.741993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:52.769194 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad57a8-1af9-4faa-9605-505516080620 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:52.796708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e22b19-9dd9-47a8-a026-f38c109d4711 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:52.805729 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:52.813345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38145f3e-b205-42e1-aed6-ec953dc987cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:52.813981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145f3e-b205-42e1-aed6-ec953dc987cb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:52.814262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145f3e-b205-42e1-aed6-ec953dc987cb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:52.814586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145f3e-b205-42e1-aed6-ec953dc987cb None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:52.815347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38145f3e-b205-42e1-aed6-ec953dc987cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:52.815664 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38145f3e-b205-42e1-aed6-ec953dc987cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:52.817087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38145f3e-b205-42e1-aed6-ec953dc987cb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:52.829338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 310/596] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:12:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:52.830862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f8d4-c1c9-45ab-b0e5-78b8d4c0d3e8 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:52.831303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f8d4-c1c9-45ab-b0e5-78b8d4c0d3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:52.831727 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f8d4-c1c9-45ab-b0e5-78b8d4c0d3e8 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:52.833452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 311/597] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:52.834985 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86f8d4-c1c9-45ab-b0e5-78b8d4c0d3e8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:52.838781 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d9198-c45f-41de-adbf-c935787afbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:52.839433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d9198-c45f-41de-adbf-c935787afbbe None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:52.839718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d9198-c45f-41de-adbf-c935787afbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:52.839998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d9198-c45f-41de-adbf-c935787afbbe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:52.847972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d9198-c45f-41de-adbf-c935787afbbe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:52.849479 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d9198-c45f-41de-adbf-c935787afbbe None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-259d9198-c45f-41de-adbf-c935787afbbe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:12:52.861456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:52.862395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:52.863369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:52.863369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:52.863369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:12:52.863369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:12:52.863369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:12:52.863369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:12:52.863369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:12:52.863369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:12:52.863369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 22:12:52.863369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:52.863369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 287/598] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:52.864034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d9198-c45f-41de-adbf-c935787afbbe None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:52.949340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86f8d4-c1c9-45ab-b0e5-78b8d4c0d3e8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:52.971479 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d9198-c45f-41de-adbf-c935787afbbe None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:52.990343 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af650c-7aa6-464f-989d-f368f39c4993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:52.991434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af650c-7aa6-464f-989d-f368f39c4993 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:52.991727 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af650c-7aa6-464f-989d-f368f39c4993 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:52.992060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af650c-7aa6-464f-989d-f368f39c4993 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:52.995311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:53.003485 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af650c-7aa6-464f-989d-f368f39c4993 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:53.004994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af650c-7aa6-464f-989d-f368f39c4993 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:53.013822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdab5e-143d-4676-a4b8-6a69648b476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:53.014532 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdab5e-143d-4676-a4b8-6a69648b476e None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:53.014820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdab5e-143d-4676-a4b8-6a69648b476e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:53.015097 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdab5e-143d-4676-a4b8-6a69648b476e None admin] PATH_INFO: `/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/04899781f67746e193a05bdc004804cc/roles/aed7c83a35d741538254f3d4775f4a0e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-65af650c-7aa6-464f-989d-f368f39c4993 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:12:53.017543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:53.018397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:53.019310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:12:53.019310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:12:53.019310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:12:53.019310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:12:53.019310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:12:53.019310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:12:53.019310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:53.019310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:53.023975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 312/599] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:53.025235 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66720c-1d67-4350-92b6-b50397977c5f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:53.025527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66720c-1d67-4350-92b6-b50397977c5f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:53.025808 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66720c-1d67-4350-92b6-b50397977c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:53.033895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdab5e-143d-4676-a4b8-6a69648b476e None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe696ab97a143959fa7e33cda768cfc, user_id=04899781f67746e193a05bdc004804cc, role_id=aed7c83a35d741538254f3d4775f4a0e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:53.035409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdab5e-143d-4676-a4b8-6a69648b476e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:53.043925 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8d66720c-1d67-4350-92b6-b50397977c5f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:53.045254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8d66720c-1d67-4350-92b6-b50397977c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:53.054447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 288/600] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:12:52 2022] PUT /identity/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/04899781f67746e193a05bdc004804cc/roles/aed7c83a35d741538254f3d4775f4a0e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:12:53.054447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdab5e-143d-4676-a4b8-6a69648b476e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:53.082810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:53.131037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 313/601] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:53.132031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66720c-1d67-4350-92b6-b50397977c5f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:53.201628 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdab5e-143d-4676-a4b8-6a69648b476e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:53.241817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3045f-f664-4e41-bafa-ee1b1ada1813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:53.242531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3045f-f664-4e41-bafa-ee1b1ada1813 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:53.242767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3045f-f664-4e41-bafa-ee1b1ada1813 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:53.243045 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3045f-f664-4e41-bafa-ee1b1ada1813 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:53.243854 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3045f-f664-4e41-bafa-ee1b1ada1813 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:53.244166 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3045f-f664-4e41-bafa-ee1b1ada1813 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:53.246369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3045f-f664-4e41-bafa-ee1b1ada1813 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:53.262173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66720c-1d67-4350-92b6-b50397977c5f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:53.270041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 289/602] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Aug 4 22:12:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:53.271233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3045f-f664-4e41-bafa-ee1b1ada1813 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:53.294155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:53.304453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b3f0b-72d8-4304-91b0-a20ebd42dd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:53.305136 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b3f0b-72d8-4304-91b0-a20ebd42dd1b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:53.305424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b3f0b-72d8-4304-91b0-a20ebd42dd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:53.305763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b3f0b-72d8-4304-91b0-a20ebd42dd1b None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:53.306551 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b3f0b-72d8-4304-91b0-a20ebd42dd1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:53.306867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b3f0b-72d8-4304-91b0-a20ebd42dd1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:53.308697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b3f0b-72d8-4304-91b0-a20ebd42dd1b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:53.324984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 314/603] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:12:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:53.326338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b3f0b-72d8-4304-91b0-a20ebd42dd1b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:53.357531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:53.385330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3045f-f664-4e41-bafa-ee1b1ada1813 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:53.422189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315152e-e034-4e89-bc22-cf6aa74b6b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:53.423224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315152e-e034-4e89-bc22-cf6aa74b6b41 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:53.423758 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315152e-e034-4e89-bc22-cf6aa74b6b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:53.424335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315152e-e034-4e89-bc22-cf6aa74b6b41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:53.436085 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315152e-e034-4e89-bc22-cf6aa74b6b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:53.440817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b3f0b-72d8-4304-91b0-a20ebd42dd1b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-9315152e-e034-4e89-bc22-cf6aa74b6b41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:53.442268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:53.443757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:53.444968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:53.444968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:53.444968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:53.444968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:53.444968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:53.444968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:53.444968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:53.444968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:53.444968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:53.444968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:53.444968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:53.444968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:53.447629 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 290/604] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:53.448599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315152e-e034-4e89-bc22-cf6aa74b6b41 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:53.488151 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4a31f-d0cd-40e1-9090-5f9ddc8794d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:53.488699 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4a31f-d0cd-40e1-9090-5f9ddc8794d3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:53.488989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4a31f-d0cd-40e1-9090-5f9ddc8794d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:53.489262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4a31f-d0cd-40e1-9090-5f9ddc8794d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:53.503827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4a31f-d0cd-40e1-9090-5f9ddc8794d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:53.505525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4a31f-d0cd-40e1-9090-5f9ddc8794d3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-a9d4a31f-d0cd-40e1-9090-5f9ddc8794d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:53.521580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:53.522799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:53.523685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:53.523685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:53.523685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:53.523685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:53.523685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 315/605] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:53.523685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4a31f-d0cd-40e1-9090-5f9ddc8794d3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:53.561611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315152e-e034-4e89-bc22-cf6aa74b6b41 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:53.568667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:53.604656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f966c9-4a69-44e1-a0c8-0ec986a1f0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:53.606002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f966c9-4a69-44e1-a0c8-0ec986a1f0f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:53.606692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f966c9-4a69-44e1-a0c8-0ec986a1f0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:53.607618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f966c9-4a69-44e1-a0c8-0ec986a1f0f3 None admin] PATH_INFO: `/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/d3b29a204dff42c399f0d143b3d0189f/roles/aed7c83a35d741538254f3d4775f4a0e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:53.611402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:53.633427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f966c9-4a69-44e1-a0c8-0ec986a1f0f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe696ab97a143959fa7e33cda768cfc, user_id=d3b29a204dff42c399f0d143b3d0189f, role_id=aed7c83a35d741538254f3d4775f4a0e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:53.635377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f966c9-4a69-44e1-a0c8-0ec986a1f0f3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:53.644699 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4a31f-d0cd-40e1-9090-5f9ddc8794d3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:53.651289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 291/606] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:12:53 2022] PUT /identity/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/d3b29a204dff42c399f0d143b3d0189f/roles/aed7c83a35d741538254f3d4775f4a0e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:12:53.652385 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f966c9-4a69-44e1-a0c8-0ec986a1f0f3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:53.694141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7e9b2-22c1-4cac-9c3e-04a58cad400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:53.695229 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7e9b2-22c1-4cac-9c3e-04a58cad400c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:53.695753 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7e9b2-22c1-4cac-9c3e-04a58cad400c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:53.696274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7e9b2-22c1-4cac-9c3e-04a58cad400c None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:53.697320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7e9b2-22c1-4cac-9c3e-04a58cad400c None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:53.697844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7e9b2-22c1-4cac-9c3e-04a58cad400c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:53.707196 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7e9b2-22c1-4cac-9c3e-04a58cad400c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:53.721960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 316/607] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:53.728781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7e9b2-22c1-4cac-9c3e-04a58cad400c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:53.832823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f966c9-4a69-44e1-a0c8-0ec986a1f0f3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:53.880030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af4793-f82f-4ab6-be87-9469b78be3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:53.881143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4793-f82f-4ab6-be87-9469b78be3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:53.881685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4793-f82f-4ab6-be87-9469b78be3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:53.882238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af4793-f82f-4ab6-be87-9469b78be3b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:53.883263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af4793-f82f-4ab6-be87-9469b78be3b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:53.883845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af4793-f82f-4ab6-be87-9469b78be3b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:53.886211 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af4793-f82f-4ab6-be87-9469b78be3b4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:53.893159 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:53.896572 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7e9b2-22c1-4cac-9c3e-04a58cad400c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:53.907754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 292/608] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:53.916180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af4793-f82f-4ab6-be87-9469b78be3b4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:53.941202 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa17b18-de26-4409-ad15-85be673a7516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:53.942571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa17b18-de26-4409-ad15-85be673a7516 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:53.943099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa17b18-de26-4409-ad15-85be673a7516 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:53.943584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa17b18-de26-4409-ad15-85be673a7516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:53.956151 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa17b18-de26-4409-ad15-85be673a7516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:53.957963 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa17b18-de26-4409-ad15-85be673a7516 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-9fa17b18-de26-4409-ad15-85be673a7516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:53.974025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:53.975627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:53.976522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:53.976522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:53.976522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:53.976522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:53.977530 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:53.979902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 317/609] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:53.985537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa17b18-de26-4409-ad15-85be673a7516 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:54.068233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af4793-f82f-4ab6-be87-9469b78be3b4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:54.127212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774907cf-11d8-4abd-9711-331bb0f04faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:54.127796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774907cf-11d8-4abd-9711-331bb0f04faf None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:54.128076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774907cf-11d8-4abd-9711-331bb0f04faf None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:54.128349 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774907cf-11d8-4abd-9711-331bb0f04faf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:54.139841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774907cf-11d8-4abd-9711-331bb0f04faf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:54.141545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774907cf-11d8-4abd-9711-331bb0f04faf None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:54.151280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa17b18-de26-4409-ad15-85be673a7516 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-774907cf-11d8-4abd-9711-331bb0f04faf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:12:54.158313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:54.159239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:54.160158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:12:54.160158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:12:54.160158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:12:54.160158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:12:54.160158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:12:54.160158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:12:54.160158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:54.160158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:54.176253 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 293/610] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:54.181569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774907cf-11d8-4abd-9711-331bb0f04faf None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:54.191321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821e566-4931-46c9-99e1-2f3a4de2f995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:54.192292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821e566-4931-46c9-99e1-2f3a4de2f995 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:54.192852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821e566-4931-46c9-99e1-2f3a4de2f995 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:54.193378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821e566-4931-46c9-99e1-2f3a4de2f995 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:54.194283 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821e566-4931-46c9-99e1-2f3a4de2f995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:54.194811 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821e566-4931-46c9-99e1-2f3a4de2f995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:54.196442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821e566-4931-46c9-99e1-2f3a4de2f995 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:54.210377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 318/611] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:54.218140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821e566-4931-46c9-99e1-2f3a4de2f995 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:54.242818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:54.302471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774907cf-11d8-4abd-9711-331bb0f04faf None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:54.318765 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:54.365322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3b384-cbbf-4bb4-8d87-dd809360b278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:54.365952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b384-cbbf-4bb4-8d87-dd809360b278 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:54.366237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b384-cbbf-4bb4-8d87-dd809360b278 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:54.366537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b384-cbbf-4bb4-8d87-dd809360b278 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:54.367306 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3b384-cbbf-4bb4-8d87-dd809360b278 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:54.367616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3b384-cbbf-4bb4-8d87-dd809360b278 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:54.369074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3b384-cbbf-4bb4-8d87-dd809360b278 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:54.387902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 294/612] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:12:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:54.393444 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3b384-cbbf-4bb4-8d87-dd809360b278 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:54.436592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821e566-4931-46c9-99e1-2f3a4de2f995 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:54.499418 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3b384-cbbf-4bb4-8d87-dd809360b278 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:54.535302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3210d38-0ebe-4e61-87fb-60dbdf3ee192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:54.536101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3210d38-0ebe-4e61-87fb-60dbdf3ee192 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:54.536494 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3210d38-0ebe-4e61-87fb-60dbdf3ee192 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:54.536803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3210d38-0ebe-4e61-87fb-60dbdf3ee192 None admin] PATH_INFO: `/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/9ee0de72ba804ba491342a8ae82a44f7/roles/aed7c83a35d741538254f3d4775f4a0e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:54.552776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3210d38-0ebe-4e61-87fb-60dbdf3ee192 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe696ab97a143959fa7e33cda768cfc, user_id=9ee0de72ba804ba491342a8ae82a44f7, role_id=aed7c83a35d741538254f3d4775f4a0e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:54.554226 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3210d38-0ebe-4e61-87fb-60dbdf3ee192 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:54.559529 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bdf19-8395-4fd0-8f2f-73876b3c7dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:54.560189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bdf19-8395-4fd0-8f2f-73876b3c7dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:54.560475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bdf19-8395-4fd0-8f2f-73876b3c7dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:54.560749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bdf19-8395-4fd0-8f2f-73876b3c7dc6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:54.577333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bdf19-8395-4fd0-8f2f-73876b3c7dc6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:54.578819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bdf19-8395-4fd0-8f2f-73876b3c7dc6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:54.586507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 295/613] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:12:54 2022] PUT /identity/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/9ee0de72ba804ba491342a8ae82a44f7/roles/aed7c83a35d741538254f3d4775f4a0e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-ff3bdf19-8395-4fd0-8f2f-73876b3c7dc6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:12:54.599327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:54.600351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:54.601719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:54.601719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:54.601719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:12:54.601719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:12:54.601719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:12:54.601719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:12:54.601719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:12:54.601719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:12:54.601719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 22:12:54.601719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:54.601719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 319/614] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:12:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:54.608490 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3210d38-0ebe-4e61-87fb-60dbdf3ee192 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:54.634799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:54.734752 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3210d38-0ebe-4e61-87fb-60dbdf3ee192 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:54.771655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f01fa9-d310-440e-b520-ab49559267ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:54.772289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f01fa9-d310-440e-b520-ab49559267ef None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:54.772573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f01fa9-d310-440e-b520-ab49559267ef None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:54.772851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f01fa9-d310-440e-b520-ab49559267ef None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:54.773660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f01fa9-d310-440e-b520-ab49559267ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:54.773972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f01fa9-d310-440e-b520-ab49559267ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:54.775446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f01fa9-d310-440e-b520-ab49559267ef None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:54.795030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 296/615] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Aug 4 22:12:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:54.800521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bdf19-8395-4fd0-8f2f-73876b3c7dc6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:54.808042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0dab9-ddbd-4180-ba84-08e3deecdd88 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:54.808329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0dab9-ddbd-4180-ba84-08e3deecdd88 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:54.808606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0dab9-ddbd-4180-ba84-08e3deecdd88 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:54.810284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 297/616] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:54.815216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db566-2d0b-495f-859e-e3920648fa58 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:54.815502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db566-2d0b-495f-859e-e3920648fa58 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:54.815780 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852db566-2d0b-495f-859e-e3920648fa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:54.846636 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-852db566-2d0b-495f-859e-e3920648fa58 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:54.847858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-852db566-2d0b-495f-859e-e3920648fa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:54.921791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:54.942359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 298/617] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:12:54.967774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bdf19-8395-4fd0-8f2f-73876b3c7dc6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:54.974203 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852db566-2d0b-495f-859e-e3920648fa58 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:54.977313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:55.019250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21ed40-c850-420e-b94d-899204347952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:55.019834 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21ed40-c850-420e-b94d-899204347952 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:55.020120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21ed40-c850-420e-b94d-899204347952 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:55.020400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21ed40-c850-420e-b94d-899204347952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:55.033537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21ed40-c850-420e-b94d-899204347952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:55.035075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21ed40-c850-420e-b94d-899204347952 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-8f21ed40-c850-420e-b94d-899204347952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:55.051779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:55.052821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:55.053813 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:55.053813 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:55.053813 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:55.053813 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:55.057643 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 320/618] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:12:55.059850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21ed40-c850-420e-b94d-899204347952 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:55.168406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852db566-2d0b-495f-859e-e3920648fa58 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:55.210712 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21ed40-c850-420e-b94d-899204347952 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:55.235663 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:55.251986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef85f4-34fa-4f2b-bdae-0cf772fa7081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:55.252729 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa0b25-4aaf-4f7d-89b1-5057de715bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:55.254894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa0b25-4aaf-4f7d-89b1-5057de715bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:55.255113 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef85f4-34fa-4f2b-bdae-0cf772fa7081 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:55.255587 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef85f4-34fa-4f2b-bdae-0cf772fa7081 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:55.256010 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa0b25-4aaf-4f7d-89b1-5057de715bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:55.256445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef85f4-34fa-4f2b-bdae-0cf772fa7081 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:55.256861 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa0b25-4aaf-4f7d-89b1-5057de715bd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:55.257707 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef85f4-34fa-4f2b-bdae-0cf772fa7081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:55.258712 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef85f4-34fa-4f2b-bdae-0cf772fa7081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:55.260406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef85f4-34fa-4f2b-bdae-0cf772fa7081 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:55.284352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 321/619] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:55.285458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa0b25-4aaf-4f7d-89b1-5057de715bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:55.290668 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef85f4-34fa-4f2b-bdae-0cf772fa7081 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-3efa0b25-4aaf-4f7d-89b1-5057de715bd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:55.299350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:55.300468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:55.301707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:55.301707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:55.301707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:55.301707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:55.301707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:55.301707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:55.301707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:55.301707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:55.301707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:55.301707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:55.301707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:55.301707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:55.301707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 299/620] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:55.324816 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa0b25-4aaf-4f7d-89b1-5057de715bd6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:55.395128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:55.441702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa0b25-4aaf-4f7d-89b1-5057de715bd6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:55.493968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb018a-adfc-48cc-9485-921b3dd79177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:55.494627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb018a-adfc-48cc-9485-921b3dd79177 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:55.494914 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb018a-adfc-48cc-9485-921b3dd79177 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:55.495198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb018a-adfc-48cc-9485-921b3dd79177 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:55.495926 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb018a-adfc-48cc-9485-921b3dd79177 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:55.496234 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb018a-adfc-48cc-9485-921b3dd79177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:55.497619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb018a-adfc-48cc-9485-921b3dd79177 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:55.515510 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 300/621] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:12:55.521356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb018a-adfc-48cc-9485-921b3dd79177 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:55.533339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef85f4-34fa-4f2b-bdae-0cf772fa7081 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:55.579984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d69bb7-5f8e-4c64-92ea-8dfb3ccdc297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:55.581617 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d69bb7-5f8e-4c64-92ea-8dfb3ccdc297 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:55.582525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d69bb7-5f8e-4c64-92ea-8dfb3ccdc297 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:55.582943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d69bb7-5f8e-4c64-92ea-8dfb3ccdc297 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:55.592244 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d69bb7-5f8e-4c64-92ea-8dfb3ccdc297 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:55.594608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d69bb7-5f8e-4c64-92ea-8dfb3ccdc297 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-74d69bb7-5f8e-4c64-92ea-8dfb3ccdc297 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:12:55.611585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:55.612717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:55.613630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:12:55.613630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:12:55.613630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:12:55.613630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:12:55.613630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:12:55.613630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:12:55.613630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:55.613630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:55.616176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 322/622] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:55.617856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56ed80-85fc-4ff3-9249-473fe04cc3d9 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:55.618578 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56ed80-85fc-4ff3-9249-473fe04cc3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:55.619245 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56ed80-85fc-4ff3-9249-473fe04cc3d9 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:55.621726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 323/623] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:55.622816 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56ed80-85fc-4ff3-9249-473fe04cc3d9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:55.656712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb018a-adfc-48cc-9485-921b3dd79177 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:55.687552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:55.689342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:55.705041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9625e-b20b-4b61-9e60-c0f442ed903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:55.705689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9625e-b20b-4b61-9e60-c0f442ed903f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:55.705977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9625e-b20b-4b61-9e60-c0f442ed903f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:55.706259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9625e-b20b-4b61-9e60-c0f442ed903f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:55.721247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9625e-b20b-4b61-9e60-c0f442ed903f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:55.722724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9625e-b20b-4b61-9e60-c0f442ed903f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a3f9625e-b20b-4b61-9e60-c0f442ed903f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:55.742027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:55.743002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:55.743878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:55.743878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:55.743878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:55.743878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:55.743878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 301/624] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:55.748908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd2821-e535-42a1-ae16-a48d4acab95a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:55.748908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd2821-e535-42a1-ae16-a48d4acab95a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:55.748908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd2821-e535-42a1-ae16-a48d4acab95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:55.761880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56ed80-85fc-4ff3-9249-473fe04cc3d9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:55.767725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-1cfd2821-e535-42a1-ae16-a48d4acab95a None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:55.768935 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1cfd2821-e535-42a1-ae16-a48d4acab95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:55.800124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0178f-f980-4671-9e25-04c76b511148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:55.801076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0178f-f980-4671-9e25-04c76b511148 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:55.801551 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0178f-f980-4671-9e25-04c76b511148 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:55.802110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0178f-f980-4671-9e25-04c76b511148 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:55.803824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0178f-f980-4671-9e25-04c76b511148 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:55.804350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0178f-f980-4671-9e25-04c76b511148 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:55.806343 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0178f-f980-4671-9e25-04c76b511148 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:55.820534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 324/625] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:12:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:55.821773 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0178f-f980-4671-9e25-04c76b511148 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:55.866563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 302/626] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:55.869522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd2821-e535-42a1-ae16-a48d4acab95a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:55.942909 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0178f-f980-4671-9e25-04c76b511148 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:55.946598 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:55.986101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef89e27-2a0d-4fe9-bcc2-72c564018b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:55.987535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef89e27-2a0d-4fe9-bcc2-72c564018b5b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:55.988317 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef89e27-2a0d-4fe9-bcc2-72c564018b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:55.988808 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef89e27-2a0d-4fe9-bcc2-72c564018b5b None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:55.989999 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef89e27-2a0d-4fe9-bcc2-72c564018b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:55.991038 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef89e27-2a0d-4fe9-bcc2-72c564018b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:55.993630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef89e27-2a0d-4fe9-bcc2-72c564018b5b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:56.013765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 325/627] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:56.013765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef89e27-2a0d-4fe9-bcc2-72c564018b5b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:56.018313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd2821-e535-42a1-ae16-a48d4acab95a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:56.027621 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:56.057195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1239c-8fe9-4b64-af24-7053385cf576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:56.057875 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1239c-8fe9-4b64-af24-7053385cf576 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:56.058154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1239c-8fe9-4b64-af24-7053385cf576 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:56.058447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1239c-8fe9-4b64-af24-7053385cf576 None admin] PATH_INFO: `/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/aa5bf773ed3a4f1e916671a22c65f031/roles/aed7c83a35d741538254f3d4775f4a0e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:56.073064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1239c-8fe9-4b64-af24-7053385cf576 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe696ab97a143959fa7e33cda768cfc, user_id=aa5bf773ed3a4f1e916671a22c65f031, role_id=aed7c83a35d741538254f3d4775f4a0e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:56.074540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1239c-8fe9-4b64-af24-7053385cf576 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:56.087820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 303/628] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:12:55 2022] PUT /identity/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/aa5bf773ed3a4f1e916671a22c65f031/roles/aed7c83a35d741538254f3d4775f4a0e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:12:56.089230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4260e-bb87-4329-a02e-9828ebf5c2e4 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:56.089568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4260e-bb87-4329-a02e-9828ebf5c2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:56.089847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4260e-bb87-4329-a02e-9828ebf5c2e4 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:56.094586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 304/629] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:56.094586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4260e-bb87-4329-a02e-9828ebf5c2e4 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:56.138935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef89e27-2a0d-4fe9-bcc2-72c564018b5b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:56.179780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa168b27-084c-4326-81fe-880658235f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:56.180439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa168b27-084c-4326-81fe-880658235f2a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:56.180723 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa168b27-084c-4326-81fe-880658235f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:56.181148 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa168b27-084c-4326-81fe-880658235f2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:56.195023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa168b27-084c-4326-81fe-880658235f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-fa168b27-084c-4326-81fe-880658235f2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:56.200979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:56.202464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:56.203325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:56.203325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:56.203325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:56.203325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:56.203325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:56.203325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:56.203325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:56.203325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:56.203325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:56.203325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:56.203325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:56.203325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:56.207542 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 326/630] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:56.209498 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165cc04-7528-4e7e-836c-b87559c3c4ee None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:56.209787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165cc04-7528-4e7e-836c-b87559c3c4ee None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:56.210065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165cc04-7528-4e7e-836c-b87559c3c4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:56.230534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0165cc04-7528-4e7e-836c-b87559c3c4ee None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:56.231858 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0165cc04-7528-4e7e-836c-b87559c3c4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:56.245823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4260e-bb87-4329-a02e-9828ebf5c2e4 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:56.256297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:56.296812 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5cb44-2d2e-4adb-a581-c72d067201be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:56.297815 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5cb44-2d2e-4adb-a581-c72d067201be None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:56.297815 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5cb44-2d2e-4adb-a581-c72d067201be None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:56.298101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5cb44-2d2e-4adb-a581-c72d067201be None admin] PATH_INFO: `/v3/users/glance` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:56.305957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5cb44-2d2e-4adb-a581-c72d067201be None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:56.307673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5cb44-2d2e-4adb-a581-c72d067201be None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:56.319601 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 327/631] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:56.320806 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165cc04-7528-4e7e-836c-b87559c3c4ee None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-33a5cb44-2d2e-4adb-a581-c72d067201be None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:12:56.321339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:56.322274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:56.323271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:56.323271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:56.323271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:12:56.323271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:12:56.323271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:12:56.323271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:12:56.323271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:12:56.323271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:12:56.323271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 04 22:12:56.323271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:56.323271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 305/632] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:56.335784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5cb44-2d2e-4adb-a581-c72d067201be None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:56.362991 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:56.446751 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165cc04-7528-4e7e-836c-b87559c3c4ee None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:56.481624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5cb44-2d2e-4adb-a581-c72d067201be None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:56.493023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742e4f5-4434-400e-a84d-9df6d6d0825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:56.493885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742e4f5-4434-400e-a84d-9df6d6d0825d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:56.494706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742e4f5-4434-400e-a84d-9df6d6d0825d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:56.495136 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742e4f5-4434-400e-a84d-9df6d6d0825d None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:56.496314 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742e4f5-4434-400e-a84d-9df6d6d0825d None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:56.496804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742e4f5-4434-400e-a84d-9df6d6d0825d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:56.498897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742e4f5-4434-400e-a84d-9df6d6d0825d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:56.511805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 328/633] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:56.512629 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742e4f5-4434-400e-a84d-9df6d6d0825d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:56.528558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73871d86-35d9-4c24-a771-fb389e68aa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:56.530016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871d86-35d9-4c24-a771-fb389e68aa32 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:56.530986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871d86-35d9-4c24-a771-fb389e68aa32 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:56.531563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871d86-35d9-4c24-a771-fb389e68aa32 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:56.532632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73871d86-35d9-4c24-a771-fb389e68aa32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:56.533377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:56.533749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73871d86-35d9-4c24-a771-fb389e68aa32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:56.536353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73871d86-35d9-4c24-a771-fb389e68aa32 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:56.566739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 306/634] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Aug 4 22:12:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:56.567227 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73871d86-35d9-4c24-a771-fb389e68aa32 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:56.648199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742e4f5-4434-400e-a84d-9df6d6d0825d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:56.657724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:56.688274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa1b78-6703-45a2-a5ac-cc089801c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:56.688920 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa1b78-6703-45a2-a5ac-cc089801c379 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:56.689205 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa1b78-6703-45a2-a5ac-cc089801c379 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:56.689480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa1b78-6703-45a2-a5ac-cc089801c379 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:56.693426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73871d86-35d9-4c24-a771-fb389e68aa32 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:56.700466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa1b78-6703-45a2-a5ac-cc089801c379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0afa1b78-6703-45a2-a5ac-cc089801c379 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:56.706533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:56.707696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:56.708779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:56.708779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:56.708779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:56.708779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:56.708779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:56.708779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:56.708779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:56.708779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:56.708779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:56.708779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:56.708779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:56.708779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:56.709518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 329/635] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:56.710355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa1b78-6703-45a2-a5ac-cc089801c379 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:56.737738 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9ab3b-7c1f-48be-893f-8e2cf1797f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:56.738983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9ab3b-7c1f-48be-893f-8e2cf1797f57 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:56.739671 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9ab3b-7c1f-48be-893f-8e2cf1797f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:56.740649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9ab3b-7c1f-48be-893f-8e2cf1797f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:56.753536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9ab3b-7c1f-48be-893f-8e2cf1797f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:56.755668 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9ab3b-7c1f-48be-893f-8e2cf1797f57 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-e7a9ab3b-7c1f-48be-893f-8e2cf1797f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:56.775552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:56.776705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:56.777845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:56.777845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:56.777845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:56.777845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:56.780310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 307/636] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:56.781264 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9ab3b-7c1f-48be-893f-8e2cf1797f57 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:56.803467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:56.825916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa1b78-6703-45a2-a5ac-cc089801c379 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:56.861485 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ab836-e924-426a-b02a-2e7cfb6aa591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:56.862138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ab836-e924-426a-b02a-2e7cfb6aa591 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:56.862434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ab836-e924-426a-b02a-2e7cfb6aa591 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:56.862861 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ab836-e924-426a-b02a-2e7cfb6aa591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:56.912995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9ab3b-7c1f-48be-893f-8e2cf1797f57 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:56.935606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ab836-e924-426a-b02a-2e7cfb6aa591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:56.937442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ab836-e924-426a-b02a-2e7cfb6aa591 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:56.940928 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:56.950815 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d728456-d48f-4d7f-a8a3-7021f4380564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:56.951633 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d728456-d48f-4d7f-a8a3-7021f4380564 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:56.951914 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d728456-d48f-4d7f-a8a3-7021f4380564 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:56.952190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d728456-d48f-4d7f-a8a3-7021f4380564 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:56.952908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d728456-d48f-4d7f-a8a3-7021f4380564 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:56.953215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d728456-d48f-4d7f-a8a3-7021f4380564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:56.954606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d728456-d48f-4d7f-a8a3-7021f4380564 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:56.963307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 308/637] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:56.964101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d728456-d48f-4d7f-a8a3-7021f4380564 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:57.027000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:57.051825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 330/638] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:57.053344 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bebe84-7887-4bc7-a199-23bcef5ec8ce None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:57.053636 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bebe84-7887-4bc7-a199-23bcef5ec8ce None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:57.053911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bebe84-7887-4bc7-a199-23bcef5ec8ce None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:57.058449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 331/639] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:57.058449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bebe84-7887-4bc7-a199-23bcef5ec8ce None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:57.077045 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d728456-d48f-4d7f-a8a3-7021f4380564 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:57.121335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825293e-fc4b-4222-88c4-f3508baeae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:57.122307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825293e-fc4b-4222-88c4-f3508baeae50 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:57.122690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825293e-fc4b-4222-88c4-f3508baeae50 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:57.122965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825293e-fc4b-4222-88c4-f3508baeae50 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:57.123663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825293e-fc4b-4222-88c4-f3508baeae50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:57.123971 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825293e-fc4b-4222-88c4-f3508baeae50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:57.125405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825293e-fc4b-4222-88c4-f3508baeae50 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:57.138490 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 309/640] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:57.143441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825293e-fc4b-4222-88c4-f3508baeae50 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:57.165215 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bebe84-7887-4bc7-a199-23bcef5ec8ce None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:57.199687 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d2c99-70db-4bc5-aec7-2cbe87bb1cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:57.200325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d2c99-70db-4bc5-aec7-2cbe87bb1cce None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:57.200606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d2c99-70db-4bc5-aec7-2cbe87bb1cce None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:57.200927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d2c99-70db-4bc5-aec7-2cbe87bb1cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:57.201031 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:57.214162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d2c99-70db-4bc5-aec7-2cbe87bb1cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:57.215193 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d2c99-70db-4bc5-aec7-2cbe87bb1cce None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e92d2c99-70db-4bc5-aec7-2cbe87bb1cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:57.231803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:57.232697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:57.233586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:57.233586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:57.233586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:57.233586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:57.233586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 332/641] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:57.235293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055d849-f395-49c0-a365-bdef11326b27 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:57.235293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055d849-f395-49c0-a365-bdef11326b27 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:57.235293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055d849-f395-49c0-a365-bdef11326b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:57.252327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9055d849-f395-49c0-a365-bdef11326b27 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:57.253512 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9055d849-f395-49c0-a365-bdef11326b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:57.277913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825293e-fc4b-4222-88c4-f3508baeae50 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:57.279160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:57.317363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203535c-73a7-407b-a7b8-57e507aaed29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:57.318456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203535c-73a7-407b-a7b8-57e507aaed29 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:57.318967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203535c-73a7-407b-a7b8-57e507aaed29 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:57.319422 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203535c-73a7-407b-a7b8-57e507aaed29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:57.325853 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 333/642] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:57.327443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055d849-f395-49c0-a365-bdef11326b27 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:57.331060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203535c-73a7-407b-a7b8-57e507aaed29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:57.332524 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203535c-73a7-407b-a7b8-57e507aaed29 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-0203535c-73a7-407b-a7b8-57e507aaed29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:57.348523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:57.350117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:57.351252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:57.351252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:57.351252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:57.351252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:57.351252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 310/643] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:57.351723 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203535c-73a7-407b-a7b8-57e507aaed29 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:57.439441 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055d849-f395-49c0-a365-bdef11326b27 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:57.459730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:57.463987 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203535c-73a7-407b-a7b8-57e507aaed29 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:57.479804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b0bb-d81c-4f1d-8c41-2e1075dc4fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:57.480448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b0bb-d81c-4f1d-8c41-2e1075dc4fde None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:57.480726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b0bb-d81c-4f1d-8c41-2e1075dc4fde None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:57.481013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b0bb-d81c-4f1d-8c41-2e1075dc4fde None admin] PATH_INFO: `/v3/users/nova` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:57.488208 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b0bb-d81c-4f1d-8c41-2e1075dc4fde None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:57.489652 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b0bb-d81c-4f1d-8c41-2e1075dc4fde None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:57.499841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ebc9e-8dea-402c-8fc2-298874e5fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:57.500665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ebc9e-8dea-402c-8fc2-298874e5fc2d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:57.500950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ebc9e-8dea-402c-8fc2-298874e5fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-3318b0bb-d81c-4f1d-8c41-2e1075dc4fde None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:12:57.501191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:57.502097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:57.504072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:57.504072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:57.504072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:12:57.504072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:12:57.504072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:12:57.504072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:12:57.504072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:12:57.504072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:12:57.504072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:12:57.504072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:57.504658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ebc9e-8dea-402c-8fc2-298874e5fc2d None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:57.504658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ebc9e-8dea-402c-8fc2-298874e5fc2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:57.504658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ebc9e-8dea-402c-8fc2-298874e5fc2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:57.504836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 334/644] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 4 22:12:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:57.504911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ebc9e-8dea-402c-8fc2-298874e5fc2d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:57.508063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b0bb-d81c-4f1d-8c41-2e1075dc4fde None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:57.522480 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 311/645] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:57.522480 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ebc9e-8dea-402c-8fc2-298874e5fc2d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:57.529694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:57.614378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b0bb-d81c-4f1d-8c41-2e1075dc4fde None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:57.629569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ebc9e-8dea-402c-8fc2-298874e5fc2d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:57.650859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f4ee8-3c5c-41d0-8b15-210ee196e4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:57.651650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f4ee8-3c5c-41d0-8b15-210ee196e4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:57.652045 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f4ee8-3c5c-41d0-8b15-210ee196e4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:57.652419 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f4ee8-3c5c-41d0-8b15-210ee196e4b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:57.653221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f4ee8-3c5c-41d0-8b15-210ee196e4b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:57.653632 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f4ee8-3c5c-41d0-8b15-210ee196e4b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:57.655147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f4ee8-3c5c-41d0-8b15-210ee196e4b7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:57.668231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 335/646] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:57.669222 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f4ee8-3c5c-41d0-8b15-210ee196e4b7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:57.676010 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65397d-b9bb-45d2-acb1-acc38f30a7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:57.676665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65397d-b9bb-45d2-acb1-acc38f30a7da None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:57.676952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65397d-b9bb-45d2-acb1-acc38f30a7da None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:57.677230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65397d-b9bb-45d2-acb1-acc38f30a7da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:57.688740 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65397d-b9bb-45d2-acb1-acc38f30a7da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-cf65397d-b9bb-45d2-acb1-acc38f30a7da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:57.694327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:57.695271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:57.696116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:57.696116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:57.696116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:57.696116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:57.696116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:57.696116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:57.696116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:57.696116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:57.696116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:57.696116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:57.696116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:57.696116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:57.700416 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 312/647] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:57.701496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65397d-b9bb-45d2-acb1-acc38f30a7da None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:57.725105 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:57.758292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:57.782891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f4ee8-3c5c-41d0-8b15-210ee196e4b7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:57.809182 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65397d-b9bb-45d2-acb1-acc38f30a7da None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:57.823421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b16bef-7843-4bbd-9169-08957c70633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:57.824046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b16bef-7843-4bbd-9169-08957c70633a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:57.824328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b16bef-7843-4bbd-9169-08957c70633a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:57.824597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b16bef-7843-4bbd-9169-08957c70633a None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:57.825393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b16bef-7843-4bbd-9169-08957c70633a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:57.825702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b16bef-7843-4bbd-9169-08957c70633a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:57.827414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b16bef-7843-4bbd-9169-08957c70633a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:57.849241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 336/648] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 4 22:12:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:57.849241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b16bef-7843-4bbd-9169-08957c70633a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:57.851707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edc25d-51e9-49d8-b01a-3db2d8aa668b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:57.852438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edc25d-51e9-49d8-b01a-3db2d8aa668b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:57.852799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edc25d-51e9-49d8-b01a-3db2d8aa668b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:57.853154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edc25d-51e9-49d8-b01a-3db2d8aa668b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:57.860967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edc25d-51e9-49d8-b01a-3db2d8aa668b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:57.862421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edc25d-51e9-49d8-b01a-3db2d8aa668b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-95edc25d-51e9-49d8-b01a-3db2d8aa668b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:12:57.875821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:57.876801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:57.877741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:57.877741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:57.877741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:12:57.877741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:12:57.877741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:12:57.877741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:12:57.877741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:12:57.877741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:12:57.877741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 22:12:57.877741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:57.877741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 313/649] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:12:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:57.878336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edc25d-51e9-49d8-b01a-3db2d8aa668b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:57.963938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:57.965567 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b16bef-7843-4bbd-9169-08957c70633a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:57.985671 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edc25d-51e9-49d8-b01a-3db2d8aa668b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:58.001249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f2cc9-8a36-42c2-9afa-5f44c6da75dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:58.001892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f2cc9-8a36-42c2-9afa-5f44c6da75dd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:58.002174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f2cc9-8a36-42c2-9afa-5f44c6da75dd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:58.002480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f2cc9-8a36-42c2-9afa-5f44c6da75dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:58.005188 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:58.010375 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f2cc9-8a36-42c2-9afa-5f44c6da75dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:58.012751 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f2cc9-8a36-42c2-9afa-5f44c6da75dd None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:58.024116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e9293-8101-4f80-8557-93b9e2ccd7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:58.024819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e9293-8101-4f80-8557-93b9e2ccd7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:58.025172 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e9293-8101-4f80-8557-93b9e2ccd7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b96f2cc9-8a36-42c2-9afa-5f44c6da75dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:12:58.025315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:58.026376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:58.027845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:12:58.027845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:12:58.027845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:12:58.027845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:12:58.027845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:12:58.027845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:12:58.027845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:58.027845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:58.028395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e9293-8101-4f80-8557-93b9e2ccd7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:58.028395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e9293-8101-4f80-8557-93b9e2ccd7a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:58.028395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e9293-8101-4f80-8557-93b9e2ccd7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:58.029686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e9293-8101-4f80-8557-93b9e2ccd7a1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:58.031242 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 337/650] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:58.032085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f2cc9-8a36-42c2-9afa-5f44c6da75dd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:58.039893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 314/651] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:58.041338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e9293-8101-4f80-8557-93b9e2ccd7a1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:58.140519 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f2cc9-8a36-42c2-9afa-5f44c6da75dd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:58.144453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e9293-8101-4f80-8557-93b9e2ccd7a1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:58.176085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b39ae-f42a-4567-9162-ca9210db5cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:58.176692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b39ae-f42a-4567-9162-ca9210db5cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:58.176970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b39ae-f42a-4567-9162-ca9210db5cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:58.177240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b39ae-f42a-4567-9162-ca9210db5cc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:58.179374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997fb90-b319-4d77-92d7-e1bd7b2e8065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:58.179989 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997fb90-b319-4d77-92d7-e1bd7b2e8065 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:58.180271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997fb90-b319-4d77-92d7-e1bd7b2e8065 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:58.180554 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997fb90-b319-4d77-92d7-e1bd7b2e8065 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:58.181346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997fb90-b319-4d77-92d7-e1bd7b2e8065 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:58.181656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997fb90-b319-4d77-92d7-e1bd7b2e8065 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:58.183117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997fb90-b319-4d77-92d7-e1bd7b2e8065 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:58.197546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:58.202568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 315/652] 10.222.0.27 () {56 vars in 1137 bytes} [Thu Aug 4 22:12:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:58.203385 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997fb90-b319-4d77-92d7-e1bd7b2e8065 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:58.238197 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:58.244934 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b39ae-f42a-4567-9162-ca9210db5cc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:58.246485 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b39ae-f42a-4567-9162-ca9210db5cc4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:58.303365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997fb90-b319-4d77-92d7-e1bd7b2e8065 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:58.337585 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c7738-15c7-4cdc-a279-5855426eccdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:58.338197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c7738-15c7-4cdc-a279-5855426eccdf None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:58.338507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c7738-15c7-4cdc-a279-5855426eccdf None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:58.338782 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c7738-15c7-4cdc-a279-5855426eccdf None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:58.339526 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c7738-15c7-4cdc-a279-5855426eccdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:58.339834 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c7738-15c7-4cdc-a279-5855426eccdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:58.341249 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c7738-15c7-4cdc-a279-5855426eccdf None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:58.345408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 338/653] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:58.346294 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b39ae-f42a-4567-9162-ca9210db5cc4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:58.359692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 316/654] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:58.359692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670005b-2803-4dd1-bd2a-869797e6fae0 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:58.359692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670005b-2803-4dd1-bd2a-869797e6fae0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:58.359692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670005b-2803-4dd1-bd2a-869797e6fae0 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:58.359692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 317/655] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:12:58.359692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670005b-2803-4dd1-bd2a-869797e6fae0 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:58.418859 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:58.439836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:58.446199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b39ae-f42a-4567-9162-ca9210db5cc4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:58.462748 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670005b-2803-4dd1-bd2a-869797e6fae0 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:58.483297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102f438-0dc3-4272-8e9f-cd4889043ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:58.484007 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102f438-0dc3-4272-8e9f-cd4889043ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:58.484347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102f438-0dc3-4272-8e9f-cd4889043ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:58.484680 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102f438-0dc3-4272-8e9f-cd4889043ab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:58.495471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102f438-0dc3-4272-8e9f-cd4889043ab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:58.496569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89773c-a18b-4b4a-bf6d-b3488c41007e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:58.497013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102f438-0dc3-4272-8e9f-cd4889043ab4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:58.497182 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89773c-a18b-4b4a-bf6d-b3488c41007e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:58.497459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89773c-a18b-4b4a-bf6d-b3488c41007e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:58.497728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89773c-a18b-4b4a-bf6d-b3488c41007e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-d102f438-0dc3-4272-8e9f-cd4889043ab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:58.512431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:58.513526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:58.514752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:58.514752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:58.514752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:58.514752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:58.514752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 339/656] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:58.514752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102f438-0dc3-4272-8e9f-cd4889043ab4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:58.564143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89773c-a18b-4b4a-bf6d-b3488c41007e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:58.565568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89773c-a18b-4b4a-bf6d-b3488c41007e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:58.617287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102f438-0dc3-4272-8e9f-cd4889043ab4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:58.622095 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:58.651839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaca0f-01b9-4182-b145-cd16a797b5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:58.652550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaca0f-01b9-4182-b145-cd16a797b5ae None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:58.652837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaca0f-01b9-4182-b145-cd16a797b5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:58.653113 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaca0f-01b9-4182-b145-cd16a797b5ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:58.663040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 318/657] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:12:58.663575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaaca0f-01b9-4182-b145-cd16a797b5ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:58.663874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89773c-a18b-4b4a-bf6d-b3488c41007e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:58.665104 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaaca0f-01b9-4182-b145-cd16a797b5ae None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:58.673395 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-7eaaca0f-01b9-4182-b145-cd16a797b5ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:58.680862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:58.681955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:58.683124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:58.683124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:58.683124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:58.683124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:58.686706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 340/658] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:58.687989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d013db-8c3e-401d-8952-6953705772f6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:58.688275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d013db-8c3e-401d-8952-6953705772f6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:58.688554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d013db-8c3e-401d-8952-6953705772f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:58.706701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-05d013db-8c3e-401d-8952-6953705772f6 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:12:58.707907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-05d013db-8c3e-401d-8952-6953705772f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:12:58.765395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89773c-a18b-4b4a-bf6d-b3488c41007e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:58.773754 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 341/659] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:12:58.774611 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d013db-8c3e-401d-8952-6953705772f6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:58.800591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce2793-d70b-4d27-8f82-5d56015d1b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:58.801207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce2793-d70b-4d27-8f82-5d56015d1b34 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:58.801486 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce2793-d70b-4d27-8f82-5d56015d1b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:58.801758 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce2793-d70b-4d27-8f82-5d56015d1b34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:58.803119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce2793-d70b-4d27-8f82-5d56015d1b34 None admin] RBAC: Adding query filter params (role.id=aed7c83a35d741538254f3d4775f4a0e, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=fce7db16c4904fb1b75ac7910f4470f8) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:58.803427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce2793-d70b-4d27-8f82-5d56015d1b34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:58.804835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce2793-d70b-4d27-8f82-5d56015d1b34 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:58.810771 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 319/660] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:12:58 2022] GET /identity/v3/role_assignments?user.id=fce7db16c4904fb1b75ac7910f4470f8&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=aed7c83a35d741538254f3d4775f4a0e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:58.811167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce2793-d70b-4d27-8f82-5d56015d1b34 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:58.839471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:58.904089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d013db-8c3e-401d-8952-6953705772f6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:58.924882 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce2793-d70b-4d27-8f82-5d56015d1b34 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:58.935652 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:58.942458 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedbdaa-fdcb-407e-8b92-ecacdd1455ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:58.943152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedbdaa-fdcb-407e-8b92-ecacdd1455ec None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:58.943442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedbdaa-fdcb-407e-8b92-ecacdd1455ec None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:58.943717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedbdaa-fdcb-407e-8b92-ecacdd1455ec None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:58.944422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedbdaa-fdcb-407e-8b92-ecacdd1455ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:58.944733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedbdaa-fdcb-407e-8b92-ecacdd1455ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:58.946143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedbdaa-fdcb-407e-8b92-ecacdd1455ec None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:58.961400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 342/661] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:58.962464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedbdaa-fdcb-407e-8b92-ecacdd1455ec None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:58.967111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32b3d0-bb2d-4db2-b8e7-7e43d3b698d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:58.967763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32b3d0-bb2d-4db2-b8e7-7e43d3b698d2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:58.968037 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32b3d0-bb2d-4db2-b8e7-7e43d3b698d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:58.968305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32b3d0-bb2d-4db2-b8e7-7e43d3b698d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:58.981141 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32b3d0-bb2d-4db2-b8e7-7e43d3b698d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:58.982911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32b3d0-bb2d-4db2-b8e7-7e43d3b698d2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-0b32b3d0-bb2d-4db2-b8e7-7e43d3b698d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:58.997468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:58.998375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:58.999372 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:58.999372 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:58.999372 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:58.999372 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:58.999372 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 320/662] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:58.999656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32b3d0-bb2d-4db2-b8e7-7e43d3b698d2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:59.074347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedbdaa-fdcb-407e-8b92-ecacdd1455ec None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:59.081807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:59.107473 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32b3d0-bb2d-4db2-b8e7-7e43d3b698d2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:59.111893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ec12c-db0d-455d-b43c-9edbd5146195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:59.112518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ec12c-db0d-455d-b43c-9edbd5146195 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:59.112804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ec12c-db0d-455d-b43c-9edbd5146195 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:59.113079 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ec12c-db0d-455d-b43c-9edbd5146195 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:59.113766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ec12c-db0d-455d-b43c-9edbd5146195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:59.114075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ec12c-db0d-455d-b43c-9edbd5146195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:59.115520 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ec12c-db0d-455d-b43c-9edbd5146195 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:59.132040 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 343/663] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:59.134566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ec12c-db0d-455d-b43c-9edbd5146195 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:59.147171 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8b5b9-8a90-47ce-a4b0-ad76cce8ef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:59.147843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b5b9-8a90-47ce-a4b0-ad76cce8ef72 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:59.148099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b5b9-8a90-47ce-a4b0-ad76cce8ef72 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:59.148376 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b5b9-8a90-47ce-a4b0-ad76cce8ef72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:59.158890 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8b5b9-8a90-47ce-a4b0-ad76cce8ef72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-0af8b5b9-8a90-47ce-a4b0-ad76cce8ef72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:12:59.164240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:59.165168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:59.165997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:59.165997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:59.165997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:59.165997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:59.165997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:12:59.165997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:12:59.165997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:12:59.165997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:12:59.165997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:12:59.165997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:12:59.165997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:12:59.165997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:59.165997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 321/664] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:59.166749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8b5b9-8a90-47ce-a4b0-ad76cce8ef72 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:59.191774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:59.247817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ec12c-db0d-455d-b43c-9edbd5146195 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:59.274610 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8b5b9-8a90-47ce-a4b0-ad76cce8ef72 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:59.282814 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7780854-9655-4969-b45e-4c5c29c21817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:59.283456 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7780854-9655-4969-b45e-4c5c29c21817 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:59.283734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7780854-9655-4969-b45e-4c5c29c21817 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:59.284006 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7780854-9655-4969-b45e-4c5c29c21817 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:59.291500 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7780854-9655-4969-b45e-4c5c29c21817 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:59.292937 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7780854-9655-4969-b45e-4c5c29c21817 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b7780854-9655-4969-b45e-4c5c29c21817 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:12:59.305110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:59.306030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:59.306996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:59.306996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:59.306996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:12:59.306996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:12:59.306996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:12:59.306996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:12:59.306996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:12:59.306996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:12:59.306996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 04 22:12:59.306996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:59.306996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 344/665] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:12:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:59.307588 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7780854-9655-4969-b45e-4c5c29c21817 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:59.314591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ad388-7b41-4d93-9014-86e10738d9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:59.315222 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ad388-7b41-4d93-9014-86e10738d9ac None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:59.315503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ad388-7b41-4d93-9014-86e10738d9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:59.315777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ad388-7b41-4d93-9014-86e10738d9ac None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:59.316470 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ad388-7b41-4d93-9014-86e10738d9ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:59.316784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ad388-7b41-4d93-9014-86e10738d9ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:59.318789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ad388-7b41-4d93-9014-86e10738d9ac None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:59.321359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:59.332409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 322/666] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:59.333179 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ad388-7b41-4d93-9014-86e10738d9ac None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:59.419534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7780854-9655-4969-b45e-4c5c29c21817 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:59.433106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:59.446501 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ad388-7b41-4d93-9014-86e10738d9ac None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:59.467628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0578966-c589-482e-adde-a46d565508ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:59.468287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578966-c589-482e-adde-a46d565508ca None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:59.468587 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578966-c589-482e-adde-a46d565508ca None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:59.468852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578966-c589-482e-adde-a46d565508ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:59.476982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0578966-c589-482e-adde-a46d565508ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:59.478466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0578966-c589-482e-adde-a46d565508ca None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:59.486797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50401bb9-cf2a-418d-a78a-597aa1775226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:59.487614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401bb9-cf2a-418d-a78a-597aa1775226 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:59.488069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401bb9-cf2a-418d-a78a-597aa1775226 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:59.488536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401bb9-cf2a-418d-a78a-597aa1775226 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:59.489408 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50401bb9-cf2a-418d-a78a-597aa1775226 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:59.490421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50401bb9-cf2a-418d-a78a-597aa1775226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-a0578966-c589-482e-adde-a46d565508ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:12:59.490574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:59.491414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:59.492276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:12:59.492276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:12:59.492276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:12:59.492276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:12:59.492276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:12:59.492276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:12:59.492276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:59.492276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:12:59.492276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 345/667] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:59.493292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0578966-c589-482e-adde-a46d565508ca None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:59.494964 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50401bb9-cf2a-418d-a78a-597aa1775226 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:59.507039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 323/668] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:12:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:59.508434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50401bb9-cf2a-418d-a78a-597aa1775226 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:59.574117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:59.604322 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0578966-c589-482e-adde-a46d565508ca None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:59.621828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50401bb9-cf2a-418d-a78a-597aa1775226 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:59.638433 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8eba4-d587-493d-b2fa-70768da24a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:59.639054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8eba4-d587-493d-b2fa-70768da24a6b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:59.639341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8eba4-d587-493d-b2fa-70768da24a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:59.639619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8eba4-d587-493d-b2fa-70768da24a6b None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:59.640408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8eba4-d587-493d-b2fa-70768da24a6b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:59.640717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8eba4-d587-493d-b2fa-70768da24a6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:59.642172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8eba4-d587-493d-b2fa-70768da24a6b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:59.668513 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d7c01-54a4-4335-a606-e24db167808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:59.669863 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7c01-54a4-4335-a606-e24db167808a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:59.670256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 346/669] 10.222.0.27 () {56 vars in 1139 bytes} [Thu Aug 4 22:12:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:59.670871 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7c01-54a4-4335-a606-e24db167808a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:59.671132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8eba4-d587-493d-b2fa-70768da24a6b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:59.671553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7c01-54a4-4335-a606-e24db167808a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:59.682027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d7c01-54a4-4335-a606-e24db167808a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:59.683485 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d7c01-54a4-4335-a606-e24db167808a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-f14d7c01-54a4-4335-a606-e24db167808a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:12:59.695185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:59.696077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:59.696973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:12:59.696973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:12:59.696973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:12:59.696973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:12:59.696973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:12:59.696973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:12:59.696973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:12:59.696973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:59.696973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 324/670] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:12:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:59.697456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d7c01-54a4-4335-a606-e24db167808a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:59.710231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:59.789068 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8eba4-d587-493d-b2fa-70768da24a6b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:59.805115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d7c01-54a4-4335-a606-e24db167808a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:59.821434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:59.825903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d1d3d-f68d-49fd-a65d-d2236bbd9d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:59.826699 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d1d3d-f68d-49fd-a65d-d2236bbd9d8f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:59.826970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d1d3d-f68d-49fd-a65d-d2236bbd9d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:59.827235 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d1d3d-f68d-49fd-a65d-d2236bbd9d8f None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:59.827974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d1d3d-f68d-49fd-a65d-d2236bbd9d8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:12:59.828277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d1d3d-f68d-49fd-a65d-d2236bbd9d8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:59.829703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d1d3d-f68d-49fd-a65d-d2236bbd9d8f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:59.839555 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b94d97-7dec-4cb6-b770-d8da7d7cb774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:59.840198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b94d97-7dec-4cb6-b770-d8da7d7cb774 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:59.840482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b94d97-7dec-4cb6-b770-d8da7d7cb774 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:59.840757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b94d97-7dec-4cb6-b770-d8da7d7cb774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:12:59.841622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 347/671] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:12:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:12:59.841622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d1d3d-f68d-49fd-a65d-d2236bbd9d8f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:59.852529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b94d97-7dec-4cb6-b770-d8da7d7cb774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:12:59.853983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b94d97-7dec-4cb6-b770-d8da7d7cb774 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-70b94d97-7dec-4cb6-b770-d8da7d7cb774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:12:59.869076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:12:59.869998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:12:59.870936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:12:59.870936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:12:59.870936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:12:59.870936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:12:59.870936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 325/672] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:12:59.871207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b94d97-7dec-4cb6-b770-d8da7d7cb774 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:12:59.942386 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:12:59.958442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d1d3d-f68d-49fd-a65d-d2236bbd9d8f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:59.977616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b94d97-7dec-4cb6-b770-d8da7d7cb774 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:12:59.992881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a66fd-d68c-41e9-9efe-5adc8d709c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:12:59.993528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a66fd-d68c-41e9-9efe-5adc8d709c57 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:12:59.993815 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a66fd-d68c-41e9-9efe-5adc8d709c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:12:59.994093 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a66fd-d68c-41e9-9efe-5adc8d709c57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:00.015102 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683984a0-a750-496e-bea2-3ea624f3fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:00.015724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683984a0-a750-496e-bea2-3ea624f3fe8b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:00.016006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683984a0-a750-496e-bea2-3ea624f3fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:00.016281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683984a0-a750-496e-bea2-3ea624f3fe8b None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:00.017039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683984a0-a750-496e-bea2-3ea624f3fe8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:00.017351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683984a0-a750-496e-bea2-3ea624f3fe8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:00.018817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683984a0-a750-496e-bea2-3ea624f3fe8b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:00.035871 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 326/673] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:12:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:00.035871 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683984a0-a750-496e-bea2-3ea624f3fe8b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:00.064802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:00.073981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a66fd-d68c-41e9-9efe-5adc8d709c57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:00.075499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a66fd-d68c-41e9-9efe-5adc8d709c57 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:00.145772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683984a0-a750-496e-bea2-3ea624f3fe8b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:00.174944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:00.183455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf52613-7585-4c91-8569-f6378cfb9188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:00.184284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52613-7585-4c91-8569-f6378cfb9188 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:00.184740 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52613-7585-4c91-8569-f6378cfb9188 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:00.185020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52613-7585-4c91-8569-f6378cfb9188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:00.185815 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf52613-7585-4c91-8569-f6378cfb9188 None admin] RBAC: Adding query filter params (role.id=aed7c83a35d741538254f3d4775f4a0e, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=04899781f67746e193a05bdc004804cc) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:00.186130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf52613-7585-4c91-8569-f6378cfb9188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:00.187587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf52613-7585-4c91-8569-f6378cfb9188 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:00.192697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 348/674] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:13:00.202836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a66fd-d68c-41e9-9efe-5adc8d709c57 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:00.203062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 327/675] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:00 2022] GET /identity/v3/role_assignments?user.id=04899781f67746e193a05bdc004804cc&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=aed7c83a35d741538254f3d4775f4a0e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:00.203062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf52613-7585-4c91-8569-f6378cfb9188 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:00.312864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:00.323636 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a66fd-d68c-41e9-9efe-5adc8d709c57 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:00.323872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf52613-7585-4c91-8569-f6378cfb9188 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:00.363558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671049d-0636-4e39-8e14-3cbff6cfc28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:00.364189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671049d-0636-4e39-8e14-3cbff6cfc28a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:00.364476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671049d-0636-4e39-8e14-3cbff6cfc28a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:00.364751 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671049d-0636-4e39-8e14-3cbff6cfc28a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:00.365429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba24677-3b88-48c4-a311-db8e9b6450e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:00.365576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671049d-0636-4e39-8e14-3cbff6cfc28a None admin] RBAC: Adding query filter params (role.id=aed7c83a35d741538254f3d4775f4a0e, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=d3b29a204dff42c399f0d143b3d0189f) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:00.365880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671049d-0636-4e39-8e14-3cbff6cfc28a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:00.369927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24677-3b88-48c4-a311-db8e9b6450e2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:00.369927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24677-3b88-48c4-a311-db8e9b6450e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:00.370119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671049d-0636-4e39-8e14-3cbff6cfc28a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:00.370274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba24677-3b88-48c4-a311-db8e9b6450e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:00.370274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba24677-3b88-48c4-a311-db8e9b6450e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:00.370274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba24677-3b88-48c4-a311-db8e9b6450e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:00.370274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba24677-3b88-48c4-a311-db8e9b6450e2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:00.377568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 328/676] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:00 2022] GET /identity/v3/role_assignments?user.id=d3b29a204dff42c399f0d143b3d0189f&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=aed7c83a35d741538254f3d4775f4a0e => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:00.377568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671049d-0636-4e39-8e14-3cbff6cfc28a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:00.395424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 349/677] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:00.403161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba24677-3b88-48c4-a311-db8e9b6450e2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:00.471346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:00.513157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671049d-0636-4e39-8e14-3cbff6cfc28a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:00.548964 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba24677-3b88-48c4-a311-db8e9b6450e2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:00.563700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36676cbc-dfe7-4c8a-91a9-5acd9639cb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:00.565004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36676cbc-dfe7-4c8a-91a9-5acd9639cb6c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:00.565978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36676cbc-dfe7-4c8a-91a9-5acd9639cb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:00.566606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36676cbc-dfe7-4c8a-91a9-5acd9639cb6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:00.582393 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36676cbc-dfe7-4c8a-91a9-5acd9639cb6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:00.584460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36676cbc-dfe7-4c8a-91a9-5acd9639cb6c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:00.595591 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2fae9-099b-4e0e-aa76-81bc4968fa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:00.597002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2fae9-099b-4e0e-aa76-81bc4968fa05 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:00.597621 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2fae9-099b-4e0e-aa76-81bc4968fa05 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:00.598199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2fae9-099b-4e0e-aa76-81bc4968fa05 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-36676cbc-dfe7-4c8a-91a9-5acd9639cb6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:00.604108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:00.605106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:00.606190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:00.606190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:00.606190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:00.606190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:00.606697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 329/678] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:00.610487 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2fae9-099b-4e0e-aa76-81bc4968fa05 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:00.611551 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36676cbc-dfe7-4c8a-91a9-5acd9639cb6c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:00.612356 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2fae9-099b-4e0e-aa76-81bc4968fa05 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:00.627020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-45b2fae9-099b-4e0e-aa76-81bc4968fa05 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:00.628787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:00.631035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:00.632265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:00.632265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:00.632265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:00.632265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:00.632265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:00.632265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:00.632265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:00.632265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:00.632265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 22:13:00.632265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:00.632265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 350/679] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:13:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:00.637844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2fae9-099b-4e0e-aa76-81bc4968fa05 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:00.725685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36676cbc-dfe7-4c8a-91a9-5acd9639cb6c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:00.751678 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2fae9-099b-4e0e-aa76-81bc4968fa05 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:00.761276 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfe1d7-456d-4bcf-bb44-23b42b08d982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:00.761901 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe1d7-456d-4bcf-bb44-23b42b08d982 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:00.762180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe1d7-456d-4bcf-bb44-23b42b08d982 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:00.762482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe1d7-456d-4bcf-bb44-23b42b08d982 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:00.763185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfe1d7-456d-4bcf-bb44-23b42b08d982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:00.763490 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfe1d7-456d-4bcf-bb44-23b42b08d982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:00.764848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfe1d7-456d-4bcf-bb44-23b42b08d982 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:00.777406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 330/680] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:00.777893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:00.785771 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfe1d7-456d-4bcf-bb44-23b42b08d982 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:00.793487 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa66c3-6438-4510-b4f2-6d1ae7679cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:00.794257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa66c3-6438-4510-b4f2-6d1ae7679cca None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:00.794670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa66c3-6438-4510-b4f2-6d1ae7679cca None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:00.795048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa66c3-6438-4510-b4f2-6d1ae7679cca None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:00.796096 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa66c3-6438-4510-b4f2-6d1ae7679cca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:00.796510 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa66c3-6438-4510-b4f2-6d1ae7679cca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:00.798165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa66c3-6438-4510-b4f2-6d1ae7679cca None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:00.820543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 351/681] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Aug 4 22:13:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:00.826094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa66c3-6438-4510-b4f2-6d1ae7679cca None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:00.898156 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:00.948318 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfe1d7-456d-4bcf-bb44-23b42b08d982 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:00.986522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26f2fa-3f0b-4419-9f97-ff9cf72c8420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:00.987422 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26f2fa-3f0b-4419-9f97-ff9cf72c8420 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:00.987919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26f2fa-3f0b-4419-9f97-ff9cf72c8420 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:00.988197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26f2fa-3f0b-4419-9f97-ff9cf72c8420 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:00.996362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26f2fa-3f0b-4419-9f97-ff9cf72c8420 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:00.997861 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26f2fa-3f0b-4419-9f97-ff9cf72c8420 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:01.002445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa66c3-6438-4510-b4f2-6d1ae7679cca None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-cd26f2fa-3f0b-4419-9f97-ff9cf72c8420 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:01.010453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:01.011392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:01.012271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:01.012271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:01.012271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:01.012271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:01.012271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:01.012271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:01.012271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:01.012271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:01.012271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 331/682] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:01.013186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915178f-acaf-421d-bf83-a115f463cdae None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:01.013465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915178f-acaf-421d-bf83-a115f463cdae None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:01.013742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915178f-acaf-421d-bf83-a115f463cdae None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:01.022560 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 332/683] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:01.022560 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915178f-acaf-421d-bf83-a115f463cdae None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:01.049405 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd4917-bc8c-479a-ab6f-28bdfe75699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:01.050029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd4917-bc8c-479a-ab6f-28bdfe75699a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:01.050630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd4917-bc8c-479a-ab6f-28bdfe75699a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:01.050630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd4917-bc8c-479a-ab6f-28bdfe75699a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:01.096586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:01.137291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd4917-bc8c-479a-ab6f-28bdfe75699a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:01.139137 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd4917-bc8c-479a-ab6f-28bdfe75699a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:01.156568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915178f-acaf-421d-bf83-a115f463cdae None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:01.187399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:01.194864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08641d-7e0a-475e-8c69-424b32519cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:01.195482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08641d-7e0a-475e-8c69-424b32519cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:01.195776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08641d-7e0a-475e-8c69-424b32519cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:01.196043 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08641d-7e0a-475e-8c69-424b32519cc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:01.196778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08641d-7e0a-475e-8c69-424b32519cc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:01.197084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08641d-7e0a-475e-8c69-424b32519cc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:01.198553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08641d-7e0a-475e-8c69-424b32519cc4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:01.216580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 333/684] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:01.218012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf12e6c-3762-4845-941b-b20ad9409429 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:01.218305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf12e6c-3762-4845-941b-b20ad9409429 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:01.218610 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf12e6c-3762-4845-941b-b20ad9409429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:01.237536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-cbf12e6c-3762-4845-941b-b20ad9409429 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:01.238754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-cbf12e6c-3762-4845-941b-b20ad9409429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:01.247830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 352/685] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 22:13:01.248927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd4917-bc8c-479a-ab6f-28bdfe75699a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:01.316039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:01.322794 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 334/686] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:13:01.323822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf12e6c-3762-4845-941b-b20ad9409429 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:01.354076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd4917-bc8c-479a-ab6f-28bdfe75699a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:01.395074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a8b91-682b-4a2f-afcd-ad2399f34234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:01.395688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a8b91-682b-4a2f-afcd-ad2399f34234 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:01.395965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a8b91-682b-4a2f-afcd-ad2399f34234 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:01.396265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a8b91-682b-4a2f-afcd-ad2399f34234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:01.397047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a8b91-682b-4a2f-afcd-ad2399f34234 None admin] RBAC: Adding query filter params (role.id=aed7c83a35d741538254f3d4775f4a0e, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=9ee0de72ba804ba491342a8ae82a44f7) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:01.397363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a8b91-682b-4a2f-afcd-ad2399f34234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:01.398810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a8b91-682b-4a2f-afcd-ad2399f34234 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:01.406478 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 353/687] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:01 2022] GET /identity/v3/role_assignments?user.id=9ee0de72ba804ba491342a8ae82a44f7&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=aed7c83a35d741538254f3d4775f4a0e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:01.406478 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a8b91-682b-4a2f-afcd-ad2399f34234 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:01.500610 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf12e6c-3762-4845-941b-b20ad9409429 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:01.535803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:01.537274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a8b91-682b-4a2f-afcd-ad2399f34234 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:01.570206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:01.576900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7c342-750a-49ae-be0b-76485ab29094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:01.579135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7c342-750a-49ae-be0b-76485ab29094 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:01.580902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada225c3-2952-497b-a874-cbeb00f6dc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:01.581471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7c342-750a-49ae-be0b-76485ab29094 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:01.582340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada225c3-2952-497b-a874-cbeb00f6dc86 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:01.582858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7c342-750a-49ae-be0b-76485ab29094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:01.584017 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada225c3-2952-497b-a874-cbeb00f6dc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:01.584491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada225c3-2952-497b-a874-cbeb00f6dc86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:01.603437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7c342-750a-49ae-be0b-76485ab29094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:01.605239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7c342-750a-49ae-be0b-76485ab29094 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:01.609879 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada225c3-2952-497b-a874-cbeb00f6dc86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:01.611594 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada225c3-2952-497b-a874-cbeb00f6dc86 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-2bd7c342-750a-49ae-be0b-76485ab29094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:01.622290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:01.623303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:01.624173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:01.624173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:01.624173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:01.624173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:01.624173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 335/688] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-ada225c3-2952-497b-a874-cbeb00f6dc86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:01.629873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:01.631373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:01.632268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:01.632268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:01.632268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:01.632268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:01.632482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7c342-750a-49ae-be0b-76485ab29094 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:01.634260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 354/689] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:01.643144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada225c3-2952-497b-a874-cbeb00f6dc86 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:01.820095 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7c342-750a-49ae-be0b-76485ab29094 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:01.863387 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2db17b-e2c0-4853-ad1d-cb2c952a4419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:01.866111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2db17b-e2c0-4853-ad1d-cb2c952a4419 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:01.866560 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2db17b-e2c0-4853-ad1d-cb2c952a4419 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:01.866990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2db17b-e2c0-4853-ad1d-cb2c952a4419 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:01.867827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2db17b-e2c0-4853-ad1d-cb2c952a4419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:01.869227 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2db17b-e2c0-4853-ad1d-cb2c952a4419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:01.870862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2db17b-e2c0-4853-ad1d-cb2c952a4419 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:01.895234 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 336/690] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:01.902099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2db17b-e2c0-4853-ad1d-cb2c952a4419 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:01.954807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:01.955947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada225c3-2952-497b-a874-cbeb00f6dc86 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:02.000019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeab77-d367-45c9-8e26-6cbbb62ba6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:02.000649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeab77-d367-45c9-8e26-6cbbb62ba6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:02.000926 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeab77-d367-45c9-8e26-6cbbb62ba6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:02.001198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeab77-d367-45c9-8e26-6cbbb62ba6f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:02.001883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeab77-d367-45c9-8e26-6cbbb62ba6f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:02.002184 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeab77-d367-45c9-8e26-6cbbb62ba6f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:02.003569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeab77-d367-45c9-8e26-6cbbb62ba6f4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:02.025508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2db17b-e2c0-4853-ad1d-cb2c952a4419 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:02.030337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 355/691] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:02.035760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeab77-d367-45c9-8e26-6cbbb62ba6f4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:02.065059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679613bb-5272-4c50-98f9-3103635acb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:02.065710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679613bb-5272-4c50-98f9-3103635acb96 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:02.066001 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679613bb-5272-4c50-98f9-3103635acb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:02.066276 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679613bb-5272-4c50-98f9-3103635acb96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:02.079877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679613bb-5272-4c50-98f9-3103635acb96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:02.081736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679613bb-5272-4c50-98f9-3103635acb96 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-679613bb-5272-4c50-98f9-3103635acb96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:02.108282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:02.109697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:02.110686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:02.110686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:02.110686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:02.110686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:02.110686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:02.110686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:02.110686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:02.110686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:02.115710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 337/692] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:02.117397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:02.118211 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679613bb-5272-4c50-98f9-3103635acb96 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:02.214761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:02.216320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeab77-d367-45c9-8e26-6cbbb62ba6f4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:02.230583 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679613bb-5272-4c50-98f9-3103635acb96 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:02.267149 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89b6ef-dd01-4e19-a880-4bc16c06dbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:02.267786 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89b6ef-dd01-4e19-a880-4bc16c06dbe7 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:02.268067 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89b6ef-dd01-4e19-a880-4bc16c06dbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:02.268406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89b6ef-dd01-4e19-a880-4bc16c06dbe7 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:02.269087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89b6ef-dd01-4e19-a880-4bc16c06dbe7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:02.270608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89b6ef-dd01-4e19-a880-4bc16c06dbe7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:02.274621 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91f04e-0990-4593-bdc4-ceafd4d5648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:02.275248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91f04e-0990-4593-bdc4-ceafd4d5648f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:02.275533 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91f04e-0990-4593-bdc4-ceafd4d5648f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:02.275812 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91f04e-0990-4593-bdc4-ceafd4d5648f None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:02.276636 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91f04e-0990-4593-bdc4-ceafd4d5648f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:02.276948 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91f04e-0990-4593-bdc4-ceafd4d5648f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:02.278365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91f04e-0990-4593-bdc4-ceafd4d5648f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:02.296339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 338/693] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:02.298512 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91f04e-0990-4593-bdc4-ceafd4d5648f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:02.309357 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 356/694] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:13:02 2022] POST /identity/v3/users => generated 254 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:13:02.414881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91f04e-0990-4593-bdc4-ceafd4d5648f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:02.450769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e401f31-7564-4367-a6e0-66f8c67556e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:02.451656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401f31-7564-4367-a6e0-66f8c67556e7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:02.451940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401f31-7564-4367-a6e0-66f8c67556e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:02.452217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401f31-7564-4367-a6e0-66f8c67556e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:02.453020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e401f31-7564-4367-a6e0-66f8c67556e7 None admin] RBAC: Adding query filter params (role.id=aed7c83a35d741538254f3d4775f4a0e, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=aa5bf773ed3a4f1e916671a22c65f031) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:02.453333 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e401f31-7564-4367-a6e0-66f8c67556e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:02.454783 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e401f31-7564-4367-a6e0-66f8c67556e7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:02.470439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 339/695] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:02 2022] GET /identity/v3/role_assignments?user.id=aa5bf773ed3a4f1e916671a22c65f031&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=aed7c83a35d741538254f3d4775f4a0e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:02.725797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6a47-5bb2-4e81-abe9-b1498351e392 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:02.726141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6a47-5bb2-4e81-abe9-b1498351e392 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:02.726332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6a47-5bb2-4e81-abe9-b1498351e392 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:02.727806 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 357/696] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:02.732970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddda8c-5e7b-4032-a495-4d2e0cde0cb3 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:02.733266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddda8c-5e7b-4032-a495-4d2e0cde0cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:02.733544 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddda8c-5e7b-4032-a495-4d2e0cde0cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:02.753889 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6fddda8c-5e7b-4032-a495-4d2e0cde0cb3 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:02.755111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6fddda8c-5e7b-4032-a495-4d2e0cde0cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:02.767460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:02.832413 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 340/697] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:13:02.857034 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b6a47-5bb2-4e81-abe9-b1498351e392 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:02.978220 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:02.983307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b6a47-5bb2-4e81-abe9-b1498351e392 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:03.028985 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd17c08-5228-4437-bd36-78ad574469cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:03.029684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd17c08-5228-4437-bd36-78ad574469cc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:03.029971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd17c08-5228-4437-bd36-78ad574469cc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:03.030242 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd17c08-5228-4437-bd36-78ad574469cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:03.042625 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aadd52-7f79-49d1-97e5-f3dfb5c00d29 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:03.043254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aadd52-7f79-49d1-97e5-f3dfb5c00d29 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:03.043836 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aadd52-7f79-49d1-97e5-f3dfb5c00d29 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:03.044381 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd17c08-5228-4437-bd36-78ad574469cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:03.045629 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 341/698] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-8fd17c08-5228-4437-bd36-78ad574469cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:03.049974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:03.050975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:03.051824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:03.051824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:03.051824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:03.051824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:03.051824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:03.051824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:03.051824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:03.051824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:03.051824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:03.051824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:03.051824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:03.051824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:03.053106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ddf33-e563-4394-b33b-93fb8fef9a71 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:03.053106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ddf33-e563-4394-b33b-93fb8fef9a71 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:03.053106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ddf33-e563-4394-b33b-93fb8fef9a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:03.056352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 358/699] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:13:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:03.057399 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd17c08-5228-4437-bd36-78ad574469cc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:03.099484 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-035ddf33-e563-4394-b33b-93fb8fef9a71 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:03.100680 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-035ddf33-e563-4394-b33b-93fb8fef9a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:03.185398 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd17c08-5228-4437-bd36-78ad574469cc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:03.231559 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae375a-cdfa-4028-9590-5d394fd7f579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:03.232092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae375a-cdfa-4028-9590-5d394fd7f579 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:03.232367 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae375a-cdfa-4028-9590-5d394fd7f579 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:03.232638 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae375a-cdfa-4028-9590-5d394fd7f579 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:03.233349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae375a-cdfa-4028-9590-5d394fd7f579 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:03.233651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae375a-cdfa-4028-9590-5d394fd7f579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:03.235082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae375a-cdfa-4028-9590-5d394fd7f579 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:03.237139 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 342/700] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 04 22:13:03.244438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 359/701] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:13:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:03.249729 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ddf33-e563-4394-b33b-93fb8fef9a71 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:03.261984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae375a-cdfa-4028-9590-5d394fd7f579 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:03.284749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:03.374434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae375a-cdfa-4028-9590-5d394fd7f579 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:03.404891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:03.423426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a61f7-23eb-4c08-879c-09fae314e3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:03.424075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a61f7-23eb-4c08-879c-09fae314e3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:03.424349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a61f7-23eb-4c08-879c-09fae314e3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:03.424618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a61f7-23eb-4c08-879c-09fae314e3f8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:03.425242 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a61f7-23eb-4c08-879c-09fae314e3f8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:03.426620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a61f7-23eb-4c08-879c-09fae314e3f8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2c8a61f7-23eb-4c08-879c-09fae314e3f8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:03.442001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:03.443105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 22:13:03.443968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:03.444775 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 360/702] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Aug 4 22:13:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:03.455022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ddf33-e563-4394-b33b-93fb8fef9a71 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:03.458149 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a61f7-23eb-4c08-879c-09fae314e3f8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:03.526326 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35824052-678b-4310-b7df-425b08747fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:03.526915 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35824052-678b-4310-b7df-425b08747fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:03.527191 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35824052-678b-4310-b7df-425b08747fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:03.527461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35824052-678b-4310-b7df-425b08747fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:03.549929 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35824052-678b-4310-b7df-425b08747fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:03.551414 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35824052-678b-4310-b7df-425b08747fd0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-35824052-678b-4310-b7df-425b08747fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:03.570847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:03.571897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:03.572790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:03.572790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:03.572790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:03.572790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:03.572790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 343/703] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:03.580052 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35824052-678b-4310-b7df-425b08747fd0 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:03.629929 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:03.658984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a61f7-23eb-4c08-879c-09fae314e3f8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:03.722228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebffaa7-7085-4f18-b1a1-b5d5f10c0979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:03.722888 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebffaa7-7085-4f18-b1a1-b5d5f10c0979 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:03.723171 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebffaa7-7085-4f18-b1a1-b5d5f10c0979 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:03.723448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebffaa7-7085-4f18-b1a1-b5d5f10c0979 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:03.724186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebffaa7-7085-4f18-b1a1-b5d5f10c0979 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:03.724991 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebffaa7-7085-4f18-b1a1-b5d5f10c0979 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:03.726372 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebffaa7-7085-4f18-b1a1-b5d5f10c0979 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:03.740811 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 361/704] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Aug 4 22:13:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:03.745845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebffaa7-7085-4f18-b1a1-b5d5f10c0979 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:03.774374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35824052-678b-4310-b7df-425b08747fd0 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:03.825869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:03.837771 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fbe43-9ca0-41d1-8559-3462dfbfbcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:03.838521 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fbe43-9ca0-41d1-8559-3462dfbfbcbd None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:03.838761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fbe43-9ca0-41d1-8559-3462dfbfbcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:03.839039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fbe43-9ca0-41d1-8559-3462dfbfbcbd None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:03.839804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fbe43-9ca0-41d1-8559-3462dfbfbcbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:03.840114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fbe43-9ca0-41d1-8559-3462dfbfbcbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:03.841480 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fbe43-9ca0-41d1-8559-3462dfbfbcbd None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:03.859792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 344/705] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:03.861235 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fbe43-9ca0-41d1-8559-3462dfbfbcbd None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:03.946644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebffaa7-7085-4f18-b1a1-b5d5f10c0979 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:03.999715 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fbe43-9ca0-41d1-8559-3462dfbfbcbd None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:04.003854 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205e8fc-5ca5-499c-85bf-262b81d38351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:04.005049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205e8fc-5ca5-499c-85bf-262b81d38351 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:04.005619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205e8fc-5ca5-499c-85bf-262b81d38351 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:04.006113 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205e8fc-5ca5-499c-85bf-262b81d38351 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:04.007036 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205e8fc-5ca5-499c-85bf-262b81d38351 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:04.007550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205e8fc-5ca5-499c-85bf-262b81d38351 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:04.009666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205e8fc-5ca5-499c-85bf-262b81d38351 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:04.026436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 362/706] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Aug 4 22:13:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:04.026436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d483f0-995e-478b-9f8b-94cd497a476c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:04.026436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d483f0-995e-478b-9f8b-94cd497a476c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:04.026436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d483f0-995e-478b-9f8b-94cd497a476c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:04.026436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 363/707] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:04.038562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1bc4-8fb5-496e-ba15-d30589a443c0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:04.038893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1bc4-8fb5-496e-ba15-d30589a443c0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:04.039113 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1bc4-8fb5-496e-ba15-d30589a443c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:04.068496 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ffba1bc4-8fb5-496e-ba15-d30589a443c0 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:04.069726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ffba1bc4-8fb5-496e-ba15-d30589a443c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:04.081230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:04.084246 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca5dfb-6e84-4236-a5c1-515db7c69282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:04.084917 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca5dfb-6e84-4236-a5c1-515db7c69282 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:04.085490 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca5dfb-6e84-4236-a5c1-515db7c69282 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:04.085490 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca5dfb-6e84-4236-a5c1-515db7c69282 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:04.098242 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca5dfb-6e84-4236-a5c1-515db7c69282 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:04.100330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca5dfb-6e84-4236-a5c1-515db7c69282 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-83ca5dfb-6e84-4236-a5c1-515db7c69282 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:04.124567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:04.126317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:04.127589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:04.127589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:04.127589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:04.127589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:04.127589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:04.127589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:04.127589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:04.127589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:04.127589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:13:04.127589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:04.133374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 345/708] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 4 22:13:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:04.134337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca5dfb-6e84-4236-a5c1-515db7c69282 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:04.186397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 364/709] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:13:04.230394 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1bc4-8fb5-496e-ba15-d30589a443c0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:04.238747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:04.320482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca5dfb-6e84-4236-a5c1-515db7c69282 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:04.388447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8ceee-802f-4846-99f8-139260da5e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:04.388997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8ceee-802f-4846-99f8-139260da5e85 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:04.389279 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8ceee-802f-4846-99f8-139260da5e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:04.389556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8ceee-802f-4846-99f8-139260da5e85 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:04.390663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8ceee-802f-4846-99f8-139260da5e85 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:04.392345 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8ceee-802f-4846-99f8-139260da5e85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:04.393797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8ceee-802f-4846-99f8-139260da5e85 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:04.430883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1bc4-8fb5-496e-ba15-d30589a443c0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:04.437343 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 346/710] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 4 22:13:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:04.439778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8ceee-802f-4846-99f8-139260da5e85 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:04.504710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffcd4f-df52-41e8-af13-ea1fa5701b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:04.505382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffcd4f-df52-41e8-af13-ea1fa5701b93 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:04.505703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffcd4f-df52-41e8-af13-ea1fa5701b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:04.505981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffcd4f-df52-41e8-af13-ea1fa5701b93 None admin] PATH_INFO: `/v3/services/network` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:04.506821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffcd4f-df52-41e8-af13-ea1fa5701b93 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:04.510869 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffcd4f-df52-41e8-af13-ea1fa5701b93 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-83ffcd4f-df52-41e8-af13-ea1fa5701b93 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:04.528579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:04.529633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:04.530501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:04.530501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:04.530501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:04.530501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:04.530501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:04.530501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:04.530501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:04.530501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:04.530501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:04.530501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:04.530501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:04.530501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:04.530501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 22:13:04.530501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:04.534767 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 365/711] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:04 2022] GET /identity/v3/services/network => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:04.539215 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffcd4f-df52-41e8-af13-ea1fa5701b93 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:04.561498 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:04.644409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8ceee-802f-4846-99f8-139260da5e85 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:04.660322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:04.708241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf675df-ad64-408e-b953-b141bf344258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:04.709277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf675df-ad64-408e-b953-b141bf344258 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:04.709660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf675df-ad64-408e-b953-b141bf344258 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:04.710041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf675df-ad64-408e-b953-b141bf344258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:04.739036 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffcd4f-df52-41e8-af13-ea1fa5701b93 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:04.783896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf675df-ad64-408e-b953-b141bf344258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:04.785353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf675df-ad64-408e-b953-b141bf344258 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:04.817642 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d27ab2-bb0f-4c88-bb8c-437bb68f7067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:04.818844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d27ab2-bb0f-4c88-bb8c-437bb68f7067 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:04.819126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d27ab2-bb0f-4c88-bb8c-437bb68f7067 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:04.819402 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d27ab2-bb0f-4c88-bb8c-437bb68f7067 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:04.820083 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d27ab2-bb0f-4c88-bb8c-437bb68f7067 None admin] RBAC: Adding query filter params (name=network) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:04.820386 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d27ab2-bb0f-4c88-bb8c-437bb68f7067 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:04.821772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d27ab2-bb0f-4c88-bb8c-437bb68f7067 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:04.830938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 366/712] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 4 22:13:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:04.832276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e24798-a981-4d9c-a578-659c1705556a None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:04.832568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e24798-a981-4d9c-a578-659c1705556a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:04.832840 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e24798-a981-4d9c-a578-659c1705556a None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:04.838323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 367/713] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:04.839765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d186d1-9660-41ed-acba-701153367d09 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:04.840054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d186d1-9660-41ed-acba-701153367d09 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:04.840331 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d186d1-9660-41ed-acba-701153367d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:04.860764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-93d186d1-9660-41ed-acba-701153367d09 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:04.861997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-93d186d1-9660-41ed-acba-701153367d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:04.936440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:04.941530 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 347/714] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 04 22:13:04.942782 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf675df-ad64-408e-b953-b141bf344258 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:04.954986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 368/715] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:13:04.955988 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:04.957192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d186d1-9660-41ed-acba-701153367d09 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:05.053135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf675df-ad64-408e-b953-b141bf344258 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:05.073893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d186d1-9660-41ed-acba-701153367d09 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:05.089032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502b659-173c-4939-9f70-852d051ec91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:05.089358 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502b659-173c-4939-9f70-852d051ec91a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:05.089633 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502b659-173c-4939-9f70-852d051ec91a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:05.089902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502b659-173c-4939-9f70-852d051ec91a None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:05.090596 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502b659-173c-4939-9f70-852d051ec91a None admin] RBAC: Adding query filter params (type=network) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:05.090897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502b659-173c-4939-9f70-852d051ec91a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:05.092242 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502b659-173c-4939-9f70-852d051ec91a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:05.102438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 348/716] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 4 22:13:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:05.102438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502b659-173c-4939-9f70-852d051ec91a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:05.123469 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fca42f-873b-470b-9226-e847bf4a7f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:05.124250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fca42f-873b-470b-9226-e847bf4a7f93 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:05.124533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fca42f-873b-470b-9226-e847bf4a7f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:05.124917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fca42f-873b-470b-9226-e847bf4a7f93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:05.137319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fca42f-873b-470b-9226-e847bf4a7f93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:05.139101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fca42f-873b-470b-9226-e847bf4a7f93 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-54fca42f-873b-470b-9226-e847bf4a7f93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:05.156287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:05.157606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:05.158524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:05.158524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:05.158524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:05.158524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:05.162900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 369/717] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:05.164530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e143f-d8e7-46d5-a12d-50c0739a511b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:05.164817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e143f-d8e7-46d5-a12d-50c0739a511b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:05.165091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e143f-d8e7-46d5-a12d-50c0739a511b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:05.170483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 370/718] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:05.170483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e143f-d8e7-46d5-a12d-50c0739a511b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:05.195229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:05.236665 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:05.242557 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502b659-173c-4939-9f70-852d051ec91a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:05.281417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97838eb8-1e0f-4370-b40d-ed93c57d8b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:05.282170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97838eb8-1e0f-4370-b40d-ed93c57d8b37 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:05.282559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97838eb8-1e0f-4370-b40d-ed93c57d8b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:05.282911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97838eb8-1e0f-4370-b40d-ed93c57d8b37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:05.295018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e143f-d8e7-46d5-a12d-50c0739a511b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:05.295229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97838eb8-1e0f-4370-b40d-ed93c57d8b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-97838eb8-1e0f-4370-b40d-ed93c57d8b37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:05.301685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:05.302787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:05.303627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:05.303627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:05.303627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:05.303627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:05.303627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:05.303627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:05.303627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:05.303627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:05.303627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:05.303627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:05.303627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:13:05.303627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:05.303627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 349/719] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:13:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:05.304521 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ad047-4f80-4d85-8958-5b74d80ef7c5 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:05.304745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ad047-4f80-4d85-8958-5b74d80ef7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:05.305023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ad047-4f80-4d85-8958-5b74d80ef7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:05.331496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-721ad047-4f80-4d85-8958-5b74d80ef7c5 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:05.333058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-721ad047-4f80-4d85-8958-5b74d80ef7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:05.346307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac91a49-2f41-490f-9bd4-7658245eccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:05.347003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac91a49-2f41-490f-9bd4-7658245eccf2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:05.347284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac91a49-2f41-490f-9bd4-7658245eccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:05.347559 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac91a49-2f41-490f-9bd4-7658245eccf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:05.348255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac91a49-2f41-490f-9bd4-7658245eccf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:05.348559 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac91a49-2f41-490f-9bd4-7658245eccf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:05.350537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac91a49-2f41-490f-9bd4-7658245eccf2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:05.370303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 371/720] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:05.370303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac91a49-2f41-490f-9bd4-7658245eccf2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:05.430432 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 350/721] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:13:05.430432 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ad047-4f80-4d85-8958-5b74d80ef7c5 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:05.507453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:05.508539 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac91a49-2f41-490f-9bd4-7658245eccf2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:05.527361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:05.557507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562279c-de82-4ea0-b079-7f8c39958edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:05.557891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ad047-4f80-4d85-8958-5b74d80ef7c5 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:05.558693 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562279c-de82-4ea0-b079-7f8c39958edc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:05.559161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562279c-de82-4ea0-b079-7f8c39958edc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:05.559860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562279c-de82-4ea0-b079-7f8c39958edc None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:05.561688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562279c-de82-4ea0-b079-7f8c39958edc None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:05.562206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562279c-de82-4ea0-b079-7f8c39958edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:05.563823 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562279c-de82-4ea0-b079-7f8c39958edc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:05.580004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 372/722] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:13:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:05.580873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562279c-de82-4ea0-b079-7f8c39958edc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:05.600474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd977a-9989-4a7e-9eb7-1bdf48657b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:05.601559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd977a-9989-4a7e-9eb7-1bdf48657b37 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:05.602080 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd977a-9989-4a7e-9eb7-1bdf48657b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:05.602613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd977a-9989-4a7e-9eb7-1bdf48657b37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:05.610555 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd977a-9989-4a7e-9eb7-1bdf48657b37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:05.612395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd977a-9989-4a7e-9eb7-1bdf48657b37 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-30bd977a-9989-4a7e-9eb7-1bdf48657b37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:05.625000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:05.625953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:05.627119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:05.627119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:05.627119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:05.627119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:05.627119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:05.627119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:05.627119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:05.627119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:05.634310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 351/723] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:05.635465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd977a-9989-4a7e-9eb7-1bdf48657b37 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:05.702311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562279c-de82-4ea0-b079-7f8c39958edc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:05.751995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd977a-9989-4a7e-9eb7-1bdf48657b37 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:05.756442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34013f2b-3130-43b1-8b8f-6b17be49aba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:05.757265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34013f2b-3130-43b1-8b8f-6b17be49aba8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:05.757725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34013f2b-3130-43b1-8b8f-6b17be49aba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:05.758165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34013f2b-3130-43b1-8b8f-6b17be49aba8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:05.769203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34013f2b-3130-43b1-8b8f-6b17be49aba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:05.773966 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-34013f2b-3130-43b1-8b8f-6b17be49aba8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:05.775382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:05.776579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:05.777763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:05.777763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:05.777763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:05.777763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:05.777763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:05.777763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:05.777763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:05.777763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:05.777763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:05.777763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:05.777763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:05.777763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:05.785039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 373/724] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:05.786209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34013f2b-3130-43b1-8b8f-6b17be49aba8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:05.790058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aed215-f941-48f1-80a9-cd36f96bde80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:05.790823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aed215-f941-48f1-80a9-cd36f96bde80 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:05.791105 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aed215-f941-48f1-80a9-cd36f96bde80 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:05.792321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aed215-f941-48f1-80a9-cd36f96bde80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:05.804804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aed215-f941-48f1-80a9-cd36f96bde80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:05.806586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aed215-f941-48f1-80a9-cd36f96bde80 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-03aed215-f941-48f1-80a9-cd36f96bde80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:05.822468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:05.823665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:05.824832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:05.824832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:05.824832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:05.824832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:05.826075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 352/725] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:05.827248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aed215-f941-48f1-80a9-cd36f96bde80 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:05.828321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:05.925512 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34013f2b-3130-43b1-8b8f-6b17be49aba8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:05.944812 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aed215-f941-48f1-80a9-cd36f96bde80 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:05.973189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95d504-dec4-4c84-bf45-78eb6074d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:05.973812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95d504-dec4-4c84-bf45-78eb6074d208 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:05.974932 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95d504-dec4-4c84-bf45-78eb6074d208 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:05.976004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95d504-dec4-4c84-bf45-78eb6074d208 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:05.976770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95d504-dec4-4c84-bf45-78eb6074d208 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:05.977082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95d504-dec4-4c84-bf45-78eb6074d208 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:05.978567 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95d504-dec4-4c84-bf45-78eb6074d208 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:05.987016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5e105-8ff5-4cbe-aa21-1131e964ca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:05.988519 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e105-8ff5-4cbe-aa21-1131e964ca55 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:05.989027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e105-8ff5-4cbe-aa21-1131e964ca55 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:05.989827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e105-8ff5-4cbe-aa21-1131e964ca55 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:05.990780 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5e105-8ff5-4cbe-aa21-1131e964ca55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:05.991293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5e105-8ff5-4cbe-aa21-1131e964ca55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:05.991747 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 374/726] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:05.992586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95d504-dec4-4c84-bf45-78eb6074d208 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:05.993404 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5e105-8ff5-4cbe-aa21-1131e964ca55 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:06.004629 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 353/727] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:06.006224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5e105-8ff5-4cbe-aa21-1131e964ca55 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:06.053331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:06.095721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:06.105790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95d504-dec4-4c84-bf45-78eb6074d208 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:06.147017 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5e105-8ff5-4cbe-aa21-1131e964ca55 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:06.148095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce141b-abc5-4432-9e2e-f09b65dc6244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:06.150114 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce141b-abc5-4432-9e2e-f09b65dc6244 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:06.150654 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce141b-abc5-4432-9e2e-f09b65dc6244 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:06.151155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce141b-abc5-4432-9e2e-f09b65dc6244 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:06.152052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce141b-abc5-4432-9e2e-f09b65dc6244 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:06.152561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce141b-abc5-4432-9e2e-f09b65dc6244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:06.154774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce141b-abc5-4432-9e2e-f09b65dc6244 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:06.175415 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 375/728] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:06.175415 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce141b-abc5-4432-9e2e-f09b65dc6244 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:06.191365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34f007-2665-4a61-9172-0a1f90553b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:06.193108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34f007-2665-4a61-9172-0a1f90553b29 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:06.193603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34f007-2665-4a61-9172-0a1f90553b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:06.194082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34f007-2665-4a61-9172-0a1f90553b29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:06.195378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34f007-2665-4a61-9172-0a1f90553b29 None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=04899781f67746e193a05bdc004804cc) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:06.195901 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34f007-2665-4a61-9172-0a1f90553b29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:06.198237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34f007-2665-4a61-9172-0a1f90553b29 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:06.206362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 354/729] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:06 2022] GET /identity/v3/role_assignments?user.id=04899781f67746e193a05bdc004804cc&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=0053c24ce06147938dbb61657a531c94 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:06.207766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34f007-2665-4a61-9172-0a1f90553b29 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:06.308884 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce141b-abc5-4432-9e2e-f09b65dc6244 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:06.337244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:06.341311 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34f007-2665-4a61-9172-0a1f90553b29 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:06.347376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae11880-064f-4a25-a9e8-c3e2e8b54597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:06.348095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11880-064f-4a25-a9e8-c3e2e8b54597 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:06.348385 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11880-064f-4a25-a9e8-c3e2e8b54597 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:06.348666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11880-064f-4a25-a9e8-c3e2e8b54597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:06.361102 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae11880-064f-4a25-a9e8-c3e2e8b54597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:06.364252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae11880-064f-4a25-a9e8-c3e2e8b54597 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1ae11880-064f-4a25-a9e8-c3e2e8b54597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:06.382023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:06.383041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:06.383949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:06.383949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:06.383949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:06.383949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:06.384171 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba4d15-179b-451d-bf62-18eb0a70dd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:06.384721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba4d15-179b-451d-bf62-18eb0a70dd87 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:06.384952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba4d15-179b-451d-bf62-18eb0a70dd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:06.385224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba4d15-179b-451d-bf62-18eb0a70dd87 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:06.388421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 376/730] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:06.389814 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea75d1-8b65-4bcb-ad21-6c2e13fd6fa9 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:06.390104 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea75d1-8b65-4bcb-ad21-6c2e13fd6fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:06.390383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea75d1-8b65-4bcb-ad21-6c2e13fd6fa9 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:06.391917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 377/731] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:06.396761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea75d1-8b65-4bcb-ad21-6c2e13fd6fa9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:06.396900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba4d15-179b-451d-bf62-18eb0a70dd87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:06.399329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba4d15-179b-451d-bf62-18eb0a70dd87 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:06.404795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d3ba4d15-179b-451d-bf62-18eb0a70dd87 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:06.417896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:06.418932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:06.419872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:06.419872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:06.419872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:06.419872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:06.419872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:06.419872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:06.419872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:06.419872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:06.419872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 22:13:06.419872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:06.422834 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 355/732] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 4 22:13:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:06.424911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab87bbf-440b-4911-9c65-37043b5b2435 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:06.425370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab87bbf-440b-4911-9c65-37043b5b2435 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:06.426074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab87bbf-440b-4911-9c65-37043b5b2435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:06.450753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5ab87bbf-440b-4911-9c65-37043b5b2435 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:06.452215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5ab87bbf-440b-4911-9c65-37043b5b2435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:06.535525 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 356/733] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:13:06.536475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab87bbf-440b-4911-9c65-37043b5b2435 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:06.548260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea75d1-8b65-4bcb-ad21-6c2e13fd6fa9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:06.596665 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4233e33-9bea-41db-b1f4-c12a0521b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:06.597747 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4233e33-9bea-41db-b1f4-c12a0521b7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:06.598166 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4233e33-9bea-41db-b1f4-c12a0521b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:06.598589 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4233e33-9bea-41db-b1f4-c12a0521b7a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:06.599316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4233e33-9bea-41db-b1f4-c12a0521b7a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:06.599875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4233e33-9bea-41db-b1f4-c12a0521b7a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:06.601907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4233e33-9bea-41db-b1f4-c12a0521b7a3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:06.617645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 378/734] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:06.618611 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4233e33-9bea-41db-b1f4-c12a0521b7a3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:06.635836 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:06.650733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab87bbf-440b-4911-9c65-37043b5b2435 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:06.702833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:06.744064 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4233e33-9bea-41db-b1f4-c12a0521b7a3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:06.781495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96eb6b-dad0-48b1-90dd-603d7e65db3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:06.782148 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96eb6b-dad0-48b1-90dd-603d7e65db3e None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:06.782453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96eb6b-dad0-48b1-90dd-603d7e65db3e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:06.782733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96eb6b-dad0-48b1-90dd-603d7e65db3e None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:06.783426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96eb6b-dad0-48b1-90dd-603d7e65db3e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:06.784797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96eb6b-dad0-48b1-90dd-603d7e65db3e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:06.805476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 379/735] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 4 22:13:06 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:13:06.806356 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96eb6b-dad0-48b1-90dd-603d7e65db3e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:06.824602 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07db66f-9329-4338-8ee4-4c3027e14886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:06.825736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07db66f-9329-4338-8ee4-4c3027e14886 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:06.826598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07db66f-9329-4338-8ee4-4c3027e14886 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:06.827119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07db66f-9329-4338-8ee4-4c3027e14886 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:06.828334 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07db66f-9329-4338-8ee4-4c3027e14886 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:06.828916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07db66f-9329-4338-8ee4-4c3027e14886 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:06.830719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07db66f-9329-4338-8ee4-4c3027e14886 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:06.853944 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 357/736] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Aug 4 22:13:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:06.859105 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07db66f-9329-4338-8ee4-4c3027e14886 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:06.937880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96eb6b-dad0-48b1-90dd-603d7e65db3e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:06.971046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:06.986255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78d957-c077-49ef-87bc-09e556f65efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:06.986951 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78d957-c077-49ef-87bc-09e556f65efc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:06.987229 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78d957-c077-49ef-87bc-09e556f65efc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:06.987505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78d957-c077-49ef-87bc-09e556f65efc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:07.008735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78d957-c077-49ef-87bc-09e556f65efc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:07.010230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78d957-c077-49ef-87bc-09e556f65efc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-bd78d957-c077-49ef-87bc-09e556f65efc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:07.030549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:07.031553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:07.032550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:07.032550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:07.032550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:07.032550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:07.032550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:07.032550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:07.032550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:07.032550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:07.032550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 22:13:07.032550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:07.033084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07db66f-9329-4338-8ee4-4c3027e14886 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:07.033475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 380/737] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:13:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:07.040152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78d957-c077-49ef-87bc-09e556f65efc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:07.075315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08089554-02b8-4813-a549-760e0b9d9761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:07.076093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089554-02b8-4813-a549-760e0b9d9761 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:07.076723 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089554-02b8-4813-a549-760e0b9d9761 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:07.077130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08089554-02b8-4813-a549-760e0b9d9761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:07.092219 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:07.155336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08089554-02b8-4813-a549-760e0b9d9761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:07.156859 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08089554-02b8-4813-a549-760e0b9d9761 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:07.178542 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78d957-c077-49ef-87bc-09e556f65efc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:07.222486 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b239d6e-a840-4130-ba88-f9be72733274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:07.223248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b239d6e-a840-4130-ba88-f9be72733274 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:07.223685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b239d6e-a840-4130-ba88-f9be72733274 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:07.224548 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b239d6e-a840-4130-ba88-f9be72733274 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:07.225508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b239d6e-a840-4130-ba88-f9be72733274 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:07.225882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b239d6e-a840-4130-ba88-f9be72733274 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:07.227601 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b239d6e-a840-4130-ba88-f9be72733274 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:07.248918 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 381/738] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Aug 4 22:13:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:07.256271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b239d6e-a840-4130-ba88-f9be72733274 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:07.303395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 358/739] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:06 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:13:07.308662 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08089554-02b8-4813-a549-760e0b9d9761 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:07.346752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:07.361099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:07.402553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b239d6e-a840-4130-ba88-f9be72733274 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:07.435529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08089554-02b8-4813-a549-760e0b9d9761 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:07.438424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977007-06a8-4bff-a5d8-2a0085213d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:07.439128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977007-06a8-4bff-a5d8-2a0085213d8b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:07.439474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977007-06a8-4bff-a5d8-2a0085213d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:07.439813 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977007-06a8-4bff-a5d8-2a0085213d8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:07.477754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbf7f8-787d-4e89-8c6b-c9cea54f1f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:07.478449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbf7f8-787d-4e89-8c6b-c9cea54f1f32 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:07.478743 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbf7f8-787d-4e89-8c6b-c9cea54f1f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:07.479163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbf7f8-787d-4e89-8c6b-c9cea54f1f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:07.493060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbf7f8-787d-4e89-8c6b-c9cea54f1f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:07.494772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbf7f8-787d-4e89-8c6b-c9cea54f1f32 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:07.514337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95977007-06a8-4bff-a5d8-2a0085213d8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-aadbf7f8-787d-4e89-8c6b-c9cea54f1f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:07.514570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:07.515419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:07.516922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:07.516922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:07.516922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:07.516922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:07.516922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 359/740] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:07.517328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e16026-11ad-417e-8131-69d72afb354c None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:07.517615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e16026-11ad-417e-8131-69d72afb354c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:07.517896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e16026-11ad-417e-8131-69d72afb354c None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:07.519694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95977007-06a8-4bff-a5d8-2a0085213d8b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:07.522536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 360/741] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:07.523737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e16026-11ad-417e-8131-69d72afb354c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:07.585737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:07.633881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:07.644094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e16026-11ad-417e-8131-69d72afb354c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:07.655518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 382/742] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:07 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 04 22:13:07.657532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c97a06-eecc-463e-978d-d76a59786f8e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:07.657986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c97a06-eecc-463e-978d-d76a59786f8e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:07.658428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c97a06-eecc-463e-978d-d76a59786f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:07.681461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-75c97a06-eecc-463e-978d-d76a59786f8e None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:07.683687 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-75c97a06-eecc-463e-978d-d76a59786f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:07.690291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c47e6-71a8-4a62-89c5-2bef595a8a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:07.690893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c47e6-71a8-4a62-89c5-2bef595a8a0c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:07.691394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c47e6-71a8-4a62-89c5-2bef595a8a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:07.691675 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c47e6-71a8-4a62-89c5-2bef595a8a0c None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:07.692369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c47e6-71a8-4a62-89c5-2bef595a8a0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:07.692841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c47e6-71a8-4a62-89c5-2bef595a8a0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:07.694267 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c47e6-71a8-4a62-89c5-2bef595a8a0c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:07.710743 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 361/743] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:07.711610 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c47e6-71a8-4a62-89c5-2bef595a8a0c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:07.782497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 383/744] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 04 22:13:07.783703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c97a06-eecc-463e-978d-d76a59786f8e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:07.847901 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c47e6-71a8-4a62-89c5-2bef595a8a0c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:07.884318 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58352b7-7b93-490c-8788-8cd11b6941c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:07.885083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58352b7-7b93-490c-8788-8cd11b6941c6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:07.885244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58352b7-7b93-490c-8788-8cd11b6941c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:07.885525 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58352b7-7b93-490c-8788-8cd11b6941c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:07.899183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58352b7-7b93-490c-8788-8cd11b6941c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:07.900699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58352b7-7b93-490c-8788-8cd11b6941c6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:07.906757 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-e58352b7-7b93-490c-8788-8cd11b6941c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:07.916207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:07.917321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:07.918380 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:07.918380 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:07.918380 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:07.918380 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:07.918991 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c97a06-eecc-463e-978d-d76a59786f8e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:07.922314 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 362/745] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:07.923456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58352b7-7b93-490c-8788-8cd11b6941c6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:07.933574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:07.965765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54344a-8f13-45c4-a094-9e73815edaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:07.966888 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54344a-8f13-45c4-a094-9e73815edaea None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:07.967394 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54344a-8f13-45c4-a094-9e73815edaea None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:07.967871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54344a-8f13-45c4-a094-9e73815edaea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:07.977347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54344a-8f13-45c4-a094-9e73815edaea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:07.979593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54344a-8f13-45c4-a094-9e73815edaea None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-9d54344a-8f13-45c4-a094-9e73815edaea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:07.994620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:07.995538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:07.996450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:07.996450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:07.996450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:07.996450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:07.996450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:07.996450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:07.996450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:07.996450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:08.004063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 384/746] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:08.004063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54344a-8f13-45c4-a094-9e73815edaea None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:08.048734 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58352b7-7b93-490c-8788-8cd11b6941c6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:08.085332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2533938-08d0-4070-ad48-d9a1dfa883e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:08.085995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2533938-08d0-4070-ad48-d9a1dfa883e9 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:08.086282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2533938-08d0-4070-ad48-d9a1dfa883e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:08.086593 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2533938-08d0-4070-ad48-d9a1dfa883e9 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:08.087394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2533938-08d0-4070-ad48-d9a1dfa883e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:08.088770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2533938-08d0-4070-ad48-d9a1dfa883e9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:08.110912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 363/747] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 4 22:13:07 2022] POST /identity/v3/services => generated 240 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:13:08.111937 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2533938-08d0-4070-ad48-d9a1dfa883e9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:08.122681 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54344a-8f13-45c4-a094-9e73815edaea None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:08.176310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:08.187860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0eca0-d0b0-4d67-8080-de2ad38e9c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:08.188653 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0eca0-d0b0-4d67-8080-de2ad38e9c22 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:08.189060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0eca0-d0b0-4d67-8080-de2ad38e9c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:08.189413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0eca0-d0b0-4d67-8080-de2ad38e9c22 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:08.190210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0eca0-d0b0-4d67-8080-de2ad38e9c22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:08.190667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0eca0-d0b0-4d67-8080-de2ad38e9c22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:08.192105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0eca0-d0b0-4d67-8080-de2ad38e9c22 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:08.214811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:08.225123 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 385/748] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:08.234702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0eca0-d0b0-4d67-8080-de2ad38e9c22 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:08.269975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2533938-08d0-4070-ad48-d9a1dfa883e9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:08.311430 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa65e67-55b9-4dc1-b2ed-fc0e5c11a9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:08.312527 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa65e67-55b9-4dc1-b2ed-fc0e5c11a9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:08.313022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa65e67-55b9-4dc1-b2ed-fc0e5c11a9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:08.313501 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa65e67-55b9-4dc1-b2ed-fc0e5c11a9e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:08.314500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa65e67-55b9-4dc1-b2ed-fc0e5c11a9e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:08.315026 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa65e67-55b9-4dc1-b2ed-fc0e5c11a9e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:08.316877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa65e67-55b9-4dc1-b2ed-fc0e5c11a9e1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:08.331601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 364/749] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:08.342683 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa65e67-55b9-4dc1-b2ed-fc0e5c11a9e1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:08.433143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0eca0-d0b0-4d67-8080-de2ad38e9c22 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:08.492481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa65e67-55b9-4dc1-b2ed-fc0e5c11a9e1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:08.494881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04688cb6-cf21-461a-ac34-8288f2762a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:08.496803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04688cb6-cf21-461a-ac34-8288f2762a1f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:08.497268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04688cb6-cf21-461a-ac34-8288f2762a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:08.497728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04688cb6-cf21-461a-ac34-8288f2762a1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:08.507049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04688cb6-cf21-461a-ac34-8288f2762a1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:08.508648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04688cb6-cf21-461a-ac34-8288f2762a1f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-04688cb6-cf21-461a-ac34-8288f2762a1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:08.523421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:08.524368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:08.525285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:08.525285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:08.525285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:08.525285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:08.525285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:08.525285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:08.525285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:08.525285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:08.526640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:08.530467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 386/750] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:08.530467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12184beb-b30b-44d2-9f9e-765f7eb68ced None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:08.530467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12184beb-b30b-44d2-9f9e-765f7eb68ced None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:08.530467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12184beb-b30b-44d2-9f9e-765f7eb68ced None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:08.531192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 387/751] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:08.535570 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12184beb-b30b-44d2-9f9e-765f7eb68ced None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:08.542612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3075d1-d142-49fa-839c-824ea07a0400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:08.543237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3075d1-d142-49fa-839c-824ea07a0400 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:08.543515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3075d1-d142-49fa-839c-824ea07a0400 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:08.543783 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3075d1-d142-49fa-839c-824ea07a0400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:08.544576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3075d1-d142-49fa-839c-824ea07a0400 None admin] RBAC: Adding query filter params (role.id=aed7c83a35d741538254f3d4775f4a0e, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=42a5e67e8b854faa8689654156c994d5) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:08.544882 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3075d1-d142-49fa-839c-824ea07a0400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:08.546362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3075d1-d142-49fa-839c-824ea07a0400 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:08.554463 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 365/752] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:08 2022] GET /identity/v3/role_assignments?user.id=42a5e67e8b854faa8689654156c994d5&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=aed7c83a35d741538254f3d4775f4a0e => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:08.555255 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50ebbf-bc53-41cf-94c4-f1876b8b4f6a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:08.555536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50ebbf-bc53-41cf-94c4-f1876b8b4f6a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:08.555811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50ebbf-bc53-41cf-94c4-f1876b8b4f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:08.577316 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-7c50ebbf-bc53-41cf-94c4-f1876b8b4f6a None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:08.578755 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7c50ebbf-bc53-41cf-94c4-f1876b8b4f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:08.653108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:08.691779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 366/753] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:08.716214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50ebbf-bc53-41cf-94c4-f1876b8b4f6a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:08.765254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12184beb-b30b-44d2-9f9e-765f7eb68ced None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:08.802063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180e9e9-df67-4e6c-b819-4cecef14f477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:08.802748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180e9e9-df67-4e6c-b819-4cecef14f477 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:08.803032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180e9e9-df67-4e6c-b819-4cecef14f477 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:08.803304 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180e9e9-df67-4e6c-b819-4cecef14f477 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:08.804176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180e9e9-df67-4e6c-b819-4cecef14f477 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:08.804547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180e9e9-df67-4e6c-b819-4cecef14f477 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:08.806122 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180e9e9-df67-4e6c-b819-4cecef14f477 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:08.819391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 388/754] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:08.825259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180e9e9-df67-4e6c-b819-4cecef14f477 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:08.911377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50ebbf-bc53-41cf-94c4-f1876b8b4f6a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:08.937309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:08.958584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38d9b5-f9ea-473d-af3e-75b844d1f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:08.959728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38d9b5-f9ea-473d-af3e-75b844d1f297 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:08.960006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38d9b5-f9ea-473d-af3e-75b844d1f297 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:08.960276 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38d9b5-f9ea-473d-af3e-75b844d1f297 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:08.961107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180e9e9-df67-4e6c-b819-4cecef14f477 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:08.974790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:08.988798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38d9b5-f9ea-473d-af3e-75b844d1f297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-0f38d9b5-f9ea-473d-af3e-75b844d1f297 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:08.994426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:08.995359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:08.996190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:08.996190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:08.996190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:08.996190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:08.996190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:08.996190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:08.996190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:08.996190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:08.996190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:08.996190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:08.996190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:08.996190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:08.997776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c62c-1764-4e7b-9083-9f57ade6aed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:08.997954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c62c-1764-4e7b-9083-9f57ade6aed2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:08.999987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c62c-1764-4e7b-9083-9f57ade6aed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:08.999987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c62c-1764-4e7b-9083-9f57ade6aed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:08.999987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c62c-1764-4e7b-9083-9f57ade6aed2 None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=aa5bf773ed3a4f1e916671a22c65f031) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:08.999987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c62c-1764-4e7b-9083-9f57ade6aed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:09.000962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c62c-1764-4e7b-9083-9f57ade6aed2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:09.002826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 367/755] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:13:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:09.003712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38d9b5-f9ea-473d-af3e-75b844d1f297 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:09.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 389/756] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:08 2022] GET /identity/v3/role_assignments?user.id=aa5bf773ed3a4f1e916671a22c65f031&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=0053c24ce06147938dbb61657a531c94 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:09.140435 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38d9b5-f9ea-473d-af3e-75b844d1f297 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:09.193980 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9477840-a733-48e2-bae4-65da438859df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:09.194628 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9477840-a733-48e2-bae4-65da438859df None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:09.195365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9477840-a733-48e2-bae4-65da438859df None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:09.195660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9477840-a733-48e2-bae4-65da438859df None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:09.196389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9477840-a733-48e2-bae4-65da438859df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:09.196699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9477840-a733-48e2-bae4-65da438859df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:09.198062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9477840-a733-48e2-bae4-65da438859df None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:09.207356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 368/757] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:13:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:09.212566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c62c-1764-4e7b-9083-9f57ade6aed2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:09.317074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c62c-1764-4e7b-9083-9f57ade6aed2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:09.353577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d51f2a-bd7d-4c2c-b3ac-d8e34f091a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:09.354224 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51f2a-bd7d-4c2c-b3ac-d8e34f091a55 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:09.354531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51f2a-bd7d-4c2c-b3ac-d8e34f091a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:09.354807 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51f2a-bd7d-4c2c-b3ac-d8e34f091a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:09.365752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d51f2a-bd7d-4c2c-b3ac-d8e34f091a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:09.367235 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d51f2a-bd7d-4c2c-b3ac-d8e34f091a55 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-c2d51f2a-bd7d-4c2c-b3ac-d8e34f091a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:09.382391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:09.384622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:09.386612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:09.386612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:09.386612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:09.386612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:09.386612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 390/758] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:09.391799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9477840-a733-48e2-bae4-65da438859df None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:09.445887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449b84d-90de-4d65-afbd-e1abfe44a500 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:09.446198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449b84d-90de-4d65-afbd-e1abfe44a500 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:09.446467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449b84d-90de-4d65-afbd-e1abfe44a500 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:09.454125 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 391/759] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:09.455819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:09.466392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28f923-1b4f-48ba-a15f-1b23e706c90a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:09.466706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28f923-1b4f-48ba-a15f-1b23e706c90a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:09.466988 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28f923-1b4f-48ba-a15f-1b23e706c90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:09.495190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8e28f923-1b4f-48ba-a15f-1b23e706c90a None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:09.496409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8e28f923-1b4f-48ba-a15f-1b23e706c90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:09.538828 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:09.586333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 392/760] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:09.612528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28f923-1b4f-48ba-a15f-1b23e706c90a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:09.616637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9477840-a733-48e2-bae4-65da438859df None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:09.659867 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2e828-669f-478d-88e9-4723bfacd70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:09.660868 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2e828-669f-478d-88e9-4723bfacd70d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:09.661336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2e828-669f-478d-88e9-4723bfacd70d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:09.661821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2e828-669f-478d-88e9-4723bfacd70d None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:09.662727 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2e828-669f-478d-88e9-4723bfacd70d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:09.663243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2e828-669f-478d-88e9-4723bfacd70d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:09.664795 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2e828-669f-478d-88e9-4723bfacd70d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:09.678186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 369/761] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:09.687690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2e828-669f-478d-88e9-4723bfacd70d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:09.743525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28f923-1b4f-48ba-a15f-1b23e706c90a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:09.785967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c86ba4-80d2-46e1-b3d0-6ca52b09bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:09.786970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c86ba4-80d2-46e1-b3d0-6ca52b09bd1f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:09.787217 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c86ba4-80d2-46e1-b3d0-6ca52b09bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:09.787561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c86ba4-80d2-46e1-b3d0-6ca52b09bd1f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:09.788530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c86ba4-80d2-46e1-b3d0-6ca52b09bd1f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:09.790125 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c86ba4-80d2-46e1-b3d0-6ca52b09bd1f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-04c86ba4-80d2-46e1-b3d0-6ca52b09bd1f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:09.800263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:09.801489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 22:13:09.803142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:09.806539 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 393/762] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Aug 4 22:13:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:09.811031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c86ba4-80d2-46e1-b3d0-6ca52b09bd1f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:09.857939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:09.899047 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2e828-669f-478d-88e9-4723bfacd70d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:09.902697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:09.962270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e46841-7f84-4355-b523-47b02294f89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:09.962875 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e46841-7f84-4355-b523-47b02294f89f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:09.963259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e46841-7f84-4355-b523-47b02294f89f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:09.963543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e46841-7f84-4355-b523-47b02294f89f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:09.981414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c86ba4-80d2-46e1-b3d0-6ca52b09bd1f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:09.984169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e46841-7f84-4355-b523-47b02294f89f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:09.985629 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e46841-7f84-4355-b523-47b02294f89f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-92e46841-7f84-4355-b523-47b02294f89f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:10.017747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:10.018760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:10.019695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:10.019695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:10.019695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:10.019695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:10.019695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:10.019695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:10.019695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:10.019695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:10.019695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:13:10.019695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:10.021644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 370/763] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 4 22:13:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:10.025463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae73613-c387-4eb1-9bab-16b0492926df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:10.025463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae73613-c387-4eb1-9bab-16b0492926df None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:10.025463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae73613-c387-4eb1-9bab-16b0492926df None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:10.025463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae73613-c387-4eb1-9bab-16b0492926df None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:10.025799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae73613-c387-4eb1-9bab-16b0492926df None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:10.025799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae73613-c387-4eb1-9bab-16b0492926df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:10.025939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae73613-c387-4eb1-9bab-16b0492926df None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:10.028038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e46841-7f84-4355-b523-47b02294f89f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:10.040140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 394/764] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Aug 4 22:13:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:10.041011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae73613-c387-4eb1-9bab-16b0492926df None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:10.193817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:10.205295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae73613-c387-4eb1-9bab-16b0492926df None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:10.220335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e46841-7f84-4355-b523-47b02294f89f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:10.240736 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36bddf-5ed0-46b7-b98b-f17dfe84cb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:10.241370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36bddf-5ed0-46b7-b98b-f17dfe84cb9c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:10.241639 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36bddf-5ed0-46b7-b98b-f17dfe84cb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:10.241913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36bddf-5ed0-46b7-b98b-f17dfe84cb9c None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:10.242622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36bddf-5ed0-46b7-b98b-f17dfe84cb9c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:10.243086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36bddf-5ed0-46b7-b98b-f17dfe84cb9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:10.244619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36bddf-5ed0-46b7-b98b-f17dfe84cb9c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:10.250077 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 395/765] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Aug 4 22:13:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:10.255931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36bddf-5ed0-46b7-b98b-f17dfe84cb9c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:10.290687 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cbd21-9545-4310-8844-6c2c52cb230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:10.291307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cbd21-9545-4310-8844-6c2c52cb230d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:10.291587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cbd21-9545-4310-8844-6c2c52cb230d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:10.291859 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cbd21-9545-4310-8844-6c2c52cb230d None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:10.292656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cbd21-9545-4310-8844-6c2c52cb230d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:10.292961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cbd21-9545-4310-8844-6c2c52cb230d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:10.299417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cbd21-9545-4310-8844-6c2c52cb230d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:10.332024 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 371/766] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 4 22:13:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:10.335415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cbd21-9545-4310-8844-6c2c52cb230d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:10.378806 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36bddf-5ed0-46b7-b98b-f17dfe84cb9c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:10.390461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:10.417294 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbd213-7476-4b91-a08a-9e444eb72746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:10.417924 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbd213-7476-4b91-a08a-9e444eb72746 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:10.418205 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbd213-7476-4b91-a08a-9e444eb72746 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:10.418508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbd213-7476-4b91-a08a-9e444eb72746 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:10.419417 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbd213-7476-4b91-a08a-9e444eb72746 None admin] RBAC: Adding query filter params (interface=public, service_id=33f8c995f7f34ffa859f7f93c4d1dcac, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:10.419739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbd213-7476-4b91-a08a-9e444eb72746 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:10.426426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbd213-7476-4b91-a08a-9e444eb72746 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:10.429718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 396/767] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 4 22:13:10 2022] GET /identity/v3/endpoints?service_id=33f8c995f7f34ffa859f7f93c4d1dcac&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:10.434710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbd213-7476-4b91-a08a-9e444eb72746 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:10.454504 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:10.569174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cbd21-9545-4310-8844-6c2c52cb230d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:10.609622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbd213-7476-4b91-a08a-9e444eb72746 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:10.614371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecd934-33d3-4b15-b729-68b21ae7c9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:10.615595 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecd934-33d3-4b15-b729-68b21ae7c9be None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:10.615878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecd934-33d3-4b15-b729-68b21ae7c9be None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:10.616151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ecd934-33d3-4b15-b729-68b21ae7c9be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:10.629030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ecd934-33d3-4b15-b729-68b21ae7c9be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:10.631639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ecd934-33d3-4b15-b729-68b21ae7c9be None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-26ecd934-33d3-4b15-b729-68b21ae7c9be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:10.648359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:10.649315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:10.650216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:10.650216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:10.650216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:10.650216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:10.650216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 372/768] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:10.655020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecd934-33d3-4b15-b729-68b21ae7c9be None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:10.677855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e2922-ede2-4922-b654-e98a3c37f9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:10.678983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e2922-ede2-4922-b654-e98a3c37f9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:10.679492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e2922-ede2-4922-b654-e98a3c37f9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:10.679971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e2922-ede2-4922-b654-e98a3c37f9a4 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:10.680827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e2922-ede2-4922-b654-e98a3c37f9a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:10.682425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e2922-ede2-4922-b654-e98a3c37f9a4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:10.690188 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 397/769] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 4 22:13:10 2022] GET /identity/v3/services => generated 772 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:10.695595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9b8b1-04cf-4122-8799-df96283a889b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:10.695829 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9b8b1-04cf-4122-8799-df96283a889b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:10.696114 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9b8b1-04cf-4122-8799-df96283a889b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:10.699145 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 398/770] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:10.705984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb10d-965c-45e6-8368-9e1a264ae151 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:10.706304 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb10d-965c-45e6-8368-9e1a264ae151 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:10.706564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aeb10d-965c-45e6-8368-9e1a264ae151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:10.747675 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-51aeb10d-965c-45e6-8368-9e1a264ae151 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:10.748907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-51aeb10d-965c-45e6-8368-9e1a264ae151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:10.813665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:10.872590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ecd934-33d3-4b15-b729-68b21ae7c9be None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:10.887787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 399/771] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:10.889186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20231c-9487-4555-8dd3-e730dcb77ecb None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:10.889472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20231c-9487-4555-8dd3-e730dcb77ecb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:10.889750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20231c-9487-4555-8dd3-e730dcb77ecb None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:10.894444 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 400/772] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:10.896762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f00734-696f-4518-8e9c-af759cb34eb2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:10.897040 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f00734-696f-4518-8e9c-af759cb34eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:10.897332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f00734-696f-4518-8e9c-af759cb34eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:10.911189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:10.917507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d1f00734-696f-4518-8e9c-af759cb34eb2 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:10.919623 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d1f00734-696f-4518-8e9c-af759cb34eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:10.921911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a9eb0-68fa-4d5b-a716-aa5f9ffd7d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:10.923386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9eb0-68fa-4d5b-a716-aa5f9ffd7d8f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:10.923676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9eb0-68fa-4d5b-a716-aa5f9ffd7d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:10.923950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9eb0-68fa-4d5b-a716-aa5f9ffd7d8f None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:10.924651 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a9eb0-68fa-4d5b-a716-aa5f9ffd7d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:10.924957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a9eb0-68fa-4d5b-a716-aa5f9ffd7d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:10.926313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a9eb0-68fa-4d5b-a716-aa5f9ffd7d8f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:10.943776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 373/773] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:10.943776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a9eb0-68fa-4d5b-a716-aa5f9ffd7d8f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:10.998960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 401/774] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:11.000037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f00734-696f-4518-8e9c-af759cb34eb2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:11.078476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a9eb0-68fa-4d5b-a716-aa5f9ffd7d8f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:11.113955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:11.121194 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adf0eb-6c69-40a4-bfc6-3f0f8b2dd206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:11.122027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adf0eb-6c69-40a4-bfc6-3f0f8b2dd206 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:11.122386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adf0eb-6c69-40a4-bfc6-3f0f8b2dd206 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:11.122828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adf0eb-6c69-40a4-bfc6-3f0f8b2dd206 None admin] PATH_INFO: `/v3/services/network` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:11.123535 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adf0eb-6c69-40a4-bfc6-3f0f8b2dd206 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:11.124195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f00734-696f-4518-8e9c-af759cb34eb2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:11.125087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adf0eb-6c69-40a4-bfc6-3f0f8b2dd206 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-f5adf0eb-6c69-40a4-bfc6-3f0f8b2dd206 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:11.139800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:11.140847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:11.141689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 374/775] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:10 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:11.142528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adf0eb-6c69-40a4-bfc6-3f0f8b2dd206 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:11.171875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48168ba0-521e-4597-831b-6f7afcbc48e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:11.173189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48168ba0-521e-4597-831b-6f7afcbc48e8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:11.173650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48168ba0-521e-4597-831b-6f7afcbc48e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:11.174167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48168ba0-521e-4597-831b-6f7afcbc48e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:11.178330 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:11.186141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48168ba0-521e-4597-831b-6f7afcbc48e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:11.188528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48168ba0-521e-4597-831b-6f7afcbc48e8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-48168ba0-521e-4597-831b-6f7afcbc48e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:11.205887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:11.207138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:11.209162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:11.209162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:11.209162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:11.209162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:11.209162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:11.209162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:11.209162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:11.209162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:11.216837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 402/776] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:11.216837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48168ba0-521e-4597-831b-6f7afcbc48e8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:11.269121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adf0eb-6c69-40a4-bfc6-3f0f8b2dd206 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:11.312587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a03a8e-0372-44d6-bb5b-17ec8fd5f7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:11.314270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a03a8e-0372-44d6-bb5b-17ec8fd5f7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:11.314778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a03a8e-0372-44d6-bb5b-17ec8fd5f7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:11.315495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a03a8e-0372-44d6-bb5b-17ec8fd5f7c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:11.322040 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48168ba0-521e-4597-831b-6f7afcbc48e8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:11.331065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a03a8e-0372-44d6-bb5b-17ec8fd5f7c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a9a03a8e-0372-44d6-bb5b-17ec8fd5f7c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:11.339870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:11.340796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:11.341648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:11.341648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:11.341648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:11.341648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:11.341648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:11.341648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:11.341648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:11.341648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:11.341648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:11.341648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:11.341648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:13:11.341648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:11.344204 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 375/777] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:13:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:11.345268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a03a8e-0372-44d6-bb5b-17ec8fd5f7c1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:11.366536 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecce11c-6439-49cb-8b3a-10fc75461f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:11.367214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecce11c-6439-49cb-8b3a-10fc75461f91 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:11.367500 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecce11c-6439-49cb-8b3a-10fc75461f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:11.367777 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecce11c-6439-49cb-8b3a-10fc75461f91 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:11.368457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecce11c-6439-49cb-8b3a-10fc75461f91 None admin] RBAC: Adding query filter params (name=network) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:11.368763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecce11c-6439-49cb-8b3a-10fc75461f91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:11.370139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecce11c-6439-49cb-8b3a-10fc75461f91 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:11.375483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 403/778] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 4 22:13:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:11.376300 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecce11c-6439-49cb-8b3a-10fc75461f91 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:11.406915 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:11.441634 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:11.453641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a03a8e-0372-44d6-bb5b-17ec8fd5f7c1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:11.489338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f9930-f99d-4325-9cd4-854c79d18d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:11.489654 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecce11c-6439-49cb-8b3a-10fc75461f91 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:11.490035 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f9930-f99d-4325-9cd4-854c79d18d0c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:11.490315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f9930-f99d-4325-9cd4-854c79d18d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:11.490644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f9930-f99d-4325-9cd4-854c79d18d0c None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:11.491389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f9930-f99d-4325-9cd4-854c79d18d0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:11.491696 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f9930-f99d-4325-9cd4-854c79d18d0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:11.493127 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f9930-f99d-4325-9cd4-854c79d18d0c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:11.504959 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 376/779] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:11.507558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f9930-f99d-4325-9cd4-854c79d18d0c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:11.525924 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb52c1-32e8-4bc3-9811-460d219f9984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:11.526572 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb52c1-32e8-4bc3-9811-460d219f9984 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:11.526855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb52c1-32e8-4bc3-9811-460d219f9984 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:11.527133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb52c1-32e8-4bc3-9811-460d219f9984 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:11.527841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb52c1-32e8-4bc3-9811-460d219f9984 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:11.528145 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb52c1-32e8-4bc3-9811-460d219f9984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:11.529507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb52c1-32e8-4bc3-9811-460d219f9984 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:11.538369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 404/780] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:13:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:11.544535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e847c2-70fd-4563-ae04-82a83d09bb60 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:11.545065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e847c2-70fd-4563-ae04-82a83d09bb60 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:11.545540 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e847c2-70fd-4563-ae04-82a83d09bb60 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:11.548233 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 405/781] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:11.549166 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e847c2-70fd-4563-ae04-82a83d09bb60 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:11.616513 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f9930-f99d-4325-9cd4-854c79d18d0c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:11.634007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:11.652359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800d2a8-85d5-4592-b78d-7be1402bebea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:11.653076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800d2a8-85d5-4592-b78d-7be1402bebea None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:11.653368 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800d2a8-85d5-4592-b78d-7be1402bebea None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:11.653644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800d2a8-85d5-4592-b78d-7be1402bebea None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:11.654320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800d2a8-85d5-4592-b78d-7be1402bebea None admin] RBAC: Adding query filter params (type=network) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:11.654664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800d2a8-85d5-4592-b78d-7be1402bebea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:11.656060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800d2a8-85d5-4592-b78d-7be1402bebea None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:11.665361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 377/782] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 4 22:13:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:11.665361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800d2a8-85d5-4592-b78d-7be1402bebea None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:11.666387 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e847c2-70fd-4563-ae04-82a83d09bb60 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:11.691903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:11.705246 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6036518-d274-40af-86e8-32ea812e7ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:11.705911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6036518-d274-40af-86e8-32ea812e7ab1 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:11.706195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6036518-d274-40af-86e8-32ea812e7ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:11.706505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6036518-d274-40af-86e8-32ea812e7ab1 None admin] PATH_INFO: `/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/04899781f67746e193a05bdc004804cc/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:11.709124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6036518-d274-40af-86e8-32ea812e7ab1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe696ab97a143959fa7e33cda768cfc, user_id=04899781f67746e193a05bdc004804cc, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:11.710592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6036518-d274-40af-86e8-32ea812e7ab1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:11.724559 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 406/783] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:13:11 2022] PUT /identity/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/04899781f67746e193a05bdc004804cc/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:13:11.725835 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceffa2e-7b16-48fd-8cf3-4f4e8728298d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:11.726129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceffa2e-7b16-48fd-8cf3-4f4e8728298d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:11.726427 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceffa2e-7b16-48fd-8cf3-4f4e8728298d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:11.745352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-aceffa2e-7b16-48fd-8cf3-4f4e8728298d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:11.746632 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-aceffa2e-7b16-48fd-8cf3-4f4e8728298d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:11.790917 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800d2a8-85d5-4592-b78d-7be1402bebea None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:11.843401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdadda-331e-462b-8f67-95f078e12413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:11.844508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdadda-331e-462b-8f67-95f078e12413 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:11.844970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdadda-331e-462b-8f67-95f078e12413 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:11.845442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdadda-331e-462b-8f67-95f078e12413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:11.845546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 407/784] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:11.846629 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceffa2e-7b16-48fd-8cf3-4f4e8728298d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:11.864332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdadda-331e-462b-8f67-95f078e12413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:11.867471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdadda-331e-462b-8f67-95f078e12413 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-7bfdadda-331e-462b-8f67-95f078e12413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:11.889852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:11.890961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:11.891847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:11.891847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:11.891847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:11.891847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:11.894290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 378/785] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:11.895418 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdadda-331e-462b-8f67-95f078e12413 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:11.932572 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:11.968838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceffa2e-7b16-48fd-8cf3-4f4e8728298d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:11.987653 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:12.020638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdadda-331e-462b-8f67-95f078e12413 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:12.022923 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e358c18-683a-4dc4-af7e-5b81bb2910a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:12.024632 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e358c18-683a-4dc4-af7e-5b81bb2910a4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:12.025101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e358c18-683a-4dc4-af7e-5b81bb2910a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:12.025537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e358c18-683a-4dc4-af7e-5b81bb2910a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:12.026475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e358c18-683a-4dc4-af7e-5b81bb2910a4 None admin] RBAC: Adding query filter params (interface=public, service_id=b980665815174d7c9c2776bd8dd03b6f, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:12.026940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e358c18-683a-4dc4-af7e-5b81bb2910a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:12.028475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e358c18-683a-4dc4-af7e-5b81bb2910a4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:12.036410 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 408/786] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 4 22:13:11 2022] GET /identity/v3/endpoints?service_id=b980665815174d7c9c2776bd8dd03b6f&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:12.037528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e358c18-683a-4dc4-af7e-5b81bb2910a4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:12.065390 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9fa7c-a79a-4444-8e4d-23144e298a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:12.066296 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9fa7c-a79a-4444-8e4d-23144e298a89 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:12.066999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9fa7c-a79a-4444-8e4d-23144e298a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:12.067452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9fa7c-a79a-4444-8e4d-23144e298a89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:12.082937 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9fa7c-a79a-4444-8e4d-23144e298a89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-3ae9fa7c-a79a-4444-8e4d-23144e298a89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:12.090884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:12.092057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:12.093145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:12.093145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:12.093145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:12.093145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:12.093145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:12.093145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:12.093145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:12.093145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:12.093145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:12.093145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:12.093145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:12.093145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:12.095862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 379/787] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:13:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:12.097154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9fa7c-a79a-4444-8e4d-23144e298a89 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:12.168003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e358c18-683a-4dc4-af7e-5b81bb2910a4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:12.212070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:12.218249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdc7a1-f198-417c-9c7c-ae2cca336d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:12.218913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdc7a1-f198-417c-9c7c-ae2cca336d1f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:12.219199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdc7a1-f198-417c-9c7c-ae2cca336d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:12.219475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdc7a1-f198-417c-9c7c-ae2cca336d1f None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:12.220172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdc7a1-f198-417c-9c7c-ae2cca336d1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:12.220483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdc7a1-f198-417c-9c7c-ae2cca336d1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:12.221857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffdc7a1-f198-417c-9c7c-ae2cca336d1f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:12.228689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9fa7c-a79a-4444-8e4d-23144e298a89 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:12.236478 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 409/788] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:12.237880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdc7a1-f198-417c-9c7c-ae2cca336d1f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:12.276777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c2f2a-47b6-4c3d-823b-c3aa5c86bd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:12.278079 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c2f2a-47b6-4c3d-823b-c3aa5c86bd5a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:12.278835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c2f2a-47b6-4c3d-823b-c3aa5c86bd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:12.279512 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c2f2a-47b6-4c3d-823b-c3aa5c86bd5a None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:12.280309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c2f2a-47b6-4c3d-823b-c3aa5c86bd5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:12.281963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c2f2a-47b6-4c3d-823b-c3aa5c86bd5a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:12.282703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:12.294737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 380/789] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 4 22:13:12 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:12.297765 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c2f2a-47b6-4c3d-823b-c3aa5c86bd5a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:12.396539 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffdc7a1-f198-417c-9c7c-ae2cca336d1f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:12.476805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996d3e1-cd0d-4ecd-a629-9106131859d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:12.477609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996d3e1-cd0d-4ecd-a629-9106131859d0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:12.478807 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996d3e1-cd0d-4ecd-a629-9106131859d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:12.479094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996d3e1-cd0d-4ecd-a629-9106131859d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:12.479826 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996d3e1-cd0d-4ecd-a629-9106131859d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:12.480138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996d3e1-cd0d-4ecd-a629-9106131859d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:12.481551 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996d3e1-cd0d-4ecd-a629-9106131859d0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:12.497499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 410/790] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:13:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:12.498839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996d3e1-cd0d-4ecd-a629-9106131859d0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:12.515957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c2f2a-47b6-4c3d-823b-c3aa5c86bd5a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:12.560430 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e695e-f7ae-4877-be04-0d743535ca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:12.561161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e695e-f7ae-4877-be04-0d743535ca87 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:12.561445 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e695e-f7ae-4877-be04-0d743535ca87 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:12.561775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e695e-f7ae-4877-be04-0d743535ca87 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:12.570683 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e695e-f7ae-4877-be04-0d743535ca87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:12.572116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e695e-f7ae-4877-be04-0d743535ca87 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-109e695e-f7ae-4877-be04-0d743535ca87 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:12.592000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:12.592982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:12.593912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:12.593912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:12.593912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:12.593912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:12.593912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:12.593912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:12.593912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:12.593912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:12.593912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 22:13:12.593912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:12.593912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 381/791] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 4 22:13:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:12.598719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e695e-f7ae-4877-be04-0d743535ca87 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:12.636075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:12.655917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:12.663099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996d3e1-cd0d-4ecd-a629-9106131859d0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:12.740305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e695e-f7ae-4877-be04-0d743535ca87 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:12.771150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b656092-5e75-4050-a709-5ae18f47ede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:12.771815 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b656092-5e75-4050-a709-5ae18f47ede0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:12.772104 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b656092-5e75-4050-a709-5ae18f47ede0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:12.772377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b656092-5e75-4050-a709-5ae18f47ede0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:12.775412 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824537ea-94b9-4b85-97ea-1bdebb58e9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:12.776040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824537ea-94b9-4b85-97ea-1bdebb58e9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:12.776327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824537ea-94b9-4b85-97ea-1bdebb58e9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:12.776602 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824537ea-94b9-4b85-97ea-1bdebb58e9c1 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:12.777401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824537ea-94b9-4b85-97ea-1bdebb58e9c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:12.777715 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824537ea-94b9-4b85-97ea-1bdebb58e9c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:12.779320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824537ea-94b9-4b85-97ea-1bdebb58e9c1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:12.797437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 382/792] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Aug 4 22:13:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:12.803035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b656092-5e75-4050-a709-5ae18f47ede0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:12.803478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824537ea-94b9-4b85-97ea-1bdebb58e9c1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:12.804523 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b656092-5e75-4050-a709-5ae18f47ede0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2b656092-5e75-4050-a709-5ae18f47ede0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:12.847688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:12.848651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:12.849573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:12.849573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:12.849573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:12.849573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:12.851675 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 411/793] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:12.859398 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b656092-5e75-4050-a709-5ae18f47ede0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:12.899005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:12.934083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824537ea-94b9-4b85-97ea-1bdebb58e9c1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:13.003454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d29e0b-2a4f-44c3-9d74-d7b91d7cc908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:13.005274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d29e0b-2a4f-44c3-9d74-d7b91d7cc908 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:13.005814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d29e0b-2a4f-44c3-9d74-d7b91d7cc908 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:13.006290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d29e0b-2a4f-44c3-9d74-d7b91d7cc908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:13.023422 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d29e0b-2a4f-44c3-9d74-d7b91d7cc908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:13.026068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d29e0b-2a4f-44c3-9d74-d7b91d7cc908 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d4d29e0b-2a4f-44c3-9d74-d7b91d7cc908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:13.047199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:13.048142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:13.049051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:13.049051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:13.049051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:13.049051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:13.049272 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b656092-5e75-4050-a709-5ae18f47ede0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:13.053004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 383/794] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:13.054529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b88644-1414-4fca-af12-7d4e6bb8b77e None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:13.055029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b88644-1414-4fca-af12-7d4e6bb8b77e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:13.055545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b88644-1414-4fca-af12-7d4e6bb8b77e None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:13.061627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 384/795] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:13.062716 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b88644-1414-4fca-af12-7d4e6bb8b77e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:13.092592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97b2c5-8ce2-4c49-b3a4-6deaef63cc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:13.093226 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b2c5-8ce2-4c49-b3a4-6deaef63cc2f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:13.093512 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b2c5-8ce2-4c49-b3a4-6deaef63cc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:13.093789 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b2c5-8ce2-4c49-b3a4-6deaef63cc2f None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:13.094531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97b2c5-8ce2-4c49-b3a4-6deaef63cc2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:13.094846 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97b2c5-8ce2-4c49-b3a4-6deaef63cc2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:13.096278 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97b2c5-8ce2-4c49-b3a4-6deaef63cc2f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:13.111255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 412/796] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:13.117627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c71a1-9a0a-4f2a-bfea-ced70332a1a8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:13.118006 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c71a1-9a0a-4f2a-bfea-ced70332a1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:13.118291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c71a1-9a0a-4f2a-bfea-ced70332a1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:13.137689 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c46c71a1-9a0a-4f2a-bfea-ced70332a1a8 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:13.138941 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c46c71a1-9a0a-4f2a-bfea-ced70332a1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:13.142574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:13.202446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b88644-1414-4fca-af12-7d4e6bb8b77e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:13.222449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 413/797] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:13.222449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c71a1-9a0a-4f2a-bfea-ced70332a1a8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:13.249406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:13.264295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581094e7-35ab-4646-8f24-d32237a19439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:13.265807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581094e7-35ab-4646-8f24-d32237a19439 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:13.266293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581094e7-35ab-4646-8f24-d32237a19439 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:13.266813 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581094e7-35ab-4646-8f24-d32237a19439 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:13.268011 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581094e7-35ab-4646-8f24-d32237a19439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:13.269378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581094e7-35ab-4646-8f24-d32237a19439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:13.271056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581094e7-35ab-4646-8f24-d32237a19439 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:13.288422 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 385/798] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:13.290081 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581094e7-35ab-4646-8f24-d32237a19439 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:13.346268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c71a1-9a0a-4f2a-bfea-ced70332a1a8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:13.392848 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a901f-3d29-4c61-9478-5569e5b1d12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:13.394569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a901f-3d29-4c61-9478-5569e5b1d12a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:13.395342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a901f-3d29-4c61-9478-5569e5b1d12a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:13.395839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a901f-3d29-4c61-9478-5569e5b1d12a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:13.406295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581094e7-35ab-4646-8f24-d32237a19439 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:13.406673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a901f-3d29-4c61-9478-5569e5b1d12a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:13.409809 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a901f-3d29-4c61-9478-5569e5b1d12a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:13.413442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-595a901f-3d29-4c61-9478-5569e5b1d12a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:13.428054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:13.429029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:13.430074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:13.430074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:13.430074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:13.430074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:13.430074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:13.430074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:13.430074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:13.430074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:13.430074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 22:13:13.430074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:13.436809 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 414/799] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:13:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:13.436809 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a901f-3d29-4c61-9478-5569e5b1d12a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:13.456691 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c9717-d5b1-463a-8532-d42646a6d8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:13.458015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c9717-d5b1-463a-8532-d42646a6d8cf None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:13.459041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c9717-d5b1-463a-8532-d42646a6d8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:13.459520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c9717-d5b1-463a-8532-d42646a6d8cf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:13.460396 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c9717-d5b1-463a-8532-d42646a6d8cf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:13.462647 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c9717-d5b1-463a-8532-d42646a6d8cf None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-094c9717-d5b1-463a-8532-d42646a6d8cf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:13.477229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:13.478192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 04 22:13:13.479068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:13.486854 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 386/800] 10.222.0.27 () {56 vars in 1129 bytes} [Thu Aug 4 22:13:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:13.487691 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c9717-d5b1-463a-8532-d42646a6d8cf None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:13.544965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:13.570927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a901f-3d29-4c61-9478-5569e5b1d12a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:13.600097 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c9717-d5b1-463a-8532-d42646a6d8cf None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:13.608547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadf6e7-ef96-46be-a349-92c1881f94ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:13.609229 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadf6e7-ef96-46be-a349-92c1881f94ac None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:13.609517 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadf6e7-ef96-46be-a349-92c1881f94ac None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:13.609786 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadf6e7-ef96-46be-a349-92c1881f94ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:13.617969 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadf6e7-ef96-46be-a349-92c1881f94ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:13.619580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadf6e7-ef96-46be-a349-92c1881f94ac None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-5fadf6e7-ef96-46be-a349-92c1881f94ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:13.632760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:13.633700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:13.634625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:13.634625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:13.634625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:13.634625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:13.634625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:13.634625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:13.634625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:13.634625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:13.634625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 415/801] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:13.635574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadf6e7-ef96-46be-a349-92c1881f94ac None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:13.641776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0061480-b967-46e1-9ace-ac4b879976be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:13.642710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0061480-b967-46e1-9ace-ac4b879976be None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:13.643191 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0061480-b967-46e1-9ace-ac4b879976be None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:13.643656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0061480-b967-46e1-9ace-ac4b879976be None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:13.644725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0061480-b967-46e1-9ace-ac4b879976be None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:13.645275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0061480-b967-46e1-9ace-ac4b879976be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:13.646954 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0061480-b967-46e1-9ace-ac4b879976be None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:13.669922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 387/802] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Aug 4 22:13:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:13.671118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0061480-b967-46e1-9ace-ac4b879976be None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:13.699462 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:13.747069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadf6e7-ef96-46be-a349-92c1881f94ac None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:13.773357 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0061480-b967-46e1-9ace-ac4b879976be None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:13.783571 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:13.785299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57f8e5-56bc-47cc-b3e6-232eb2f919b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:13.786126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57f8e5-56bc-47cc-b3e6-232eb2f919b6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:13.786684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57f8e5-56bc-47cc-b3e6-232eb2f919b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:13.787168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57f8e5-56bc-47cc-b3e6-232eb2f919b6 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:13.788040 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57f8e5-56bc-47cc-b3e6-232eb2f919b6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:13.788500 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57f8e5-56bc-47cc-b3e6-232eb2f919b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:13.790136 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57f8e5-56bc-47cc-b3e6-232eb2f919b6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:13.800920 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 416/803] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Aug 4 22:13:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:13.803118 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57f8e5-56bc-47cc-b3e6-232eb2f919b6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:13.810598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0c047-9e6a-4ece-813e-ab08c7569b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:13.811359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0c047-9e6a-4ece-813e-ab08c7569b9a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:13.811738 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0c047-9e6a-4ece-813e-ab08c7569b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:13.812128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0c047-9e6a-4ece-813e-ab08c7569b9a None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:13.812978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0c047-9e6a-4ece-813e-ab08c7569b9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:13.813384 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0c047-9e6a-4ece-813e-ab08c7569b9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:13.814941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0c047-9e6a-4ece-813e-ab08c7569b9a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:13.830582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 388/804] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:13.831654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0c047-9e6a-4ece-813e-ab08c7569b9a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:13.926024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57f8e5-56bc-47cc-b3e6-232eb2f919b6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:13.939766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0c047-9e6a-4ece-813e-ab08c7569b9a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:13.959885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:13.972379 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f3539-41c2-41b3-b234-e0f8803c89e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:13.973030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f3539-41c2-41b3-b234-e0f8803c89e1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:13.973315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f3539-41c2-41b3-b234-e0f8803c89e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:13.973591 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f3539-41c2-41b3-b234-e0f8803c89e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:13.976119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7be8b-6252-4c4f-bfcf-e637c2231d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:13.976735 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7be8b-6252-4c4f-bfcf-e637c2231d82 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:13.977012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7be8b-6252-4c4f-bfcf-e637c2231d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:13.977282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7be8b-6252-4c4f-bfcf-e637c2231d82 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:13.977960 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7be8b-6252-4c4f-bfcf-e637c2231d82 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:13.978262 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7be8b-6252-4c4f-bfcf-e637c2231d82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:13.979644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7be8b-6252-4c4f-bfcf-e637c2231d82 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:13.985059 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f3539-41c2-41b3-b234-e0f8803c89e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:13.985295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 389/805] 10.222.0.27 () {56 vars in 1124 bytes} [Thu Aug 4 22:13:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:13.985971 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7be8b-6252-4c4f-bfcf-e637c2231d82 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:13.987372 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f3539-41c2-41b3-b234-e0f8803c89e1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-ff8f3539-41c2-41b3-b234-e0f8803c89e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:14.004776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:14.006249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:14.007186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:14.007186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:14.007186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:14.007186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:14.012443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 417/806] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:14.012443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf6450-db76-4f4d-a2bb-14ab8d6b674c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:14.012443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf6450-db76-4f4d-a2bb-14ab8d6b674c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:14.012443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf6450-db76-4f4d-a2bb-14ab8d6b674c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:14.012443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 418/807] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:14.013099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf6450-db76-4f4d-a2bb-14ab8d6b674c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:14.024578 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:14.100497 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7be8b-6252-4c4f-bfcf-e637c2231d82 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:14.122400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf6450-db76-4f4d-a2bb-14ab8d6b674c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:14.136852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46883d5-ad67-435a-9e87-2723923aad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:14.137519 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46883d5-ad67-435a-9e87-2723923aad37 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:14.137797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46883d5-ad67-435a-9e87-2723923aad37 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:14.138073 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46883d5-ad67-435a-9e87-2723923aad37 None admin] PATH_INFO: `/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/42a5e67e8b854faa8689654156c994d5/roles/aed7c83a35d741538254f3d4775f4a0e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:14.153352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46883d5-ad67-435a-9e87-2723923aad37 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe696ab97a143959fa7e33cda768cfc, user_id=42a5e67e8b854faa8689654156c994d5, role_id=aed7c83a35d741538254f3d4775f4a0e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:14.154916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46883d5-ad67-435a-9e87-2723923aad37 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:14.161580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520494b9-d3f9-47ba-9ed0-b20c4d692f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:14.162210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520494b9-d3f9-47ba-9ed0-b20c4d692f8b None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:14.162614 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520494b9-d3f9-47ba-9ed0-b20c4d692f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:14.162900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520494b9-d3f9-47ba-9ed0-b20c4d692f8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:14.163615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520494b9-d3f9-47ba-9ed0-b20c4d692f8b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:14.164995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520494b9-d3f9-47ba-9ed0-b20c4d692f8b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:14.178821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 390/808] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:13:13 2022] PUT /identity/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/42a5e67e8b854faa8689654156c994d5/roles/aed7c83a35d741538254f3d4775f4a0e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:13:14.178821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46883d5-ad67-435a-9e87-2723923aad37 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:14.202855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 419/809] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:13:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:13:14.204585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9be8-9171-43a8-84c8-5def883f866a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:14.205097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9be8-9171-43a8-84c8-5def883f866a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:14.205450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9be8-9171-43a8-84c8-5def883f866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:14.226962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bbab9be8-9171-43a8-84c8-5def883f866a None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:14.228378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bbab9be8-9171-43a8-84c8-5def883f866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:14.264420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:14.323689 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 420/810] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:14.348168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab9be8-9171-43a8-84c8-5def883f866a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:14.358174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:14.393550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46883d5-ad67-435a-9e87-2723923aad37 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:14.437695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4704a-5ed4-4916-9edd-43c4beb00154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:14.438356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4704a-5ed4-4916-9edd-43c4beb00154 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:14.438668 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4704a-5ed4-4916-9edd-43c4beb00154 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:14.438946 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4704a-5ed4-4916-9edd-43c4beb00154 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:14.439655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4704a-5ed4-4916-9edd-43c4beb00154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:14.440253 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4704a-5ed4-4916-9edd-43c4beb00154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:14.442444 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4704a-5ed4-4916-9edd-43c4beb00154 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:14.467571 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 391/811] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:14.468868 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4704a-5ed4-4916-9edd-43c4beb00154 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:14.501067 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab9be8-9171-43a8-84c8-5def883f866a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:14.542913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b333b-69ae-42fe-b9ba-72c83e9ce259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:14.543564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b333b-69ae-42fe-b9ba-72c83e9ce259 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:14.543843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b333b-69ae-42fe-b9ba-72c83e9ce259 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:14.544121 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b333b-69ae-42fe-b9ba-72c83e9ce259 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:14.556843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b333b-69ae-42fe-b9ba-72c83e9ce259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b20b333b-69ae-42fe-b9ba-72c83e9ce259 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:14.561790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:14.562975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:14.564016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:14.564016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:14.564016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:14.564016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:14.564016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:14.564016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:14.564016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:14.564016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:14.564016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:14.564016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:14.564016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:14.564016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:14.564016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 421/812] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:13:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:14.564742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308e9c7-cb83-4f35-9399-39cfaa1c1d8b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:14.564742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308e9c7-cb83-4f35-9399-39cfaa1c1d8b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:14.565004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308e9c7-cb83-4f35-9399-39cfaa1c1d8b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:14.571773 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 422/813] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:14.574482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308e9c7-cb83-4f35-9399-39cfaa1c1d8b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:14.601955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4704a-5ed4-4916-9edd-43c4beb00154 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:14.626899 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:14.646425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaca86-4799-438b-a4d3-14bb1f133af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:14.647321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaca86-4799-438b-a4d3-14bb1f133af7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:14.647932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaca86-4799-438b-a4d3-14bb1f133af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:14.648358 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaca86-4799-438b-a4d3-14bb1f133af7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:14.657417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaca86-4799-438b-a4d3-14bb1f133af7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:14.659645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaca86-4799-438b-a4d3-14bb1f133af7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-bdeaca86-4799-438b-a4d3-14bb1f133af7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:14.675566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:14.676591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:14.677570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:14.677570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:14.677570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:14.677570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:14.677570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:14.677570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:14.677570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:14.677570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:14.680162 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 392/814] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:14.682226 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f378496-40ec-4d91-91b7-50cd0cdc06c5 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:14.682690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f378496-40ec-4d91-91b7-50cd0cdc06c5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:14.683269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f378496-40ec-4d91-91b7-50cd0cdc06c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:14.687833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308e9c7-cb83-4f35-9399-39cfaa1c1d8b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:14.691086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:14.708896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6f378496-40ec-4d91-91b7-50cd0cdc06c5 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:14.710280 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6f378496-40ec-4d91-91b7-50cd0cdc06c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:14.733417 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60a773-3e7c-4346-8e56-5900eed93f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:14.734619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60a773-3e7c-4346-8e56-5900eed93f49 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:14.735400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60a773-3e7c-4346-8e56-5900eed93f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:14.736065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60a773-3e7c-4346-8e56-5900eed93f49 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:14.737138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60a773-3e7c-4346-8e56-5900eed93f49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:14.737836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60a773-3e7c-4346-8e56-5900eed93f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:14.740107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60a773-3e7c-4346-8e56-5900eed93f49 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:14.751423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 423/815] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:14.752553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60a773-3e7c-4346-8e56-5900eed93f49 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:14.790491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 393/816] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:14.790491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f378496-40ec-4d91-91b7-50cd0cdc06c5 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:14.861518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:14.891495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60a773-3e7c-4346-8e56-5900eed93f49 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:14.918709 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f378496-40ec-4d91-91b7-50cd0cdc06c5 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:14.937807 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d112e-1f4a-4ed4-9787-8c5e15f9b31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:14.938592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d112e-1f4a-4ed4-9787-8c5e15f9b31f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:14.938973 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d112e-1f4a-4ed4-9787-8c5e15f9b31f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:14.939347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d112e-1f4a-4ed4-9787-8c5e15f9b31f None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:14.940216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d112e-1f4a-4ed4-9787-8c5e15f9b31f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:14.940625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d112e-1f4a-4ed4-9787-8c5e15f9b31f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:14.943553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d112e-1f4a-4ed4-9787-8c5e15f9b31f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:14.952347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:14.960060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b5ec9-c7be-4bd3-9333-75c7c4a85346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:14.960987 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b5ec9-c7be-4bd3-9333-75c7c4a85346 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:14.961529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b5ec9-c7be-4bd3-9333-75c7c4a85346 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:14.962054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b5ec9-c7be-4bd3-9333-75c7c4a85346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:14.963815 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 424/817] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:14.964988 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d112e-1f4a-4ed4-9787-8c5e15f9b31f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:14.974846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b5ec9-c7be-4bd3-9333-75c7c4a85346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:14.976626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b5ec9-c7be-4bd3-9333-75c7c4a85346 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-db2b5ec9-c7be-4bd3-9333-75c7c4a85346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:14.993415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:14.994367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:14.995292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:14.995292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:14.995292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:14.995292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:14.997410 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 394/818] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:15.003100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b5ec9-c7be-4bd3-9333-75c7c4a85346 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:15.080005 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d112e-1f4a-4ed4-9787-8c5e15f9b31f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:15.119954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996ec4b-82b2-44e4-9100-12f7b3bf6e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:15.120994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996ec4b-82b2-44e4-9100-12f7b3bf6e89 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:15.121529 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996ec4b-82b2-44e4-9100-12f7b3bf6e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:15.122009 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996ec4b-82b2-44e4-9100-12f7b3bf6e89 None admin] PATH_INFO: `/v3/services/network` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:15.122917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996ec4b-82b2-44e4-9100-12f7b3bf6e89 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:15.124497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996ec4b-82b2-44e4-9100-12f7b3bf6e89 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-3996ec4b-82b2-44e4-9100-12f7b3bf6e89 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:15.134157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:15.135209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:15.136130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:15.136130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:15.136130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:15.136130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:15.136130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:15.136130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:15.136130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:15.136130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:15.136130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:15.136130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:15.136130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:15.136130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:15.136130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 04 22:13:15.136130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:15.138874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 425/819] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:14 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:15.139891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996ec4b-82b2-44e4-9100-12f7b3bf6e89 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:15.145563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b5ec9-c7be-4bd3-9333-75c7c4a85346 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:15.147626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:15.181927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99086ad-93d5-4db0-bb28-7e32441419d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:15.182626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99086ad-93d5-4db0-bb28-7e32441419d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:15.182911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99086ad-93d5-4db0-bb28-7e32441419d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:15.183189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99086ad-93d5-4db0-bb28-7e32441419d9 None admin] PATH_INFO: `/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/aa5bf773ed3a4f1e916671a22c65f031/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:15.185200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99086ad-93d5-4db0-bb28-7e32441419d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe696ab97a143959fa7e33cda768cfc, user_id=aa5bf773ed3a4f1e916671a22c65f031, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:15.186657 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99086ad-93d5-4db0-bb28-7e32441419d9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:15.210218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 395/820] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:13:15 2022] PUT /identity/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/aa5bf773ed3a4f1e916671a22c65f031/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:13:15.211355 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99086ad-93d5-4db0-bb28-7e32441419d9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:15.264188 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:15.273829 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996ec4b-82b2-44e4-9100-12f7b3bf6e89 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:15.342616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f0055-4786-4f47-a8b7-95131e7543c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:15.343260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f0055-4786-4f47-a8b7-95131e7543c9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:15.343541 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f0055-4786-4f47-a8b7-95131e7543c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:15.343817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f0055-4786-4f47-a8b7-95131e7543c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:15.344543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f0055-4786-4f47-a8b7-95131e7543c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:15.344828 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f0055-4786-4f47-a8b7-95131e7543c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:15.350481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f0055-4786-4f47-a8b7-95131e7543c9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:15.356243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99086ad-93d5-4db0-bb28-7e32441419d9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:15.380746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 426/821] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:15.386685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f0055-4786-4f47-a8b7-95131e7543c9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:15.419629 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d594a-c6fd-4406-8500-5df559fd364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:15.420305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d594a-c6fd-4406-8500-5df559fd364a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:15.420491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d594a-c6fd-4406-8500-5df559fd364a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:15.420725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d594a-c6fd-4406-8500-5df559fd364a None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:15.421411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d594a-c6fd-4406-8500-5df559fd364a None admin] RBAC: Adding query filter params (name=network) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:15.421719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d594a-c6fd-4406-8500-5df559fd364a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:15.424462 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d594a-c6fd-4406-8500-5df559fd364a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:15.432010 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 396/822] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 4 22:13:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:15.440338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d594a-c6fd-4406-8500-5df559fd364a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:15.476849 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:15.523542 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f0055-4786-4f47-a8b7-95131e7543c9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:15.564543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b3b5-8fcf-44c2-978f-e7cf440362a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:15.565184 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b3b5-8fcf-44c2-978f-e7cf440362a8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:15.565461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b3b5-8fcf-44c2-978f-e7cf440362a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:15.565731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885b3b5-8fcf-44c2-978f-e7cf440362a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:15.573231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885b3b5-8fcf-44c2-978f-e7cf440362a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:15.574703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885b3b5-8fcf-44c2-978f-e7cf440362a8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:15.574833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d594a-c6fd-4406-8500-5df559fd364a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:15.586013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0885b3b5-8fcf-44c2-978f-e7cf440362a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:15.586943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:15.587867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:15.588792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:15.588792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:15.588792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:15.588792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:15.588792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:15.588792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:15.588792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:15.588792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:15.588792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:13:15.588792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:15.588792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 427/823] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 4 22:13:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:15.593958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b3b5-8fcf-44c2-978f-e7cf440362a8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:15.615318 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95832ce7-ac44-4cda-bd85-901756954dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:15.616480 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832ce7-ac44-4cda-bd85-901756954dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:15.616763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832ce7-ac44-4cda-bd85-901756954dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:15.617041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95832ce7-ac44-4cda-bd85-901756954dc4 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:15.617724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95832ce7-ac44-4cda-bd85-901756954dc4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:15.618028 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95832ce7-ac44-4cda-bd85-901756954dc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:15.619520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95832ce7-ac44-4cda-bd85-901756954dc4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:15.625703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 397/824] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 4 22:13:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:15.631127 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95832ce7-ac44-4cda-bd85-901756954dc4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:15.747220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95832ce7-ac44-4cda-bd85-901756954dc4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:15.785541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07934f1-c4b2-483f-bc24-ee3f42ca029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:15.786168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07934f1-c4b2-483f-bc24-ee3f42ca029f None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:15.787264 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07934f1-c4b2-483f-bc24-ee3f42ca029f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:15.787553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07934f1-c4b2-483f-bc24-ee3f42ca029f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:15.788294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07934f1-c4b2-483f-bc24-ee3f42ca029f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:15.789622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07934f1-c4b2-483f-bc24-ee3f42ca029f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:15.814847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 398/825] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:13:15 2022] POST /identity/v3/endpoints => generated 337 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:13:15.862771 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885b3b5-8fcf-44c2-978f-e7cf440362a8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:15.906207 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:15.931025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b875665-2d8e-4d22-a3f6-602e48410c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:15.931899 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b875665-2d8e-4d22-a3f6-602e48410c8d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:15.932280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b875665-2d8e-4d22-a3f6-602e48410c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:15.932651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b875665-2d8e-4d22-a3f6-602e48410c8d None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:15.933555 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b875665-2d8e-4d22-a3f6-602e48410c8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:15.933965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b875665-2d8e-4d22-a3f6-602e48410c8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:15.935649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b875665-2d8e-4d22-a3f6-602e48410c8d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:15.964157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 428/826] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 4 22:13:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:15.970158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07934f1-c4b2-483f-bc24-ee3f42ca029f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:16.018320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:16.103664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07934f1-c4b2-483f-bc24-ee3f42ca029f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:16.140678 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c431ef-55d8-4fb6-bd0d-ebd3edc4c6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:16.141556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c431ef-55d8-4fb6-bd0d-ebd3edc4c6fc None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:16.142015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c431ef-55d8-4fb6-bd0d-ebd3edc4c6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:16.142458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c431ef-55d8-4fb6-bd0d-ebd3edc4c6fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:16.215305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c431ef-55d8-4fb6-bd0d-ebd3edc4c6fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:16.217027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c431ef-55d8-4fb6-bd0d-ebd3edc4c6fc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:16.245332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:16.324138 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 399/827] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:13:16.329618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b875665-2d8e-4d22-a3f6-602e48410c8d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:16.455765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b875665-2d8e-4d22-a3f6-602e48410c8d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:16.502241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374aed9c-847c-4519-87d7-32d07e643dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:16.502935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aed9c-847c-4519-87d7-32d07e643dbb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:16.503217 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aed9c-847c-4519-87d7-32d07e643dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:16.503563 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aed9c-847c-4519-87d7-32d07e643dbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:16.515944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374aed9c-847c-4519-87d7-32d07e643dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:16.517426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374aed9c-847c-4519-87d7-32d07e643dbb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-374aed9c-847c-4519-87d7-32d07e643dbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:16.537039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:16.539107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:16.540004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:16.540004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:16.540004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:16.540004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:16.540004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 429/828] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:16.543953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c431ef-55d8-4fb6-bd0d-ebd3edc4c6fc None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:16.608999 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69178c97-43cc-49a1-b1c7-e97b20e3c240 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:16.610531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69178c97-43cc-49a1-b1c7-e97b20e3c240 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:16.610828 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69178c97-43cc-49a1-b1c7-e97b20e3c240 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:16.613240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 430/829] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:16.621428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8897e-79bf-4024-9c1d-65a1f0d9c329 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:16.621716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8897e-79bf-4024-9c1d-65a1f0d9c329 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:16.621975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8897e-79bf-4024-9c1d-65a1f0d9c329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:16.650130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b1c8897e-79bf-4024-9c1d-65a1f0d9c329 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:16.651827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b1c8897e-79bf-4024-9c1d-65a1f0d9c329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:16.668593 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c431ef-55d8-4fb6-bd0d-ebd3edc4c6fc None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:16.684613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:16.705698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:16.716447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49287e7a-916d-4f2c-ae33-697b8aa5b3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:16.717080 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49287e7a-916d-4f2c-ae33-697b8aa5b3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:16.717478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49287e7a-916d-4f2c-ae33-697b8aa5b3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:16.717757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49287e7a-916d-4f2c-ae33-697b8aa5b3a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:16.718481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49287e7a-916d-4f2c-ae33-697b8aa5b3a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:16.718789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49287e7a-916d-4f2c-ae33-697b8aa5b3a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:16.720166 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49287e7a-916d-4f2c-ae33-697b8aa5b3a0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:16.734730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 400/830] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:16.738912 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 431/831] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 22:13:16.741848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724a90a-da2d-4d76-b3e0-7a69c3741b6e None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:16.742213 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724a90a-da2d-4d76-b3e0-7a69c3741b6e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:16.742599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724a90a-da2d-4d76-b3e0-7a69c3741b6e None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:16.743762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8897e-79bf-4024-9c1d-65a1f0d9c329 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:16.748450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 401/832] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:16 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:16.750674 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cd3f5-eb61-4411-9929-97967d7aabb2 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:16.750965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cd3f5-eb61-4411-9929-97967d7aabb2 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:16.751247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cd3f5-eb61-4411-9929-97967d7aabb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:16.776663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b88cd3f5-eb61-4411-9929-97967d7aabb2 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:16.778507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b88cd3f5-eb61-4411-9929-97967d7aabb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:16.862706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8897e-79bf-4024-9c1d-65a1f0d9c329 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:16.865896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 402/833] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:16.866770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cd3f5-eb61-4411-9929-97967d7aabb2 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:16.921014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079430f9-0e4b-497c-95ae-e6cc83b890aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:16.922337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079430f9-0e4b-497c-95ae-e6cc83b890aa None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:16.922861 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079430f9-0e4b-497c-95ae-e6cc83b890aa None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:16.923783 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079430f9-0e4b-497c-95ae-e6cc83b890aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:16.933506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079430f9-0e4b-497c-95ae-e6cc83b890aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:16.936147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079430f9-0e4b-497c-95ae-e6cc83b890aa None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-079430f9-0e4b-497c-95ae-e6cc83b890aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:16.953622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:16.954626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:16.955718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:16.955718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:16.955718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:16.955718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:16.955718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:16.955718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:16.955718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:16.955718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:16.957515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 432/834] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:16.958491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079430f9-0e4b-497c-95ae-e6cc83b890aa None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:16.986338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:16.990931 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cd3f5-eb61-4411-9929-97967d7aabb2 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:17.011179 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:17.032558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9baa09-2209-4e61-9e03-8ec63187b98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:17.033196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9baa09-2209-4e61-9e03-8ec63187b98f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:17.033473 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9baa09-2209-4e61-9e03-8ec63187b98f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:17.033745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9baa09-2209-4e61-9e03-8ec63187b98f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:17.044791 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9baa09-2209-4e61-9e03-8ec63187b98f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-3c9baa09-2209-4e61-9e03-8ec63187b98f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:17.050962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:17.052207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:17.058741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:17.058741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:17.058741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:17.058741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:17.058741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:17.058741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:17.058741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:17.058741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:17.058741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:17.058741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:17.058741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:13:17.058741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:17.058741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 403/835] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:13:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:17.058741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9baa09-2209-4e61-9e03-8ec63187b98f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:17.091194 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079430f9-0e4b-497c-95ae-e6cc83b890aa None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:17.131841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62a26e-910b-42de-ad00-94cc2df4e90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:17.132919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62a26e-910b-42de-ad00-94cc2df4e90f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:17.133353 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62a26e-910b-42de-ad00-94cc2df4e90f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:17.133888 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62a26e-910b-42de-ad00-94cc2df4e90f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:17.135042 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62a26e-910b-42de-ad00-94cc2df4e90f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:17.136737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62a26e-910b-42de-ad00-94cc2df4e90f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-bf62a26e-910b-42de-ad00-94cc2df4e90f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:17.147144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:17.148370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:17.149413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:17.149413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:17.149413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:17.149413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:17.149413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:17.149413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:17.149413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:17.149413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:17.149413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:17.149413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:17.149413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:17.149413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:17.149413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 22:13:17.149413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:17.156742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 433/836] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:13:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:17.157907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62a26e-910b-42de-ad00-94cc2df4e90f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:17.178522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9baa09-2209-4e61-9e03-8ec63187b98f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:17.219786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026a18-b4ec-4988-85de-b411415cafba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:17.220817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026a18-b4ec-4988-85de-b411415cafba None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:17.221263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026a18-b4ec-4988-85de-b411415cafba None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:17.221739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026a18-b4ec-4988-85de-b411415cafba None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:17.222774 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0026a18-b4ec-4988-85de-b411415cafba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:17.223094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0026a18-b4ec-4988-85de-b411415cafba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:17.225849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0026a18-b4ec-4988-85de-b411415cafba None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:17.239435 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 404/837] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:17.240308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026a18-b4ec-4988-85de-b411415cafba None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:17.261634 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:17.279659 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62a26e-910b-42de-ad00-94cc2df4e90f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:17.290266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:17.317535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3f316-0e0e-44cf-9cfb-219265437fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:17.318208 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f316-0e0e-44cf-9cfb-219265437fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:17.318518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f316-0e0e-44cf-9cfb-219265437fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:17.318800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f316-0e0e-44cf-9cfb-219265437fc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:17.319584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3f316-0e0e-44cf-9cfb-219265437fc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:17.319902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3f316-0e0e-44cf-9cfb-219265437fc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:17.321287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3f316-0e0e-44cf-9cfb-219265437fc4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:17.334823 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 434/838] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:13:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:17.334823 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3f316-0e0e-44cf-9cfb-219265437fc4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:17.368463 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026a18-b4ec-4988-85de-b411415cafba None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:17.405710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8006d4-c850-48ed-a66e-e9fce58b3712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:17.406229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8006d4-c850-48ed-a66e-e9fce58b3712 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:17.406563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8006d4-c850-48ed-a66e-e9fce58b3712 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:17.406979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8006d4-c850-48ed-a66e-e9fce58b3712 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:17.407659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8006d4-c850-48ed-a66e-e9fce58b3712 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:17.408464 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8006d4-c850-48ed-a66e-e9fce58b3712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:17.409828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8006d4-c850-48ed-a66e-e9fce58b3712 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:17.420473 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 405/839] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:13:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:17.420473 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8006d4-c850-48ed-a66e-e9fce58b3712 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:17.449359 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3f316-0e0e-44cf-9cfb-219265437fc4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:17.489234 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bfdda-b173-4f07-b7e1-3aef34415e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:17.489880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfdda-b173-4f07-b7e1-3aef34415e4c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:17.490203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfdda-b173-4f07-b7e1-3aef34415e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:17.490460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfdda-b173-4f07-b7e1-3aef34415e4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:17.491254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bfdda-b173-4f07-b7e1-3aef34415e4c None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=04899781f67746e193a05bdc004804cc) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:17.491567 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bfdda-b173-4f07-b7e1-3aef34415e4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:17.493006 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bfdda-b173-4f07-b7e1-3aef34415e4c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:17.499548 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 435/840] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:17 2022] GET /identity/v3/role_assignments?user.id=04899781f67746e193a05bdc004804cc&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=0053c24ce06147938dbb61657a531c94 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:17.500668 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bfdda-b173-4f07-b7e1-3aef34415e4c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:17.514355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:17.551053 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8006d4-c850-48ed-a66e-e9fce58b3712 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:17.552872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:17.591396 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781e04c-49df-49f8-ba52-11b7f6d2ec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:17.592058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781e04c-49df-49f8-ba52-11b7f6d2ec98 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:17.592343 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781e04c-49df-49f8-ba52-11b7f6d2ec98 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:17.592618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781e04c-49df-49f8-ba52-11b7f6d2ec98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:17.605337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781e04c-49df-49f8-ba52-11b7f6d2ec98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:17.606846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781e04c-49df-49f8-ba52-11b7f6d2ec98 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:17.615254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bfdda-b173-4f07-b7e1-3aef34415e4c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-8781e04c-49df-49f8-ba52-11b7f6d2ec98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:17.622336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:17.623461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:17.624932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:17.624932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:17.624932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:17.624932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:17.624932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 406/841] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:17.625220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9df07-78bd-4f56-83ee-1b0497b33c7c None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:17.626004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9df07-78bd-4f56-83ee-1b0497b33c7c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:17.626004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9df07-78bd-4f56-83ee-1b0497b33c7c None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:17.630693 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 407/842] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:17.630693 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9df07-78bd-4f56-83ee-1b0497b33c7c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:17.660309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3899492-557f-4077-a2be-e6f1f3f84702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:17.660858 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3899492-557f-4077-a2be-e6f1f3f84702 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:17.661138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3899492-557f-4077-a2be-e6f1f3f84702 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:17.661403 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3899492-557f-4077-a2be-e6f1f3f84702 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:17.662877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3899492-557f-4077-a2be-e6f1f3f84702 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:17.662877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3899492-557f-4077-a2be-e6f1f3f84702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:17.664320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3899492-557f-4077-a2be-e6f1f3f84702 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:17.672576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 436/843] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:13:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:17.673785 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fdfba-bf3d-4c9c-a486-bfaac4906ff2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:17.674068 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fdfba-bf3d-4c9c-a486-bfaac4906ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:17.675135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fdfba-bf3d-4c9c-a486-bfaac4906ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:17.695961 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-266fdfba-bf3d-4c9c-a486-bfaac4906ff2 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:17.697346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-266fdfba-bf3d-4c9c-a486-bfaac4906ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:17.781313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9df07-78bd-4f56-83ee-1b0497b33c7c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:17.790458 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 437/844] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:17.816075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fdfba-bf3d-4c9c-a486-bfaac4906ff2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:17.820261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:17.842228 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b7db1-ad48-49b5-9168-e97919641ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:17.843261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b7db1-ad48-49b5-9168-e97919641ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:17.843762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b7db1-ad48-49b5-9168-e97919641ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:17.844042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b7db1-ad48-49b5-9168-e97919641ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:17.844740 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b7db1-ad48-49b5-9168-e97919641ee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:17.845047 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b7db1-ad48-49b5-9168-e97919641ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:17.846442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b7db1-ad48-49b5-9168-e97919641ee6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:17.858962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 408/845] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:17.864468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b7db1-ad48-49b5-9168-e97919641ee6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:17.892643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:17.949643 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fdfba-bf3d-4c9c-a486-bfaac4906ff2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:17.986823 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccd7b5-5d11-4149-aff2-0e0e119f12a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:17.987469 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccd7b5-5d11-4149-aff2-0e0e119f12a4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:17.987748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccd7b5-5d11-4149-aff2-0e0e119f12a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:17.988021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccd7b5-5d11-4149-aff2-0e0e119f12a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:18.000332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ccd7b5-5d11-4149-aff2-0e0e119f12a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:18.000919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b7db1-ad48-49b5-9168-e97919641ee6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e3ccd7b5-5d11-4149-aff2-0e0e119f12a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:18.006692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:18.007644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:18.008492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:18.008492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:18.008492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:18.008492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:18.008492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:18.008492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:18.008492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:18.008492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:18.008492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:18.008492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:18.008492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:18.008492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:18.013047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 438/846] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:13:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:18.014147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccd7b5-5d11-4149-aff2-0e0e119f12a4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:18.051852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee34a96-1362-4d8c-8fc4-f5e273bf3bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:18.053413 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee34a96-1362-4d8c-8fc4-f5e273bf3bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:18.054020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee34a96-1362-4d8c-8fc4-f5e273bf3bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:18.054581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee34a96-1362-4d8c-8fc4-f5e273bf3bf5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:18.063786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee34a96-1362-4d8c-8fc4-f5e273bf3bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:18.065573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee34a96-1362-4d8c-8fc4-f5e273bf3bf5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-1ee34a96-1362-4d8c-8fc4-f5e273bf3bf5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:18.080257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:18.081259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:18.082187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:18.082187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:18.082187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:18.082187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:18.082187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:18.082187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:18.082187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:18.082187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:18.082187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 22:13:18.082187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:18.084994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 409/847] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 4 22:13:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:18.091220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee34a96-1362-4d8c-8fc4-f5e273bf3bf5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:18.092914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:18.150153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccd7b5-5d11-4149-aff2-0e0e119f12a4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:18.178828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:18.196129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903c777-0023-4c00-917c-673b905f9ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:18.197378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903c777-0023-4c00-917c-673b905f9ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:18.197770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903c777-0023-4c00-917c-673b905f9ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:18.198118 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903c777-0023-4c00-917c-673b905f9ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:18.199219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903c777-0023-4c00-917c-673b905f9ed2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:18.199600 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903c777-0023-4c00-917c-673b905f9ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:18.202027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903c777-0023-4c00-917c-673b905f9ed2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:18.213101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee34a96-1362-4d8c-8fc4-f5e273bf3bf5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:18.218898 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 439/848] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:13:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:18.221225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903c777-0023-4c00-917c-673b905f9ed2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:18.258449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0c08c-c576-45ad-8900-d9ebf79263c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:18.259071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0c08c-c576-45ad-8900-d9ebf79263c5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:18.259423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0c08c-c576-45ad-8900-d9ebf79263c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:18.259768 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0c08c-c576-45ad-8900-d9ebf79263c5 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:18.260634 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0c08c-c576-45ad-8900-d9ebf79263c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:18.261012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0c08c-c576-45ad-8900-d9ebf79263c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:18.262531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0c08c-c576-45ad-8900-d9ebf79263c5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:18.285869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 410/849] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Aug 4 22:13:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:18.287816 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0c08c-c576-45ad-8900-d9ebf79263c5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:18.340049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903c777-0023-4c00-917c-673b905f9ed2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:18.367388 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:18.376895 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8071da-6e16-45f2-a589-ac24e03286d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:18.377538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8071da-6e16-45f2-a589-ac24e03286d4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:18.377813 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8071da-6e16-45f2-a589-ac24e03286d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:18.378080 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8071da-6e16-45f2-a589-ac24e03286d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:18.389966 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8071da-6e16-45f2-a589-ac24e03286d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:18.391498 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8071da-6e16-45f2-a589-ac24e03286d4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:18.393201 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0c08c-c576-45ad-8900-d9ebf79263c5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0c8071da-6e16-45f2-a589-ac24e03286d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:18.408827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:18.409743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:18.411216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:18.411216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:18.411216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:18.411216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:18.411216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 440/850] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:18.419787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8071da-6e16-45f2-a589-ac24e03286d4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:18.429287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:18.434746 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eb4d8-ceb5-4037-9584-615688ba53d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:18.435382 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eb4d8-ceb5-4037-9584-615688ba53d1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:18.435678 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eb4d8-ceb5-4037-9584-615688ba53d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:18.435941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eb4d8-ceb5-4037-9584-615688ba53d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:18.508670 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eb4d8-ceb5-4037-9584-615688ba53d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:18.510227 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eb4d8-ceb5-4037-9584-615688ba53d1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:18.533788 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8071da-6e16-45f2-a589-ac24e03286d4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:18.569604 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681da48-3424-437c-8d8e-6ad091e1883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:18.570561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681da48-3424-437c-8d8e-6ad091e1883f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:18.571019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681da48-3424-437c-8d8e-6ad091e1883f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:18.571491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681da48-3424-437c-8d8e-6ad091e1883f None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:18.572345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681da48-3424-437c-8d8e-6ad091e1883f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:18.572824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681da48-3424-437c-8d8e-6ad091e1883f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:18.574364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681da48-3424-437c-8d8e-6ad091e1883f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:18.591755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 441/851] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:18.593004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681da48-3424-437c-8d8e-6ad091e1883f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:18.618524 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 411/852] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:13:18.619814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eb4d8-ceb5-4037-9584-615688ba53d1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:18.636009 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:18.650381 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:18.700645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681da48-3424-437c-8d8e-6ad091e1883f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:18.725945 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eb4d8-ceb5-4037-9584-615688ba53d1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:18.740270 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1570a-e94e-4d43-a152-cff50ea3ea0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:18.741205 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1570a-e94e-4d43-a152-cff50ea3ea0b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:18.741663 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1570a-e94e-4d43-a152-cff50ea3ea0b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:18.742110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1570a-e94e-4d43-a152-cff50ea3ea0b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:18.749847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1570a-e94e-4d43-a152-cff50ea3ea0b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:18.751509 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1570a-e94e-4d43-a152-cff50ea3ea0b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:18.761886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5fa2a-0871-4ed6-a63a-fdb3f4a4cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:18.762567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5fa2a-0871-4ed6-a63a-fdb3f4a4cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:18.762866 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5fa2a-0871-4ed6-a63a-fdb3f4a4cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:18.763129 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5fa2a-0871-4ed6-a63a-fdb3f4a4cdf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-ebc1570a-e94e-4d43-a152-cff50ea3ea0b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:18.764669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:18.765561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:18.766531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:18.766531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:18.766531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:18.766531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:18.766531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:18.766531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:18.766531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:18.766531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:18.766531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 04 22:13:18.766531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:18.773453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 442/853] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:13:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:18.774905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5fa2a-0871-4ed6-a63a-fdb3f4a4cdf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:18.775442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1570a-e94e-4d43-a152-cff50ea3ea0b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:18.776482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5fa2a-0871-4ed6-a63a-fdb3f4a4cdf4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-93f5fa2a-0871-4ed6-a63a-fdb3f4a4cdf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:18.792084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:18.793244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:18.794236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:18.794236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:18.794236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:18.794236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:18.797863 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 412/854] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:18.799169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5fa2a-0871-4ed6-a63a-fdb3f4a4cdf4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:18.884021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:18.888653 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1570a-e94e-4d43-a152-cff50ea3ea0b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:18.890131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:18.907266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5fa2a-0871-4ed6-a63a-fdb3f4a4cdf4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:18.925413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad51be-6e5a-413e-adb0-0cf67f774d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:18.926085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad51be-6e5a-413e-adb0-0cf67f774d45 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:18.926367 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad51be-6e5a-413e-adb0-0cf67f774d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:18.926701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad51be-6e5a-413e-adb0-0cf67f774d45 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:18.928346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad51be-6e5a-413e-adb0-0cf67f774d45 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:18.928689 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad51be-6e5a-413e-adb0-0cf67f774d45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:18.929906 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad51be-6e5a-413e-adb0-0cf67f774d45 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:18.945278 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ec294-9f7f-4c0d-bbc2-fc83b7a5e4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:18.946140 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ec294-9f7f-4c0d-bbc2-fc83b7a5e4fa None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:18.946601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ec294-9f7f-4c0d-bbc2-fc83b7a5e4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:18.947042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ec294-9f7f-4c0d-bbc2-fc83b7a5e4fa None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:18.947889 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ec294-9f7f-4c0d-bbc2-fc83b7a5e4fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:18.948342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ec294-9f7f-4c0d-bbc2-fc83b7a5e4fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:18.949845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ec294-9f7f-4c0d-bbc2-fc83b7a5e4fa None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:18.954022 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 443/855] 10.222.0.27 () {56 vars in 1135 bytes} [Thu Aug 4 22:13:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:18.955090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad51be-6e5a-413e-adb0-0cf67f774d45 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:18.968486 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 413/856] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:18.969936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ec294-9f7f-4c0d-bbc2-fc83b7a5e4fa None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:19.059139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad51be-6e5a-413e-adb0-0cf67f774d45 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:19.072230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ec294-9f7f-4c0d-bbc2-fc83b7a5e4fa None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:19.096107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b5475-92ac-4c8b-9c2a-efb2effec64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:19.096726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b5475-92ac-4c8b-9c2a-efb2effec64a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:19.097015 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b5475-92ac-4c8b-9c2a-efb2effec64a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:19.097426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b5475-92ac-4c8b-9c2a-efb2effec64a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:19.109617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fb422-ce77-45fa-bc18-bba106f2be97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:19.110517 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb422-ce77-45fa-bc18-bba106f2be97 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:19.110961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb422-ce77-45fa-bc18-bba106f2be97 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:19.111384 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb422-ce77-45fa-bc18-bba106f2be97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:19.118434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fb422-ce77-45fa-bc18-bba106f2be97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:19.120070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fb422-ce77-45fa-bc18-bba106f2be97 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:19.124760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-7a5fb422-ce77-45fa-bc18-bba106f2be97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:19.132423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:19.133506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:19.134624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:19.134624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:19.134624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:19.134624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:19.134624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:19.134624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:19.134624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:19.134624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:19.141033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 414/857] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:19.142498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fb422-ce77-45fa-bc18-bba106f2be97 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:19.146704 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:19.173673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b5475-92ac-4c8b-9c2a-efb2effec64a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:19.175615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b5475-92ac-4c8b-9c2a-efb2effec64a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:19.252798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fb422-ce77-45fa-bc18-bba106f2be97 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:19.290354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254150c-f7e9-42e5-9b06-1d7dcf7d634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:19.290354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254150c-f7e9-42e5-9b06-1d7dcf7d634a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:19.290354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254150c-f7e9-42e5-9b06-1d7dcf7d634a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:19.290730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254150c-f7e9-42e5-9b06-1d7dcf7d634a None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:19.290883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 444/858] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 22:13:19.291356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254150c-f7e9-42e5-9b06-1d7dcf7d634a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:19.291665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254150c-f7e9-42e5-9b06-1d7dcf7d634a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:19.292300 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b5475-92ac-4c8b-9c2a-efb2effec64a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:19.293192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254150c-f7e9-42e5-9b06-1d7dcf7d634a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:19.312123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 415/859] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:19.313556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254150c-f7e9-42e5-9b06-1d7dcf7d634a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:19.354189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:19.390013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:19.408217 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b5475-92ac-4c8b-9c2a-efb2effec64a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:19.430998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254150c-f7e9-42e5-9b06-1d7dcf7d634a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:19.445450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d8357-cdac-408b-a251-0af1fd1cf529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:19.446381 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d8357-cdac-408b-a251-0af1fd1cf529 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:19.447356 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d8357-cdac-408b-a251-0af1fd1cf529 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:19.447765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d8357-cdac-408b-a251-0af1fd1cf529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:19.461915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d8357-cdac-408b-a251-0af1fd1cf529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:19.463911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d8357-cdac-408b-a251-0af1fd1cf529 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:19.478126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f562a37-61cf-4fd7-863a-784bd78a0d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:19.478920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f562a37-61cf-4fd7-863a-784bd78a0d43 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:19.479308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f562a37-61cf-4fd7-863a-784bd78a0d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:19.479687 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f562a37-61cf-4fd7-863a-784bd78a0d43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:19.480590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f562a37-61cf-4fd7-863a-784bd78a0d43 None admin] RBAC: Adding query filter params (role.id=aed7c83a35d741538254f3d4775f4a0e, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=42a5e67e8b854faa8689654156c994d5) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:19.481060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f562a37-61cf-4fd7-863a-784bd78a0d43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-514d8357-cdac-408b-a251-0af1fd1cf529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:19.481214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:19.482139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:19.483069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:19.483069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:19.483069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:19.483069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:19.483297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f562a37-61cf-4fd7-863a-784bd78a0d43 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:19.489418 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 445/860] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:19.491590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d8357-cdac-408b-a251-0af1fd1cf529 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:19.493043 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 416/861] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:19 2022] GET /identity/v3/role_assignments?user.id=42a5e67e8b854faa8689654156c994d5&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=aed7c83a35d741538254f3d4775f4a0e => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:19.609051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d8357-cdac-408b-a251-0af1fd1cf529 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:19.620120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:19.648313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51a652-72a1-4e5e-9e24-282f5c949d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:19.648922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51a652-72a1-4e5e-9e24-282f5c949d18 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:19.649276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51a652-72a1-4e5e-9e24-282f5c949d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:19.649812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51a652-72a1-4e5e-9e24-282f5c949d18 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:19.650269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51a652-72a1-4e5e-9e24-282f5c949d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:19.650616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51a652-72a1-4e5e-9e24-282f5c949d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:19.651320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139c5cd-4b51-4805-9305-eb8faf9e98ff None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:19.651683 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139c5cd-4b51-4805-9305-eb8faf9e98ff None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:19.651874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139c5cd-4b51-4805-9305-eb8faf9e98ff None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:19.652031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51a652-72a1-4e5e-9e24-282f5c949d18 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:19.653345 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 417/862] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:13:19.658766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3e2ab-e165-44af-96fa-461cfb5fd0d2 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:19.659051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3e2ab-e165-44af-96fa-461cfb5fd0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:19.659328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3e2ab-e165-44af-96fa-461cfb5fd0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:19.665101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 446/863] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:19.670953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51a652-72a1-4e5e-9e24-282f5c949d18 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:19.682352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2de3e2ab-e165-44af-96fa-461cfb5fd0d2 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:19.683571 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2de3e2ab-e165-44af-96fa-461cfb5fd0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:19.773020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 418/864] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 22:13:19.799115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3e2ab-e165-44af-96fa-461cfb5fd0d2 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:19.803279 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51a652-72a1-4e5e-9e24-282f5c949d18 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:19.845962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a84fb9-82a1-4b7d-a702-b747d5e715c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:19.846633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a84fb9-82a1-4b7d-a702-b747d5e715c7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:19.846913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a84fb9-82a1-4b7d-a702-b747d5e715c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:19.847184 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a84fb9-82a1-4b7d-a702-b747d5e715c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:19.855965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a84fb9-82a1-4b7d-a702-b747d5e715c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:19.857961 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a84fb9-82a1-4b7d-a702-b747d5e715c7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-55a84fb9-82a1-4b7d-a702-b747d5e715c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:19.870127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:19.871066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:19.872406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:19.872406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:19.872406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:19.872406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:19.872406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:19.872406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:19.872406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:19.872406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:19.872958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:19.873046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 447/865] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:19.873046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04880732-f516-487a-9bd0-e686965e8eed None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:19.873046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04880732-f516-487a-9bd0-e686965e8eed None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:19.873282 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04880732-f516-487a-9bd0-e686965e8eed None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:19.874329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 448/866] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:19.879145 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04880732-f516-487a-9bd0-e686965e8eed None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:19.912656 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:19.922556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3e2ab-e165-44af-96fa-461cfb5fd0d2 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:19.964661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf0649-5d99-4754-be30-0fbc3a344bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:19.965748 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf0649-5d99-4754-be30-0fbc3a344bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:19.966079 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf0649-5d99-4754-be30-0fbc3a344bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:19.966415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf0649-5d99-4754-be30-0fbc3a344bd2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:19.967056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf0649-5d99-4754-be30-0fbc3a344bd2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:19.969095 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf0649-5d99-4754-be30-0fbc3a344bd2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-42cf0649-5d99-4754-be30-0fbc3a344bd2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:19.978809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:19.979807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:19.985712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 419/867] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Aug 4 22:13:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:19.986864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af31d0-d65b-4556-a0bd-3749903bcca5 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:19.986864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af31d0-d65b-4556-a0bd-3749903bcca5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:19.986864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af31d0-d65b-4556-a0bd-3749903bcca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:20.001191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04880732-f516-487a-9bd0-e686965e8eed None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:20.002389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c5af31d0-d65b-4556-a0bd-3749903bcca5 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:20.003704 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c5af31d0-d65b-4556-a0bd-3749903bcca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:20.037871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46b9aa-79f3-417e-847c-97c7fa798dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:20.038533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46b9aa-79f3-417e-847c-97c7fa798dbe None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:20.038868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46b9aa-79f3-417e-847c-97c7fa798dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:20.039259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46b9aa-79f3-417e-847c-97c7fa798dbe None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:20.039895 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46b9aa-79f3-417e-847c-97c7fa798dbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:20.040206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46b9aa-79f3-417e-847c-97c7fa798dbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:20.041688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46b9aa-79f3-417e-847c-97c7fa798dbe None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:20.058831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 449/868] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:20.058831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46b9aa-79f3-417e-847c-97c7fa798dbe None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:20.083367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 420/869] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:20.085065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af31d0-d65b-4556-a0bd-3749903bcca5 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:20.139546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:20.172101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:20.186393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46b9aa-79f3-417e-847c-97c7fa798dbe None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:20.189984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af31d0-d65b-4556-a0bd-3749903bcca5 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:20.226258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952e393-4a33-46f9-9d58-583901efd499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:20.227014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952e393-4a33-46f9-9d58-583901efd499 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:20.227303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952e393-4a33-46f9-9d58-583901efd499 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:20.227582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952e393-4a33-46f9-9d58-583901efd499 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:20.228369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952e393-4a33-46f9-9d58-583901efd499 None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=aa5bf773ed3a4f1e916671a22c65f031) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:20.228681 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952e393-4a33-46f9-9d58-583901efd499 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:20.228985 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b86ab4-0b42-4041-ad71-e17718c284cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:20.229767 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b86ab4-0b42-4041-ad71-e17718c284cc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:20.230107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952e393-4a33-46f9-9d58-583901efd499 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:20.230346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b86ab4-0b42-4041-ad71-e17718c284cc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:20.230787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b86ab4-0b42-4041-ad71-e17718c284cc None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:20.231599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b86ab4-0b42-4041-ad71-e17718c284cc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:20.232117 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b86ab4-0b42-4041-ad71-e17718c284cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:20.233615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b86ab4-0b42-4041-ad71-e17718c284cc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:20.236029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 421/870] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:20 2022] GET /identity/v3/role_assignments?user.id=aa5bf773ed3a4f1e916671a22c65f031&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=0053c24ce06147938dbb61657a531c94 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:20.236790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952e393-4a33-46f9-9d58-583901efd499 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:20.249479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 450/871] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 4 22:13:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:20.256055 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b86ab4-0b42-4041-ad71-e17718c284cc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:20.379377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952e393-4a33-46f9-9d58-583901efd499 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:20.394036 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b86ab4-0b42-4041-ad71-e17718c284cc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:20.398432 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:20.423763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63932c0-5a3f-43c8-8285-c6236819fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:20.424400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63932c0-5a3f-43c8-8285-c6236819fae8 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:20.424687 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63932c0-5a3f-43c8-8285-c6236819fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:20.424966 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63932c0-5a3f-43c8-8285-c6236819fae8 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:20.425677 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63932c0-5a3f-43c8-8285-c6236819fae8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:20.428821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63932c0-5a3f-43c8-8285-c6236819fae8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:20.450318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d202f-5bd6-41d8-b41f-6807b6bfaede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:20.451292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d202f-5bd6-41d8-b41f-6807b6bfaede None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:20.451828 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d202f-5bd6-41d8-b41f-6807b6bfaede None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:20.452100 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d202f-5bd6-41d8-b41f-6807b6bfaede None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:20.452780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d202f-5bd6-41d8-b41f-6807b6bfaede None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:20.458428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 422/872] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 4 22:13:20 2022] POST /identity/v3/services => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:13:20.458631 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d202f-5bd6-41d8-b41f-6807b6bfaede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:20.458631 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d202f-5bd6-41d8-b41f-6807b6bfaede None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:20.461605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 451/873] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 4 22:13:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:21.685986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110370b-11e8-41d1-9a08-e1d62a78017b None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:21.686524 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110370b-11e8-41d1-9a08-e1d62a78017b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:21.686603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110370b-11e8-41d1-9a08-e1d62a78017b None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:21.688194 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 423/874] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:21.693786 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41573fa-3d9c-439e-babb-4a0bc2136f3b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:21.694169 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41573fa-3d9c-439e-babb-4a0bc2136f3b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:21.694358 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41573fa-3d9c-439e-babb-4a0bc2136f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:21.713234 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a41573fa-3d9c-439e-babb-4a0bc2136f3b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:21.714422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a41573fa-3d9c-439e-babb-4a0bc2136f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:21.725313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:21.794150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 452/875] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:21.816669 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110370b-11e8-41d1-9a08-e1d62a78017b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:21.920965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110370b-11e8-41d1-9a08-e1d62a78017b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:21.965635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d25f0-35ac-4fdc-a411-4dd3339c5b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:21.966298 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d25f0-35ac-4fdc-a411-4dd3339c5b54 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:21.966873 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d25f0-35ac-4fdc-a411-4dd3339c5b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:21.967152 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d25f0-35ac-4fdc-a411-4dd3339c5b54 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:21.978582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d25f0-35ac-4fdc-a411-4dd3339c5b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-139d25f0-35ac-4fdc-a411-4dd3339c5b54 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:21.983504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:21.984437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:21.985297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:21.985297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:21.985297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:21.985297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:21.985297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:21.985297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:21.985297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:21.985297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:21.985297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:21.985297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:21.985297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 22:13:21.985297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:21.985297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 424/876] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Aug 4 22:13:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:21.991475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41573fa-3d9c-439e-babb-4a0bc2136f3b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:22.093528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41573fa-3d9c-439e-babb-4a0bc2136f3b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:22.130663 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659292c-a936-46de-8b16-0f1866ee2754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:22.131333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659292c-a936-46de-8b16-0f1866ee2754 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:22.131615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659292c-a936-46de-8b16-0f1866ee2754 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:22.131885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659292c-a936-46de-8b16-0f1866ee2754 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:22.132599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659292c-a936-46de-8b16-0f1866ee2754 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:22.132901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659292c-a936-46de-8b16-0f1866ee2754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:22.134269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659292c-a936-46de-8b16-0f1866ee2754 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:22.143114 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 453/877] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Aug 4 22:13:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:22.148528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d25f0-35ac-4fdc-a411-4dd3339c5b54 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:22.186125 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:22.260272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d25f0-35ac-4fdc-a411-4dd3339c5b54 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:22.297583 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132c280-d056-4081-9c92-92f44031393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:22.299381 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132c280-d056-4081-9c92-92f44031393d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:22.299381 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132c280-d056-4081-9c92-92f44031393d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:22.299381 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132c280-d056-4081-9c92-92f44031393d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:22.311148 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132c280-d056-4081-9c92-92f44031393d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:22.312607 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132c280-d056-4081-9c92-92f44031393d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d132c280-d056-4081-9c92-92f44031393d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:22.327694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:22.328612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:22.329492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:22.329492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:22.329492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:22.329492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:22.329492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 425/878] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:22.334648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659292c-a936-46de-8b16-0f1866ee2754 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:22.338715 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:22.375700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c331a5-3f16-47b0-8449-477e8dcd0444 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:22.376051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c331a5-3f16-47b0-8449-477e8dcd0444 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:22.376340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c331a5-3f16-47b0-8449-477e8dcd0444 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:22.377991 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 426/879] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:22.382819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a6e3c-c4a7-4581-9a77-50304af19fc7 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:22.383104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a6e3c-c4a7-4581-9a77-50304af19fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:22.383385 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a6e3c-c4a7-4581-9a77-50304af19fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:22.401848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b86a6e3c-c4a7-4581-9a77-50304af19fc7 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:22.403077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b86a6e3c-c4a7-4581-9a77-50304af19fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:22.446739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659292c-a936-46de-8b16-0f1866ee2754 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:22.490457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 427/880] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:22.494208 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074bec8-53af-4145-b893-c2d46872ead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:22.494860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074bec8-53af-4145-b893-c2d46872ead2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:22.495145 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074bec8-53af-4145-b893-c2d46872ead2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:22.495421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074bec8-53af-4145-b893-c2d46872ead2 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:22.496115 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074bec8-53af-4145-b893-c2d46872ead2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:22.496422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074bec8-53af-4145-b893-c2d46872ead2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:22.497889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074bec8-53af-4145-b893-c2d46872ead2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:22.509715 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a6e3c-c4a7-4581-9a77-50304af19fc7 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:22.512447 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 454/881] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:22.518164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074bec8-53af-4145-b893-c2d46872ead2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:22.529575 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:22.587318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:22.613455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a6e3c-c4a7-4581-9a77-50304af19fc7 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:22.627363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074bec8-53af-4145-b893-c2d46872ead2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:22.647729 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540f648-53c3-4a4e-a0b4-a10893d5bdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:22.648372 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540f648-53c3-4a4e-a0b4-a10893d5bdde None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:22.648650 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540f648-53c3-4a4e-a0b4-a10893d5bdde None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:22.648923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540f648-53c3-4a4e-a0b4-a10893d5bdde None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:22.649549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540f648-53c3-4a4e-a0b4-a10893d5bdde None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:22.650942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540f648-53c3-4a4e-a0b4-a10893d5bdde None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-9540f648-53c3-4a4e-a0b4-a10893d5bdde None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:22.659620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:22.660603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:22.662112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:22.662112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:22.662112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:22.662112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:22.662112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:22.662112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:22.662112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:22.662112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:22.662112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:22.662112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:22.662112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:22.662112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:22.662112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:22.662112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:22.662883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f9b19-d7d5-4df5-bf06-3e0017fcbd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:22.662883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f9b19-d7d5-4df5-bf06-3e0017fcbd38 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:22.662883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f9b19-d7d5-4df5-bf06-3e0017fcbd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:22.662883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f9b19-d7d5-4df5-bf06-3e0017fcbd38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:22.663394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 428/882] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 4 22:13:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:22.664802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c908a1-1232-4450-9bbc-b77a66100fdd None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:22.665098 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c908a1-1232-4450-9bbc-b77a66100fdd None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:22.665371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c908a1-1232-4450-9bbc-b77a66100fdd None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:22.667193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 429/883] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:22.668221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d90618-6f6b-4ea9-b50c-4706fcb590ba None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:22.668501 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d90618-6f6b-4ea9-b50c-4706fcb590ba None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:22.668772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d90618-6f6b-4ea9-b50c-4706fcb590ba None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:22.670094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 430/884] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:22.670270 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f9b19-d7d5-4df5-bf06-3e0017fcbd38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:22.670684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d90618-6f6b-4ea9-b50c-4706fcb590ba None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:22.671732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f9b19-d7d5-4df5-bf06-3e0017fcbd38 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-712f9b19-d7d5-4df5-bf06-3e0017fcbd38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:22.684616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:22.685831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:22.687132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:22.687132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:22.687132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:22.687132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:22.687132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:22.687132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:22.687132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:22.687132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:22.687132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 22:13:22.687132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:22.687132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 455/885] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 4 22:13:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:22.687132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78f37e-5497-4ad4-ac68-8e40e5e32612 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:22.687799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78f37e-5497-4ad4-ac68-8e40e5e32612 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:22.687799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78f37e-5497-4ad4-ac68-8e40e5e32612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:22.705659 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1c78f37e-5497-4ad4-ac68-8e40e5e32612 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:22.706893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1c78f37e-5497-4ad4-ac68-8e40e5e32612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:22.754627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:22.774526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 456/886] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:22.774756 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d90618-6f6b-4ea9-b50c-4706fcb590ba None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:22.776238 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6ff0-7b3d-478b-8d22-f41abcb5420e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:22.776534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6ff0-7b3d-478b-8d22-f41abcb5420e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:22.776815 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb6ff0-7b3d-478b-8d22-f41abcb5420e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:22.800477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-86bb6ff0-7b3d-478b-8d22-f41abcb5420e None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:22.801775 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-86bb6ff0-7b3d-478b-8d22-f41abcb5420e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:22.811781 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a3ca1-6686-4741-abfa-c2c32696eef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:22.812430 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a3ca1-6686-4741-abfa-c2c32696eef2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:22.812710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a3ca1-6686-4741-abfa-c2c32696eef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:22.812981 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a3ca1-6686-4741-abfa-c2c32696eef2 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:22.813658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a3ca1-6686-4741-abfa-c2c32696eef2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:22.814008 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a3ca1-6686-4741-abfa-c2c32696eef2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:22.815337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063a3ca1-6686-4741-abfa-c2c32696eef2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:22.820035 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 431/887] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 4 22:13:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:22.820785 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a3ca1-6686-4741-abfa-c2c32696eef2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:22.858846 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:22.876047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 457/888] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:22.876669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb6ff0-7b3d-478b-8d22-f41abcb5420e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:22.927762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a3ca1-6686-4741-abfa-c2c32696eef2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:22.961551 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb12c2-30ab-4e6d-ada3-0acb2e0e1507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:22.962164 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb12c2-30ab-4e6d-ada3-0acb2e0e1507 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:22.962474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb12c2-30ab-4e6d-ada3-0acb2e0e1507 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:22.962752 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb12c2-30ab-4e6d-ada3-0acb2e0e1507 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:22.963537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb12c2-30ab-4e6d-ada3-0acb2e0e1507 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:22.963845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb12c2-30ab-4e6d-ada3-0acb2e0e1507 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:22.965257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb12c2-30ab-4e6d-ada3-0acb2e0e1507 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:22.974031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb6ff0-7b3d-478b-8d22-f41abcb5420e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:22.982000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 432/889] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Aug 4 22:13:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:22.982941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb12c2-30ab-4e6d-ada3-0acb2e0e1507 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:22.986554 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:23.009120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b33fa-278b-492c-9d75-6c489827b40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:23.009719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b33fa-278b-492c-9d75-6c489827b40a None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:23.010002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b33fa-278b-492c-9d75-6c489827b40a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:23.010274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b33fa-278b-492c-9d75-6c489827b40a None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:23.010989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b33fa-278b-492c-9d75-6c489827b40a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:23.012354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b33fa-278b-492c-9d75-6c489827b40a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:23.027759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 458/890] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 4 22:13:22 2022] POST /identity/v3/services => generated 269 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:13:23.028489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b33fa-278b-492c-9d75-6c489827b40a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:23.082215 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:23.105131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb12c2-30ab-4e6d-ada3-0acb2e0e1507 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:23.151350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a22d30-86eb-474e-a86d-2ca2994bb8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:23.151910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b33fa-278b-492c-9d75-6c489827b40a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:23.152030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22d30-86eb-474e-a86d-2ca2994bb8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:23.152296 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22d30-86eb-474e-a86d-2ca2994bb8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:23.152576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22d30-86eb-474e-a86d-2ca2994bb8f2 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:23.153258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a22d30-86eb-474e-a86d-2ca2994bb8f2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:23.153570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a22d30-86eb-474e-a86d-2ca2994bb8f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:23.155005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a22d30-86eb-474e-a86d-2ca2994bb8f2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:23.162448 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 433/891] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 4 22:13:22 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:23.162448 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a22d30-86eb-474e-a86d-2ca2994bb8f2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:23.221321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f2935-ce73-4191-a882-d704056e4a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:23.222355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2935-ce73-4191-a882-d704056e4a5a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:23.223699 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2935-ce73-4191-a882-d704056e4a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:23.224016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2935-ce73-4191-a882-d704056e4a5a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:23.224663 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f2935-ce73-4191-a882-d704056e4a5a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:23.226082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f2935-ce73-4191-a882-d704056e4a5a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-c52f2935-ce73-4191-a882-d704056e4a5a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:23.238716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:23.240354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:23.241420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 459/892] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:13:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:23.249233 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f2935-ce73-4191-a882-d704056e4a5a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:23.264034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:23.318784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a22d30-86eb-474e-a86d-2ca2994bb8f2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:23.366954 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641b28c-59de-4bc8-9cd6-2473bdd42bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:23.367577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641b28c-59de-4bc8-9cd6-2473bdd42bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:23.367857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641b28c-59de-4bc8-9cd6-2473bdd42bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:23.368129 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641b28c-59de-4bc8-9cd6-2473bdd42bc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:23.384777 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f2935-ce73-4191-a882-d704056e4a5a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:23.394842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:23.432197 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a8217-7905-4d7a-b80e-87024b04813a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:23.433320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a8217-7905-4d7a-b80e-87024b04813a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:23.433854 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a8217-7905-4d7a-b80e-87024b04813a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:23.434424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a8217-7905-4d7a-b80e-87024b04813a None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:23.435585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a8217-7905-4d7a-b80e-87024b04813a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:23.436049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a8217-7905-4d7a-b80e-87024b04813a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:23.437670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a8217-7905-4d7a-b80e-87024b04813a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:23.450258 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 460/893] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:13:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:23.458574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a8217-7905-4d7a-b80e-87024b04813a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:23.464660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641b28c-59de-4bc8-9cd6-2473bdd42bc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:23.466377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641b28c-59de-4bc8-9cd6-2473bdd42bc2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:23.549194 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:23.574253 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a8217-7905-4d7a-b80e-87024b04813a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:23.606125 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 434/894] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:23 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:13:23.611378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641b28c-59de-4bc8-9cd6-2473bdd42bc2 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:23.622785 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217576b-c65d-4db8-9ec2-34321d82dee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:23.624049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217576b-c65d-4db8-9ec2-34321d82dee8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:23.624488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217576b-c65d-4db8-9ec2-34321d82dee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:23.625194 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217576b-c65d-4db8-9ec2-34321d82dee8 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:23.626059 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217576b-c65d-4db8-9ec2-34321d82dee8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:23.626887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217576b-c65d-4db8-9ec2-34321d82dee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:23.629224 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217576b-c65d-4db8-9ec2-34321d82dee8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:23.640586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 461/895] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:13:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:23.642564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217576b-c65d-4db8-9ec2-34321d82dee8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:23.684924 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:23.725554 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641b28c-59de-4bc8-9cd6-2473bdd42bc2 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:23.745747 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217576b-c65d-4db8-9ec2-34321d82dee8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:23.762909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac85cc-25d7-4383-b58c-61f02ae5c799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:23.764121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac85cc-25d7-4383-b58c-61f02ae5c799 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:23.764641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac85cc-25d7-4383-b58c-61f02ae5c799 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:23.765131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac85cc-25d7-4383-b58c-61f02ae5c799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:23.775824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac85cc-25d7-4383-b58c-61f02ae5c799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:23.777586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac85cc-25d7-4383-b58c-61f02ae5c799 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:23.784704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f46303-38fe-4275-b718-4c9d5b43aa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:23.785378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f46303-38fe-4275-b718-4c9d5b43aa60 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:23.785659 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f46303-38fe-4275-b718-4c9d5b43aa60 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:23.785930 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f46303-38fe-4275-b718-4c9d5b43aa60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:23.787704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f46303-38fe-4275-b718-4c9d5b43aa60 None admin] RBAC: Adding query filter params (interface=public, service_id=ede7f2ddf2bb4bac90e6247fe18aabb1, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:23.788017 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f46303-38fe-4275-b718-4c9d5b43aa60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:23.789780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f46303-38fe-4275-b718-4c9d5b43aa60 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:23.799820 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 462/896] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 4 22:13:23 2022] GET /identity/v3/endpoints?service_id=ede7f2ddf2bb4bac90e6247fe18aabb1&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-20ac85cc-25d7-4383-b58c-61f02ae5c799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:23.800676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:23.801659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:23.803193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:23.803193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:23.803193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:23.803193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:23.804559 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f46303-38fe-4275-b718-4c9d5b43aa60 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:23.806479 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 435/897] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:23.807918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac85cc-25d7-4383-b58c-61f02ae5c799 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:23.828090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:23.923711 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac85cc-25d7-4383-b58c-61f02ae5c799 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:23.930343 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:23.933804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f46303-38fe-4275-b718-4c9d5b43aa60 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:23.970513 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf48c20-2387-4eed-aa26-42c22d866fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:23.971149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf48c20-2387-4eed-aa26-42c22d866fba None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:23.971430 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf48c20-2387-4eed-aa26-42c22d866fba None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:23.971694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf48c20-2387-4eed-aa26-42c22d866fba None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:23.972479 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf48c20-2387-4eed-aa26-42c22d866fba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:23.972785 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf48c20-2387-4eed-aa26-42c22d866fba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:23.974876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a95074-44e7-4e1d-8f6f-98a20b07f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:23.975076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf48c20-2387-4eed-aa26-42c22d866fba None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:23.975894 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95074-44e7-4e1d-8f6f-98a20b07f217 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:23.976482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95074-44e7-4e1d-8f6f-98a20b07f217 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:23.976960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95074-44e7-4e1d-8f6f-98a20b07f217 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:23.977922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a95074-44e7-4e1d-8f6f-98a20b07f217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:23.979540 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a95074-44e7-4e1d-8f6f-98a20b07f217 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:23.990560 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 463/898] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 4 22:13:23 2022] GET /identity/v3/services => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:13:23.993859 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 436/899] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:23.995028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a95074-44e7-4e1d-8f6f-98a20b07f217 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:24.107517 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a95074-44e7-4e1d-8f6f-98a20b07f217 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:24.148581 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71da71-1061-4239-a3e2-b98fa0b003a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:24.149222 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71da71-1061-4239-a3e2-b98fa0b003a8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:24.149503 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71da71-1061-4239-a3e2-b98fa0b003a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:24.149773 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71da71-1061-4239-a3e2-b98fa0b003a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:24.156994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71da71-1061-4239-a3e2-b98fa0b003a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:24.158454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71da71-1061-4239-a3e2-b98fa0b003a8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-4e71da71-1061-4239-a3e2-b98fa0b003a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:24.170805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:24.171719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:24.173018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:24.173018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:24.173018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:24.173018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:24.173018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:24.173018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:24.173018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:24.173018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:24.173018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 464/900] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:24.178029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf48c20-2387-4eed-aa26-42c22d866fba None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:24.261154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:24.287566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf48c20-2387-4eed-aa26-42c22d866fba None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:24.326128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9a6ac-1cc5-45b6-ad0b-13eaf55821f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:24.327047 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9a6ac-1cc5-45b6-ad0b-13eaf55821f3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:24.327329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9a6ac-1cc5-45b6-ad0b-13eaf55821f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:24.327605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9a6ac-1cc5-45b6-ad0b-13eaf55821f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:24.328363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9a6ac-1cc5-45b6-ad0b-13eaf55821f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:24.328673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9a6ac-1cc5-45b6-ad0b-13eaf55821f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:24.330103 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9a6ac-1cc5-45b6-ad0b-13eaf55821f3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:24.343119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 437/901] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:24.349525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71da71-1061-4239-a3e2-b98fa0b003a8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:24.385694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:24.471334 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71da71-1061-4239-a3e2-b98fa0b003a8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:24.505889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11531c87-3732-4e95-b0a1-8656d1618384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:24.508141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531c87-3732-4e95-b0a1-8656d1618384 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:24.508141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531c87-3732-4e95-b0a1-8656d1618384 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:24.508141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531c87-3732-4e95-b0a1-8656d1618384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:24.508141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11531c87-3732-4e95-b0a1-8656d1618384 None admin] RBAC: Adding query filter params (role.id=f934e462c48447a48fbec7721badecdf, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=42a5e67e8b854faa8689654156c994d5) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:24.508141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11531c87-3732-4e95-b0a1-8656d1618384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:24.509546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11531c87-3732-4e95-b0a1-8656d1618384 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:24.515475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 465/902] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:24 2022] GET /identity/v3/role_assignments?user.id=42a5e67e8b854faa8689654156c994d5&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=f934e462c48447a48fbec7721badecdf => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:25.115676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fe966-72bd-4df3-bce5-645000adda55 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:25.116201 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fe966-72bd-4df3-bce5-645000adda55 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:25.116201 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fe966-72bd-4df3-bce5-645000adda55 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:25.117853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 438/903] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:25.123044 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aeaee-a23d-43ee-90b4-ad9e6e2dcfed None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:25.123479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aeaee-a23d-43ee-90b4-ad9e6e2dcfed None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:25.123627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aeaee-a23d-43ee-90b4-ad9e6e2dcfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:25.141705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-fc2aeaee-a23d-43ee-90b4-ad9e6e2dcfed None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:25.142955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fc2aeaee-a23d-43ee-90b4-ad9e6e2dcfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:25.214203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 466/904] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:25.237025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fe966-72bd-4df3-bce5-645000adda55 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:25.255157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c88ca4-8903-4773-b470-777a900a59c4 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:25.255441 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c88ca4-8903-4773-b470-777a900a59c4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:25.255710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c88ca4-8903-4773-b470-777a900a59c4 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:25.257296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 467/905] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:13:25.262157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3a95b-1ad7-4539-81bb-eb8c23f38c6f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:25.262470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3a95b-1ad7-4539-81bb-eb8c23f38c6f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:25.262750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3a95b-1ad7-4539-81bb-eb8c23f38c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:25.280775 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-90f3a95b-1ad7-4539-81bb-eb8c23f38c6f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:25.281945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-90f3a95b-1ad7-4539-81bb-eb8c23f38c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:25.318012 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:25.346220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fe966-72bd-4df3-bce5-645000adda55 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:25.362655 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 468/906] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 22:13:25.380516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3a95b-1ad7-4539-81bb-eb8c23f38c6f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:25.381519 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fde17f-8f48-449b-b819-69a4e989a864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:25.382161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fde17f-8f48-449b-b819-69a4e989a864 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:25.382585 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fde17f-8f48-449b-b819-69a4e989a864 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:25.382861 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fde17f-8f48-449b-b819-69a4e989a864 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:25.383598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fde17f-8f48-449b-b819-69a4e989a864 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:25.384964 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fde17f-8f48-449b-b819-69a4e989a864 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:25.387700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-01fde17f-8f48-449b-b819-69a4e989a864 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:25.394925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:25.396268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:25.397112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 439/907] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Aug 4 22:13:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:25.402195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fde17f-8f48-449b-b819-69a4e989a864 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:25.498860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3a95b-1ad7-4539-81bb-eb8c23f38c6f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:25.540110 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fde17f-8f48-449b-b819-69a4e989a864 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:25.544922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15c71c-eaa1-45bb-bc0a-2f9eb30cf598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:25.545763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15c71c-eaa1-45bb-bc0a-2f9eb30cf598 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:25.546222 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15c71c-eaa1-45bb-bc0a-2f9eb30cf598 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:25.546699 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15c71c-eaa1-45bb-bc0a-2f9eb30cf598 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:25.547570 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15c71c-eaa1-45bb-bc0a-2f9eb30cf598 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:25.549678 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15c71c-eaa1-45bb-bc0a-2f9eb30cf598 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:25.574810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 469/908] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 4 22:13:25 2022] POST /identity/v3/services => generated 241 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:13:25.594923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d601f8-b850-46cd-ad59-3725a9512629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:25.595613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d601f8-b850-46cd-ad59-3725a9512629 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:25.595894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d601f8-b850-46cd-ad59-3725a9512629 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:25.596167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d601f8-b850-46cd-ad59-3725a9512629 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:25.596910 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d601f8-b850-46cd-ad59-3725a9512629 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:25.597225 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d601f8-b850-46cd-ad59-3725a9512629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:25.598888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d601f8-b850-46cd-ad59-3725a9512629 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:25.605639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 440/909] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 4 22:13:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:25.611301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15c71c-eaa1-45bb-bc0a-2f9eb30cf598 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:25.627035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:25.738566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15c71c-eaa1-45bb-bc0a-2f9eb30cf598 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:25.775538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065bcf5-1072-4ab4-b7df-a8b1842a30fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:25.776166 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065bcf5-1072-4ab4-b7df-a8b1842a30fd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:25.776450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065bcf5-1072-4ab4-b7df-a8b1842a30fd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:25.776727 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065bcf5-1072-4ab4-b7df-a8b1842a30fd None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:25.777412 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065bcf5-1072-4ab4-b7df-a8b1842a30fd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:25.777718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065bcf5-1072-4ab4-b7df-a8b1842a30fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:25.779171 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065bcf5-1072-4ab4-b7df-a8b1842a30fd None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:25.784804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 470/910] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 4 22:13:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:25.790967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d601f8-b850-46cd-ad59-3725a9512629 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:25.854219 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:25.900919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d601f8-b850-46cd-ad59-3725a9512629 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:25.935495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2998f5-0a09-4d25-92fe-98472f7f25cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:25.936121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2998f5-0a09-4d25-92fe-98472f7f25cd None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:25.936403 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2998f5-0a09-4d25-92fe-98472f7f25cd None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:25.936672 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2998f5-0a09-4d25-92fe-98472f7f25cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:25.937432 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2998f5-0a09-4d25-92fe-98472f7f25cd None admin] RBAC: Adding query filter params (interface=public, service_id=894e538ec12441e4a6ed39873743f8f8, region_id=RegionOne) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:25.937738 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2998f5-0a09-4d25-92fe-98472f7f25cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:25.939132 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2998f5-0a09-4d25-92fe-98472f7f25cd None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:25.947577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 441/911] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 4 22:13:25 2022] GET /identity/v3/endpoints?service_id=894e538ec12441e4a6ed39873743f8f8&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:25.953017 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065bcf5-1072-4ab4-b7df-a8b1842a30fd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:26.039816 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:26.072157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065bcf5-1072-4ab4-b7df-a8b1842a30fd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:26.111169 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79073a1-d1e4-4908-8a0d-c6b22afc4856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:26.111790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79073a1-d1e4-4908-8a0d-c6b22afc4856 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:26.112070 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79073a1-d1e4-4908-8a0d-c6b22afc4856 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:26.112343 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79073a1-d1e4-4908-8a0d-c6b22afc4856 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:26.112999 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79073a1-d1e4-4908-8a0d-c6b22afc4856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:26.114490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79073a1-d1e4-4908-8a0d-c6b22afc4856 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:26.121162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 471/912] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 4 22:13:25 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:13:26.198635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462bd7a-bb28-409d-a713-bb60a1beaf41 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:26.199159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462bd7a-bb28-409d-a713-bb60a1beaf41 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:26.199159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462bd7a-bb28-409d-a713-bb60a1beaf41 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:26.200879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 442/913] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:26.206844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445f84c-279f-441e-9744-2707b601ac97 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:26.207781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445f84c-279f-441e-9744-2707b601ac97 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:26.208810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445f84c-279f-441e-9744-2707b601ac97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:26.228196 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8445f84c-279f-441e-9744-2707b601ac97 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:26.229717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8445f84c-279f-441e-9744-2707b601ac97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:26.301803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 472/914] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:26.325640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462bd7a-bb28-409d-a713-bb60a1beaf41 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:26.432728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462bd7a-bb28-409d-a713-bb60a1beaf41 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:26.458774 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:26.471149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bafa50-3ff9-4578-83b9-cfadbfd7b8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:26.471783 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bafa50-3ff9-4578-83b9-cfadbfd7b8dd None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:26.472069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bafa50-3ff9-4578-83b9-cfadbfd7b8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:26.472356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bafa50-3ff9-4578-83b9-cfadbfd7b8dd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:26.473046 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bafa50-3ff9-4578-83b9-cfadbfd7b8dd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:26.474710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bafa50-3ff9-4578-83b9-cfadbfd7b8dd None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-74bafa50-3ff9-4578-83b9-cfadbfd7b8dd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:26.484107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:26.485093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:26.485941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 443/915] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:13:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:26.492063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445f84c-279f-441e-9744-2707b601ac97 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:26.559240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ab011-049c-4601-8892-9c20b30b2eaa None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:26.559541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ab011-049c-4601-8892-9c20b30b2eaa None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:26.559728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ab011-049c-4601-8892-9c20b30b2eaa None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:26.561992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:26.564913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 444/916] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:13:26.566838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dee083-eb77-4415-b502-e256a5ec76c2 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:26.567593 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dee083-eb77-4415-b502-e256a5ec76c2 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:26.568303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dee083-eb77-4415-b502-e256a5ec76c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:26.590021 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-f6dee083-eb77-4415-b502-e256a5ec76c2 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:26.591571 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f6dee083-eb77-4415-b502-e256a5ec76c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:26.604532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445f84c-279f-441e-9744-2707b601ac97 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:26.648847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e91162-ae42-4d86-b787-81e2c1b130a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:26.650001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91162-ae42-4d86-b787-81e2c1b130a1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:26.650679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91162-ae42-4d86-b787-81e2c1b130a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:26.651068 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e91162-ae42-4d86-b787-81e2c1b130a1 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:26.652008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e91162-ae42-4d86-b787-81e2c1b130a1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:26.652416 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e91162-ae42-4d86-b787-81e2c1b130a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:26.654181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e91162-ae42-4d86-b787-81e2c1b130a1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:26.662525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 473/917] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:13:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:26.667033 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e91162-ae42-4d86-b787-81e2c1b130a1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:26.678481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 445/918] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:26.699057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dee083-eb77-4415-b502-e256a5ec76c2 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:26.804077 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e91162-ae42-4d86-b787-81e2c1b130a1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:26.814656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dee083-eb77-4415-b502-e256a5ec76c2 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:26.839106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:26.845213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:26.854360 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137595d-4cd8-49b9-b2af-4309da8c7981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:26.855639 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137595d-4cd8-49b9-b2af-4309da8c7981 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:26.856181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137595d-4cd8-49b9-b2af-4309da8c7981 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:26.856554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137595d-4cd8-49b9-b2af-4309da8c7981 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:26.857481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137595d-4cd8-49b9-b2af-4309da8c7981 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:26.857940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137595d-4cd8-49b9-b2af-4309da8c7981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:26.859723 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137595d-4cd8-49b9-b2af-4309da8c7981 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:26.860762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772691e9-8348-4f4a-822c-60feb1232f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:26.861804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772691e9-8348-4f4a-822c-60feb1232f3f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:26.862649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772691e9-8348-4f4a-822c-60feb1232f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:26.863128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772691e9-8348-4f4a-822c-60feb1232f3f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:26.866483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 474/919] 10.222.0.27 () {56 vars in 1114 bytes} [Thu Aug 4 22:13:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:26.871587 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137595d-4cd8-49b9-b2af-4309da8c7981 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:26.881413 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772691e9-8348-4f4a-822c-60feb1232f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-772691e9-8348-4f4a-822c-60feb1232f3f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:26.887056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:26.887984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:26.888847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:26.888847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:26.888847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:26.888847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:26.888847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:26.888847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:26.888847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:26.888847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:26.888847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:26.888847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:26.888847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 22:13:26.888847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:26.891554 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 446/920] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Aug 4 22:13:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:26.902449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772691e9-8348-4f4a-822c-60feb1232f3f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:26.981682 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137595d-4cd8-49b9-b2af-4309da8c7981 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:27.018851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88ba06-c819-4985-a42a-d1567ab0e43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:27.019469 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88ba06-c819-4985-a42a-d1567ab0e43c None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:27.019750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88ba06-c819-4985-a42a-d1567ab0e43c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:27.020047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88ba06-c819-4985-a42a-d1567ab0e43c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:27.021337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88ba06-c819-4985-a42a-d1567ab0e43c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:27.022750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88ba06-c819-4985-a42a-d1567ab0e43c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:27.023528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772691e9-8348-4f4a-822c-60feb1232f3f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:27.048303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 475/921] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:13:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:13:27.075010 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83dd79-ca59-48cc-85fb-2317d9b4eeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:27.075947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83dd79-ca59-48cc-85fb-2317d9b4eeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:27.076411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83dd79-ca59-48cc-85fb-2317d9b4eeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:27.077098 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83dd79-ca59-48cc-85fb-2317d9b4eeb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:27.078003 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83dd79-ca59-48cc-85fb-2317d9b4eeb9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:27.078490 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83dd79-ca59-48cc-85fb-2317d9b4eeb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:27.080392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83dd79-ca59-48cc-85fb-2317d9b4eeb9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:27.095580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 447/922] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Aug 4 22:13:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:27.098181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88ba06-c819-4985-a42a-d1567ab0e43c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:27.157585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:27.228749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88ba06-c819-4985-a42a-d1567ab0e43c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:27.269413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4261bb-52b6-4937-9070-200f764b0a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:27.270069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4261bb-52b6-4937-9070-200f764b0a5e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:27.270353 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4261bb-52b6-4937-9070-200f764b0a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:27.270754 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4261bb-52b6-4937-9070-200f764b0a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:27.282739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4261bb-52b6-4937-9070-200f764b0a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:27.284253 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4261bb-52b6-4937-9070-200f764b0a5e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-ac4261bb-52b6-4937-9070-200f764b0a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:27.300810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:27.301781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:27.303546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:27.303546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:27.303546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:27.303546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:27.303546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 476/923] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:27.310256 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83dd79-ca59-48cc-85fb-2317d9b4eeb9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:27.349653 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:27.419400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83dd79-ca59-48cc-85fb-2317d9b4eeb9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:27.455520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260b9dd-15e8-4ac3-9865-8557b582120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:27.456394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260b9dd-15e8-4ac3-9865-8557b582120e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:27.456831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260b9dd-15e8-4ac3-9865-8557b582120e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:27.457258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260b9dd-15e8-4ac3-9865-8557b582120e None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:27.458173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260b9dd-15e8-4ac3-9865-8557b582120e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:27.458676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260b9dd-15e8-4ac3-9865-8557b582120e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:27.460192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260b9dd-15e8-4ac3-9865-8557b582120e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:27.477841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 448/924] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:27.479506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4261bb-52b6-4937-9070-200f764b0a5e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:27.586350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4261bb-52b6-4937-9070-200f764b0a5e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:27.587900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:27.624262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7897467-0961-4502-8461-f8b30cf3c18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:27.624830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7897467-0961-4502-8461-f8b30cf3c18d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:27.625113 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7897467-0961-4502-8461-f8b30cf3c18d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:27.625390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7897467-0961-4502-8461-f8b30cf3c18d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:27.633454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7897467-0961-4502-8461-f8b30cf3c18d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:27.634949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7897467-0961-4502-8461-f8b30cf3c18d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e7897467-0961-4502-8461-f8b30cf3c18d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:27.647354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:27.648341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:27.649333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:27.649333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:27.649333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:27.649333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:27.649333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:27.649333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:27.649333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:27.649333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:27.649333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 22:13:27.649333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:27.653313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 477/925] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 4 22:13:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:27.654700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260b9dd-15e8-4ac3-9865-8557b582120e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:27.758008 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260b9dd-15e8-4ac3-9865-8557b582120e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:27.759587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:27.773109 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a707b7b-f397-433c-97d1-3912461c9e06 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:27.773435 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a707b7b-f397-433c-97d1-3912461c9e06 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:27.773745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a707b7b-f397-433c-97d1-3912461c9e06 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:27.775489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 478/926] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:13:27.782539 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772d39e-12e0-487a-bf19-a86857368e52 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:27.783108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772d39e-12e0-487a-bf19-a86857368e52 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:27.783495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772d39e-12e0-487a-bf19-a86857368e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:27.802198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288341b4-01de-4cc1-907d-b96c5b592e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:27.802860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288341b4-01de-4cc1-907d-b96c5b592e09 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:27.803145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288341b4-01de-4cc1-907d-b96c5b592e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:27.803424 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288341b4-01de-4cc1-907d-b96c5b592e09 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:27.804226 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288341b4-01de-4cc1-907d-b96c5b592e09 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:27.804540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288341b4-01de-4cc1-907d-b96c5b592e09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:27.805970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288341b4-01de-4cc1-907d-b96c5b592e09 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:27.806354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e772d39e-12e0-487a-bf19-a86857368e52 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:27.807784 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e772d39e-12e0-487a-bf19-a86857368e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:27.830300 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 449/927] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Aug 4 22:13:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:27.831559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288341b4-01de-4cc1-907d-b96c5b592e09 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:27.898514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 479/928] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 22:13:27.914571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772d39e-12e0-487a-bf19-a86857368e52 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:27.944126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288341b4-01de-4cc1-907d-b96c5b592e09 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:27.980923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4402e6-a3d4-4c1a-8d2c-54a62b92a7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:27.981367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4402e6-a3d4-4c1a-8d2c-54a62b92a7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:27.981652 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4402e6-a3d4-4c1a-8d2c-54a62b92a7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:27.981930 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4402e6-a3d4-4c1a-8d2c-54a62b92a7b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:27.992612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4402e6-a3d4-4c1a-8d2c-54a62b92a7b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:27.994314 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4402e6-a3d4-4c1a-8d2c-54a62b92a7b4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-1e4402e6-a3d4-4c1a-8d2c-54a62b92a7b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:28.009481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:28.010442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:28.011356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:28.011356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:28.011356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:28.011356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:28.016199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 450/929] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:28.017208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4402e6-a3d4-4c1a-8d2c-54a62b92a7b4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:28.021580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:28.027380 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:28.031042 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772d39e-12e0-487a-bf19-a86857368e52 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:28.068939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0897b76-2b57-4d81-88f0-c1a00213236e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:28.069917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0897b76-2b57-4d81-88f0-c1a00213236e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:28.070475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0897b76-2b57-4d81-88f0-c1a00213236e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:28.071075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0897b76-2b57-4d81-88f0-c1a00213236e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:28.071954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0897b76-2b57-4d81-88f0-c1a00213236e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:28.073521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0897b76-2b57-4d81-88f0-c1a00213236e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e0897b76-2b57-4d81-88f0-c1a00213236e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:28.084165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:28.087461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:28.088301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:28.088301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:28.088301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:28.088301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:28.088301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:28.088301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:28.088301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:28.088301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:28.088301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:28.088301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:28.088301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:28.088301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:28.088301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:28.088301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:28.091157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 480/930] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 4 22:13:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:28.092219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0897b76-2b57-4d81-88f0-c1a00213236e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:28.124736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4402e6-a3d4-4c1a-8d2c-54a62b92a7b4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:28.160995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5c6d4-3877-40a7-a7f2-40a15faf0d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:28.161568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5c6d4-3877-40a7-a7f2-40a15faf0d32 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:28.161854 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5c6d4-3877-40a7-a7f2-40a15faf0d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:28.162132 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5c6d4-3877-40a7-a7f2-40a15faf0d32 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:28.162857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5c6d4-3877-40a7-a7f2-40a15faf0d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:28.163170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5c6d4-3877-40a7-a7f2-40a15faf0d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:28.164544 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5c6d4-3877-40a7-a7f2-40a15faf0d32 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:28.181362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 451/931] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:28.182612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5c6d4-3877-40a7-a7f2-40a15faf0d32 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:28.200467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0897b76-2b57-4d81-88f0-c1a00213236e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:28.236830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe448c52-b63e-4efa-a12f-971fea2ee9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:28.237720 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe448c52-b63e-4efa-a12f-971fea2ee9da None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:28.238104 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe448c52-b63e-4efa-a12f-971fea2ee9da None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:28.238505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe448c52-b63e-4efa-a12f-971fea2ee9da None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:28.239289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe448c52-b63e-4efa-a12f-971fea2ee9da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:28.239746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe448c52-b63e-4efa-a12f-971fea2ee9da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:28.241391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe448c52-b63e-4efa-a12f-971fea2ee9da None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:28.250540 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 481/932] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 4 22:13:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:28.252342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:28.254026 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe448c52-b63e-4efa-a12f-971fea2ee9da None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:28.277276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:28.291476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5c6d4-3877-40a7-a7f2-40a15faf0d32 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:28.330804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d8170-adf6-4199-a344-27cf1dbceaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:28.331442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d8170-adf6-4199-a344-27cf1dbceaee None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:28.331716 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d8170-adf6-4199-a344-27cf1dbceaee None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:28.331992 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d8170-adf6-4199-a344-27cf1dbceaee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:28.339973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d8170-adf6-4199-a344-27cf1dbceaee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:28.341966 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d8170-adf6-4199-a344-27cf1dbceaee None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-eb1d8170-adf6-4199-a344-27cf1dbceaee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:28.357802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:28.358786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:28.359664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:28.359664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:28.359664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:28.359664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:28.359664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:28.359664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:28.359664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:28.359664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:28.360092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 452/933] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:28.361378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffd125-83ec-4c72-b508-9d5239efa646 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:28.361658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffd125-83ec-4c72-b508-9d5239efa646 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:28.361929 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffd125-83ec-4c72-b508-9d5239efa646 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:28.366521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe448c52-b63e-4efa-a12f-971fea2ee9da None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:28.366667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 453/934] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:28.367663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffd125-83ec-4c72-b508-9d5239efa646 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:28.404506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f574b-2a2b-4409-a715-44767362e21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:28.405124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f574b-2a2b-4409-a715-44767362e21d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:28.405405 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f574b-2a2b-4409-a715-44767362e21d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:28.405682 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f574b-2a2b-4409-a715-44767362e21d None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:28.406351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f574b-2a2b-4409-a715-44767362e21d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:28.406686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f574b-2a2b-4409-a715-44767362e21d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:28.408053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f574b-2a2b-4409-a715-44767362e21d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:28.412994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 482/935] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 4 22:13:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:28.414070 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052b08d-bae1-4290-ba3e-1fde577df042 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:28.414351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052b08d-bae1-4290-ba3e-1fde577df042 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:28.414670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052b08d-bae1-4290-ba3e-1fde577df042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:28.433316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9052b08d-bae1-4290-ba3e-1fde577df042 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:28.434836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9052b08d-bae1-4290-ba3e-1fde577df042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:28.482079 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffd125-83ec-4c72-b508-9d5239efa646 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:28.508646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:28.516361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 483/936] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:28.517462 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052b08d-bae1-4290-ba3e-1fde577df042 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:28.528110 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b0800-c1f9-4af3-975f-f47a4a43c70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:28.528829 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b0800-c1f9-4af3-975f-f47a4a43c70d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:28.529199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b0800-c1f9-4af3-975f-f47a4a43c70d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:28.529590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b0800-c1f9-4af3-975f-f47a4a43c70d None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:28.530434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b0800-c1f9-4af3-975f-f47a4a43c70d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:28.530836 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b0800-c1f9-4af3-975f-f47a4a43c70d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:28.532337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b0800-c1f9-4af3-975f-f47a4a43c70d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:28.543159 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:28.546773 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 454/937] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:28.547899 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b0800-c1f9-4af3-975f-f47a4a43c70d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:28.643695 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052b08d-bae1-4290-ba3e-1fde577df042 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:28.652118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b0800-c1f9-4af3-975f-f47a4a43c70d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:28.678514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc5fbb-eefb-4706-85a9-74cbc1190728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:28.679087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc5fbb-eefb-4706-85a9-74cbc1190728 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:28.679388 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc5fbb-eefb-4706-85a9-74cbc1190728 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:28.679643 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc5fbb-eefb-4706-85a9-74cbc1190728 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:28.680387 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc5fbb-eefb-4706-85a9-74cbc1190728 None admin] RBAC: Adding query filter params (interface=public, service_id=09166732288b4ae0ba5986c8e872b767, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:28.680698 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc5fbb-eefb-4706-85a9-74cbc1190728 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:28.682066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc5fbb-eefb-4706-85a9-74cbc1190728 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:28.686889 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32e577-a4a2-4b48-8775-e534de5b32b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:28.687431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 484/938] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 4 22:13:28 2022] GET /identity/v3/endpoints?service_id=09166732288b4ae0ba5986c8e872b767&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:28.688049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc5fbb-eefb-4706-85a9-74cbc1190728 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:28.691950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32e577-a4a2-4b48-8775-e534de5b32b3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:28.692242 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32e577-a4a2-4b48-8775-e534de5b32b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:28.693144 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32e577-a4a2-4b48-8775-e534de5b32b3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:28.693794 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32e577-a4a2-4b48-8775-e534de5b32b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:28.695194 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32e577-a4a2-4b48-8775-e534de5b32b3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-5e32e577-a4a2-4b48-8775-e534de5b32b3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:28.704720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:28.705660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:28.707023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 455/939] 10.222.0.27 () {56 vars in 1132 bytes} [Thu Aug 4 22:13:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:28.707880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32e577-a4a2-4b48-8775-e534de5b32b3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:28.757757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:28.775657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:28.799276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc5fbb-eefb-4706-85a9-74cbc1190728 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:28.815687 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32e577-a4a2-4b48-8775-e534de5b32b3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:28.841899 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa11497-871e-4413-b633-2fec6924cef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:28.842597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa11497-871e-4413-b633-2fec6924cef1 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:28.842883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa11497-871e-4413-b633-2fec6924cef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:28.843196 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa11497-871e-4413-b633-2fec6924cef1 None admin] PATH_INFO: `/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/42a5e67e8b854faa8689654156c994d5/roles/f934e462c48447a48fbec7721badecdf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:28.845531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa11497-871e-4413-b633-2fec6924cef1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe696ab97a143959fa7e33cda768cfc, user_id=42a5e67e8b854faa8689654156c994d5, role_id=f934e462c48447a48fbec7721badecdf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:28.846855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa11497-871e-4413-b633-2fec6924cef1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:28.854191 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685258e-ddbd-47f7-b149-a5ea85cdf6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:28.854902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685258e-ddbd-47f7-b149-a5ea85cdf6df None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:28.855184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685258e-ddbd-47f7-b149-a5ea85cdf6df None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:28.855444 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685258e-ddbd-47f7-b149-a5ea85cdf6df None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:28.856093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685258e-ddbd-47f7-b149-a5ea85cdf6df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:28.857417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685258e-ddbd-47f7-b149-a5ea85cdf6df None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:28.870436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 485/940] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:13:28 2022] PUT /identity/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/42a5e67e8b854faa8689654156c994d5/roles/f934e462c48447a48fbec7721badecdf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:13:28.870436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa11497-871e-4413-b633-2fec6924cef1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:28.870713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 456/941] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 4 22:13:28 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:13:29.003562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa11497-871e-4413-b633-2fec6924cef1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:29.048321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac6d06-91b4-4628-9e75-42878119b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:29.049307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac6d06-91b4-4628-9e75-42878119b000 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:29.049787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac6d06-91b4-4628-9e75-42878119b000 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:29.050253 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac6d06-91b4-4628-9e75-42878119b000 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:29.051129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac6d06-91b4-4628-9e75-42878119b000 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:29.051583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac6d06-91b4-4628-9e75-42878119b000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:29.053740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac6d06-91b4-4628-9e75-42878119b000 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:29.060902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 486/942] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 4 22:13:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:29.066233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685258e-ddbd-47f7-b149-a5ea85cdf6df None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:29.170651 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685258e-ddbd-47f7-b149-a5ea85cdf6df None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:29.185452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:29.201404 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b34d2d-694c-47c9-aa67-abec22d5d737 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:29.201974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b34d2d-694c-47c9-aa67-abec22d5d737 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:29.202218 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b34d2d-694c-47c9-aa67-abec22d5d737 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:29.203832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 487/943] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:13:29.209950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64384f-640b-48c7-88f8-73491611abe0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:29.210533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64384f-640b-48c7-88f8-73491611abe0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:29.211024 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949fe14-ce13-449b-af91-d3a0e4614b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:29.211156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64384f-640b-48c7-88f8-73491611abe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:29.211639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949fe14-ce13-449b-af91-d3a0e4614b98 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:29.211916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949fe14-ce13-449b-af91-d3a0e4614b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:29.212182 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949fe14-ce13-449b-af91-d3a0e4614b98 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:29.212858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949fe14-ce13-449b-af91-d3a0e4614b98 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:29.213158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949fe14-ce13-449b-af91-d3a0e4614b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:29.214523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949fe14-ce13-449b-af91-d3a0e4614b98 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:29.219094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:29.220608 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 457/944] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 4 22:13:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:29.226312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949fe14-ce13-449b-af91-d3a0e4614b98 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:29.240086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-fc64384f-640b-48c7-88f8-73491611abe0 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:29.242577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fc64384f-640b-48c7-88f8-73491611abe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:29.334457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949fe14-ce13-449b-af91-d3a0e4614b98 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:29.334992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 488/945] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 22:13:29.358118 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64384f-640b-48c7-88f8-73491611abe0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:29.371333 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dbcc7-cd77-4abc-9d0b-43c9559ba615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:29.371962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dbcc7-cd77-4abc-9d0b-43c9559ba615 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:29.372241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dbcc7-cd77-4abc-9d0b-43c9559ba615 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:29.372512 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dbcc7-cd77-4abc-9d0b-43c9559ba615 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:29.373218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dbcc7-cd77-4abc-9d0b-43c9559ba615 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:29.380777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dbcc7-cd77-4abc-9d0b-43c9559ba615 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:29.408106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 458/946] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:13:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:13:29.497080 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64384f-640b-48c7-88f8-73491611abe0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:29.532338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:29.544934 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553f66a-e0db-43bb-81d9-5f5569953758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:29.545834 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553f66a-e0db-43bb-81d9-5f5569953758 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:29.546119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553f66a-e0db-43bb-81d9-5f5569953758 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:29.546496 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553f66a-e0db-43bb-81d9-5f5569953758 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:29.547210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553f66a-e0db-43bb-81d9-5f5569953758 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:29.548693 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553f66a-e0db-43bb-81d9-5f5569953758 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:29.551501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: WARNING keystone.server.flask.common [None req-2553f66a-e0db-43bb-81d9-5f5569953758 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 22:13:29.571989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.sql.core [None req-2553f66a-e0db-43bb-81d9-5f5569953758 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 22:13:29.571989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 22:13:29.571989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [parameters: {'id': 'd7ca47b21508441cb9ebd2b854d9f81d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 22:13:29.571989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80285) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 22:13:29.592032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2553f66a-e0db-43bb-81d9-5f5569953758 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d7ca47b21508441cb9ebd2b854d9f81d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d7ca47b21508441cb9ebd2b854d9f81d. Aug 04 22:13:29.592032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:29.592032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 22:13:29.592032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 22:13:29.592032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 22:13:29.592032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 22:13:29.592032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 22:13:29.592032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 22:13:29.592032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 22:13:29.592032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application conn.query(q) Aug 04 22:13:29.592032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 22:13:29.592032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 22:13:29.592032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result.read() Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 04 22:13:29.592940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application next(self.gen) Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application yield resource Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application next(self.gen) Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise self.value Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application session.commit() Aug 04 22:13:29.594146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.session.flush() Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application compat.raise_( Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 22:13:29.595613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 22:13:29.596931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application conn.query(q) Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result.read() Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 22:13:29.598051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [parameters: {'id': 'd7ca47b21508441cb9ebd2b854d9f81d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:29.603355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:29.604174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:29.605140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:29.605140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 04 22:13:29.605140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 04 22:13:29.605140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:29.605140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:29.605140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 04 22:13:29.605140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 04 22:13:29.605140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d7ca47b21508441cb9ebd2b854d9f81d. Aug 04 22:13:29.605140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:29.605140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 489/947] 10.222.0.27 () {60 vars in 1140 bytes} [Thu Aug 4 22:13:29 2022] POST /identity/v3/projects => generated 262 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:29.607510 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dbcc7-cd77-4abc-9d0b-43c9559ba615 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:29.644561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:29.718496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dbcc7-cd77-4abc-9d0b-43c9559ba615 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:29.755961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d66265-cbac-4fea-b303-f00c702d0824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:29.756884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d66265-cbac-4fea-b303-f00c702d0824 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:29.757317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d66265-cbac-4fea-b303-f00c702d0824 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:29.757753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d66265-cbac-4fea-b303-f00c702d0824 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:29.765092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d66265-cbac-4fea-b303-f00c702d0824 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:29.766733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d66265-cbac-4fea-b303-f00c702d0824 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a7d66265-cbac-4fea-b303-f00c702d0824 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:29.778295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:29.779459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:29.780574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:29.780574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:29.780574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:29.780574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:29.780574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:29.780574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:29.780574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:29.780574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:29.782327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 459/948] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:29.793205 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553f66a-e0db-43bb-81d9-5f5569953758 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:29.897171 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553f66a-e0db-43bb-81d9-5f5569953758 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:29.934256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5b6d6-06ca-44a5-95e4-36fc0fcd92e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:29.935280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5b6d6-06ca-44a5-95e4-36fc0fcd92e3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:29.935818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5b6d6-06ca-44a5-95e4-36fc0fcd92e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:29.936295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5b6d6-06ca-44a5-95e4-36fc0fcd92e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:29.937240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5b6d6-06ca-44a5-95e4-36fc0fcd92e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:29.937749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5b6d6-06ca-44a5-95e4-36fc0fcd92e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:29.939622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5b6d6-06ca-44a5-95e4-36fc0fcd92e3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:29.961719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 490/949] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 4 22:13:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:30.983803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc9917-81e2-4417-805f-8e39f4e135f9 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:30.984431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc9917-81e2-4417-805f-8e39f4e135f9 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:30.984431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc9917-81e2-4417-805f-8e39f4e135f9 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:30.986004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 460/950] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:30.992048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c175d1-fea3-4090-a1c6-d14f222eac4e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:30.992511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c175d1-fea3-4090-a1c6-d14f222eac4e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:30.992607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c175d1-fea3-4090-a1c6-d14f222eac4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:31.011649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-01c175d1-fea3-4090-a1c6-d14f222eac4e None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:31.013175 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-01c175d1-fea3-4090-a1c6-d14f222eac4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:31.024168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96855a8f-75c9-4bca-ac61-e4629155f5fe None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:31.024455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96855a8f-75c9-4bca-ac61-e4629155f5fe None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:31.024733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96855a8f-75c9-4bca-ac61-e4629155f5fe None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:31.026369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 461/951] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:31.031071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6accca4-6738-47b4-b98e-cc612107b909 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:31.031362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6accca4-6738-47b4-b98e-cc612107b909 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:31.031640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6accca4-6738-47b4-b98e-cc612107b909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:31.050714 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b6accca4-6738-47b4-b98e-cc612107b909 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:31.052664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b6accca4-6738-47b4-b98e-cc612107b909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:31.060329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:31.097762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 491/952] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:31.123095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c175d1-fea3-4090-a1c6-d14f222eac4e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:31.142747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 462/953] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:31.167942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6accca4-6738-47b4-b98e-cc612107b909 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:31.194737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:31.239014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c175d1-fea3-4090-a1c6-d14f222eac4e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:31.277130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b9888-ea86-465f-80b8-b5c11d12b447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:31.277778 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b9888-ea86-465f-80b8-b5c11d12b447 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:31.278064 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b9888-ea86-465f-80b8-b5c11d12b447 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:31.278343 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b9888-ea86-465f-80b8-b5c11d12b447 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:31.279019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b9888-ea86-465f-80b8-b5c11d12b447 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:31.280397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b9888-ea86-465f-80b8-b5c11d12b447 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-c16b9888-ea86-465f-80b8-b5c11d12b447 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:31.290165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:31.291308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:31.292339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 492/954] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 4 22:13:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:31.294640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6accca4-6738-47b4-b98e-cc612107b909 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:31.297445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b9888-ea86-465f-80b8-b5c11d12b447 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:31.339488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:31.339835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69263c-61fe-456f-851a-eac64cca560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:31.340685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69263c-61fe-456f-851a-eac64cca560b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:31.341805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69263c-61fe-456f-851a-eac64cca560b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:31.342385 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69263c-61fe-456f-851a-eac64cca560b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:31.357335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69263c-61fe-456f-851a-eac64cca560b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-cc69263c-61fe-456f-851a-eac64cca560b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:31.365646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:31.366665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:31.367516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:31.367516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:31.367516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:31.367516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:31.367516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:31.367516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:31.367516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:31.367516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:31.367516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:31.367516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:31.367516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 22:13:31.367516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:31.368183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 463/955] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Aug 4 22:13:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:31.374375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69263c-61fe-456f-851a-eac64cca560b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:31.424682 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b9888-ea86-465f-80b8-b5c11d12b447 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:31.471899 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:31.473565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a00eb-2395-4feb-822c-889178b1d24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:31.475493 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a00eb-2395-4feb-822c-889178b1d24c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:31.476004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a00eb-2395-4feb-822c-889178b1d24c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:31.477021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a00eb-2395-4feb-822c-889178b1d24c None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:31.478212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a00eb-2395-4feb-822c-889178b1d24c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:31.478817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a00eb-2395-4feb-822c-889178b1d24c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:31.480212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a00eb-2395-4feb-822c-889178b1d24c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:31.488617 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 493/956] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 4 22:13:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:31.494650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a00eb-2395-4feb-822c-889178b1d24c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:31.497116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69263c-61fe-456f-851a-eac64cca560b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:31.533791 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8c5c2-74f7-4a4a-a4e8-469bc1d2effe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:31.534518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8c5c2-74f7-4a4a-a4e8-469bc1d2effe None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:31.534887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8c5c2-74f7-4a4a-a4e8-469bc1d2effe None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:31.535239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8c5c2-74f7-4a4a-a4e8-469bc1d2effe None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:31.536078 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8c5c2-74f7-4a4a-a4e8-469bc1d2effe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:31.536989 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8c5c2-74f7-4a4a-a4e8-469bc1d2effe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:31.538519 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8c5c2-74f7-4a4a-a4e8-469bc1d2effe None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:31.551817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 464/957] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Aug 4 22:13:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:31.553673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8c5c2-74f7-4a4a-a4e8-469bc1d2effe None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:31.624288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a00eb-2395-4feb-822c-889178b1d24c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:31.625976 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:31.663857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aae15-ec83-4b0c-83af-09b9f9dfc29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:31.664470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aae15-ec83-4b0c-83af-09b9f9dfc29a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:31.664753 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aae15-ec83-4b0c-83af-09b9f9dfc29a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:31.665026 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aae15-ec83-4b0c-83af-09b9f9dfc29a None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:31.665700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aae15-ec83-4b0c-83af-09b9f9dfc29a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:31.666005 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aae15-ec83-4b0c-83af-09b9f9dfc29a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:31.667410 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aae15-ec83-4b0c-83af-09b9f9dfc29a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:31.676874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 494/958] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 4 22:13:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:31.676874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487911fc-e278-4593-8495-e7354d1f8663 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:31.677091 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8c5c2-74f7-4a4a-a4e8-469bc1d2effe None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:31.677186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487911fc-e278-4593-8495-e7354d1f8663 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:31.677186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487911fc-e278-4593-8495-e7354d1f8663 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:31.677186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 495/959] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:31.678243 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487911fc-e278-4593-8495-e7354d1f8663 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:31.714903 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcb564-ebe2-4380-b3c1-71ae2fb3ce2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:31.715568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcb564-ebe2-4380-b3c1-71ae2fb3ce2f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:31.715827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcb564-ebe2-4380-b3c1-71ae2fb3ce2f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:31.716099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcb564-ebe2-4380-b3c1-71ae2fb3ce2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:31.727691 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcb564-ebe2-4380-b3c1-71ae2fb3ce2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:31.729252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcb564-ebe2-4380-b3c1-71ae2fb3ce2f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:31.736133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-6cfcb564-ebe2-4380-b3c1-71ae2fb3ce2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:31.744449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:31.745637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:31.746635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:31.746635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:31.746635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:31.746635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:31.749137 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 465/960] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:31.750318 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab63615-a2c5-4d0d-bee9-deee9786254a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:31.750650 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab63615-a2c5-4d0d-bee9-deee9786254a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:31.750924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab63615-a2c5-4d0d-bee9-deee9786254a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:31.769822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-3ab63615-a2c5-4d0d-bee9-deee9786254a None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:31.771562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3ab63615-a2c5-4d0d-bee9-deee9786254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:31.790792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487911fc-e278-4593-8495-e7354d1f8663 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:31.826080 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d36511-f51f-4342-85c0-418b6a13484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:31.827369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d36511-f51f-4342-85c0-418b6a13484d None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:31.827657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d36511-f51f-4342-85c0-418b6a13484d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:31.827924 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d36511-f51f-4342-85c0-418b6a13484d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:31.828625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d36511-f51f-4342-85c0-418b6a13484d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:31.829986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d36511-f51f-4342-85c0-418b6a13484d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:31.841820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 466/961] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:31.842663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab63615-a2c5-4d0d-bee9-deee9786254a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:31.866829 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 496/962] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:13:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:13:31.867893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d36511-f51f-4342-85c0-418b6a13484d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:31.900187 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:31.968077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab63615-a2c5-4d0d-bee9-deee9786254a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:31.998331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:32.010616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d36511-f51f-4342-85c0-418b6a13484d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:32.012799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c45ca4-6104-4d3d-846b-7c3ea0a9a981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:32.013444 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c45ca4-6104-4d3d-846b-7c3ea0a9a981 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:32.013726 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c45ca4-6104-4d3d-846b-7c3ea0a9a981 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:32.014005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c45ca4-6104-4d3d-846b-7c3ea0a9a981 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:32.014755 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c45ca4-6104-4d3d-846b-7c3ea0a9a981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:32.015064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c45ca4-6104-4d3d-846b-7c3ea0a9a981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:32.016471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c45ca4-6104-4d3d-846b-7c3ea0a9a981 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:32.037248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 467/963] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:32.038629 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c45ca4-6104-4d3d-846b-7c3ea0a9a981 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:32.058571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3741f02-03bc-46ef-aa06-a7698598aeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:32.058876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3741f02-03bc-46ef-aa06-a7698598aeba None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:32.059245 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3741f02-03bc-46ef-aa06-a7698598aeba None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:32.059755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3741f02-03bc-46ef-aa06-a7698598aeba None admin] PATH_INFO: `/v3/services/compute` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:32.060731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3741f02-03bc-46ef-aa06-a7698598aeba None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:32.062036 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3741f02-03bc-46ef-aa06-a7698598aeba None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-a3741f02-03bc-46ef-aa06-a7698598aeba None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:32.075800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:32.077380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:32.078228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 497/964] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:32.083683 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3741f02-03bc-46ef-aa06-a7698598aeba None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:32.165500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c45ca4-6104-4d3d-846b-7c3ea0a9a981 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:32.182786 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:32.208931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3741f02-03bc-46ef-aa06-a7698598aeba None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:32.209169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b2f30-7d26-456f-a032-b79df00b9d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:32.209828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b2f30-7d26-456f-a032-b79df00b9d55 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:32.210115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b2f30-7d26-456f-a032-b79df00b9d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:32.210441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b2f30-7d26-456f-a032-b79df00b9d55 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:32.219345 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b2f30-7d26-456f-a032-b79df00b9d55 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:32.220841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b2f30-7d26-456f-a032-b79df00b9d55 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-877b2f30-7d26-456f-a032-b79df00b9d55 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:32.232295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:32.233295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:32.234250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:32.234250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:32.234250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:32.234250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:32.234250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:32.234250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:32.234250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:32.234250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:32.234250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 04 22:13:32.234250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:32.234250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 468/965] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 4 22:13:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:32.235277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6304-d7e1-49e4-8b0d-cf4b58c38fb4 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:32.235277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6304-d7e1-49e4-8b0d-cf4b58c38fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:32.235277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6304-d7e1-49e4-8b0d-cf4b58c38fb4 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:32.236594 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 469/966] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:32.239804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f6304-d7e1-49e4-8b0d-cf4b58c38fb4 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:32.252429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c00f3a-7abf-4f3e-9ca2-82313731d94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:32.253078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00f3a-7abf-4f3e-9ca2-82313731d94e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:32.253378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00f3a-7abf-4f3e-9ca2-82313731d94e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:32.253642 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00f3a-7abf-4f3e-9ca2-82313731d94e None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:32.254328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c00f3a-7abf-4f3e-9ca2-82313731d94e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:32.254742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c00f3a-7abf-4f3e-9ca2-82313731d94e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:32.256644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c00f3a-7abf-4f3e-9ca2-82313731d94e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:32.261596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 498/967] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 4 22:13:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:32.266903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810b55-03b5-4352-94d8-445bd506cc6a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:32.266903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810b55-03b5-4352-94d8-445bd506cc6a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:32.266903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810b55-03b5-4352-94d8-445bd506cc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:32.281293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a0810b55-03b5-4352-94d8-445bd506cc6a None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:32.282603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a0810b55-03b5-4352-94d8-445bd506cc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:32.298220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:32.353324 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 499/968] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:32.354165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810b55-03b5-4352-94d8-445bd506cc6a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:32.359202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f6304-d7e1-49e4-8b0d-cf4b58c38fb4 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:32.403278 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a29a7-8e43-49ea-8044-db30852371b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:32.404831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a29a7-8e43-49ea-8044-db30852371b3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:32.405619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a29a7-8e43-49ea-8044-db30852371b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:32.406028 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a29a7-8e43-49ea-8044-db30852371b3 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:32.406949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a29a7-8e43-49ea-8044-db30852371b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:32.407362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a29a7-8e43-49ea-8044-db30852371b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:32.408841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a29a7-8e43-49ea-8044-db30852371b3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:32.428628 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 470/969] 10.222.0.27 () {56 vars in 1149 bytes} [Thu Aug 4 22:13:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:32.429246 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a29a7-8e43-49ea-8044-db30852371b3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:32.453148 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:32.483608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810b55-03b5-4352-94d8-445bd506cc6a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:32.520995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026817-1f27-44f2-92f0-6d3ad33c9089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:32.521530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026817-1f27-44f2-92f0-6d3ad33c9089 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:32.521812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026817-1f27-44f2-92f0-6d3ad33c9089 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:32.522082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026817-1f27-44f2-92f0-6d3ad33c9089 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:32.523090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026817-1f27-44f2-92f0-6d3ad33c9089 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:32.523614 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026817-1f27-44f2-92f0-6d3ad33c9089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:32.524857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026817-1f27-44f2-92f0-6d3ad33c9089 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:32.529692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 500/970] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 4 22:13:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:32.535418 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026817-1f27-44f2-92f0-6d3ad33c9089 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:32.550883 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a29a7-8e43-49ea-8044-db30852371b3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:32.560490 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:32.596670 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029f8fa-b2b2-4ff1-9228-c93059f4754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:32.598131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f8fa-b2b2-4ff1-9228-c93059f4754d None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:32.598565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f8fa-b2b2-4ff1-9228-c93059f4754d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:32.599498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f8fa-b2b2-4ff1-9228-c93059f4754d None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:32.600639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029f8fa-b2b2-4ff1-9228-c93059f4754d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:32.602639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029f8fa-b2b2-4ff1-9228-c93059f4754d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:32.606189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: WARNING keystone.server.flask.common [None req-3029f8fa-b2b2-4ff1-9228-c93059f4754d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 04 22:13:32.627436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.sql.core [None req-3029f8fa-b2b2-4ff1-9228-c93059f4754d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 22:13:32.627436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 22:13:32.627436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [parameters: {'user_id': 'ef8b10e229bb4d36b9a5242aea639ca9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 22:13:32.627436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80284) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-3029f8fa-b2b2-4ff1-9228-c93059f4754d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application conn.query(q) Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application result.read() Aug 04 22:13:32.635136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 22:13:32.636346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application next(self.gen) Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application yield resource Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application next(self.gen) Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.session.rollback() Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.force_reraise() Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise self.value Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application session.commit() Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 04 22:13:32.637584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._prepare_impl() Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.session.flush() Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._flush(objects) Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application compat.raise_( Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application flush_context.execute() Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rec.execute(self) Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 22:13:32.638881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 22:13:32.640340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application result = self._query(query) Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application conn.query(q) Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application result.read() Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 22:13:32.642248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ef8b10e229bb4d36b9a5242aea639ca9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:32.644112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 04 22:13:32.645881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 04 22:13:32.654342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 04 22:13:32.654342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 04 22:13:32.654342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 04 22:13:32.654342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 04 22:13:32.654342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 04 22:13:32.654342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:32.655387 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 471/971] 10.222.0.27 () {60 vars in 1131 bytes} [Thu Aug 4 22:13:32 2022] POST /identity/v3/users => generated 160 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:32.657156 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029f8fa-b2b2-4ff1-9228-c93059f4754d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:32.680295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026817-1f27-44f2-92f0-6d3ad33c9089 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:32.730741 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a1088-3b68-41bc-9b4a-583582ac6da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:32.731733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a1088-3b68-41bc-9b4a-583582ac6da0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:32.732174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a1088-3b68-41bc-9b4a-583582ac6da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:32.732642 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a1088-3b68-41bc-9b4a-583582ac6da0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:32.745128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:32.783661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029f8fa-b2b2-4ff1-9228-c93059f4754d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:32.809736 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a1088-3b68-41bc-9b4a-583582ac6da0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:32.811332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a1088-3b68-41bc-9b4a-583582ac6da0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:32.821617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db3e1a-6436-43ff-a2fe-58e7d0512ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:32.822552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db3e1a-6436-43ff-a2fe-58e7d0512ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:32.823006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db3e1a-6436-43ff-a2fe-58e7d0512ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:32.823494 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db3e1a-6436-43ff-a2fe-58e7d0512ac9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:32.831686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db3e1a-6436-43ff-a2fe-58e7d0512ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:32.833656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db3e1a-6436-43ff-a2fe-58e7d0512ac9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-40db3e1a-6436-43ff-a2fe-58e7d0512ac9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:32.850388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:32.851611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:32.852804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:32.852804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:32.852804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:32.852804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:32.852804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:32.852804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:32.852804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:32.852804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:32.852804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 04 22:13:32.852804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:32.855590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 472/972] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:13:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:32.861537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db3e1a-6436-43ff-a2fe-58e7d0512ac9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:32.900562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:32.938001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 501/973] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:32 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:13:32.944855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a1088-3b68-41bc-9b4a-583582ac6da0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:32.986784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db3e1a-6436-43ff-a2fe-58e7d0512ac9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:32.987624 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:33.024254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b4864-b57c-43bd-9a40-86f5957061f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:33.024908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b4864-b57c-43bd-9a40-86f5957061f6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:33.025197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b4864-b57c-43bd-9a40-86f5957061f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:33.025475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b4864-b57c-43bd-9a40-86f5957061f6 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:33.026247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b4864-b57c-43bd-9a40-86f5957061f6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:33.026589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b4864-b57c-43bd-9a40-86f5957061f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:33.028057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b4864-b57c-43bd-9a40-86f5957061f6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:33.053482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a1088-3b68-41bc-9b4a-583582ac6da0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:33.073110 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 473/974] 10.222.0.27 () {56 vars in 1101 bytes} [Thu Aug 4 22:13:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:33.096628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b620f-180b-4343-a407-9fe18fadd511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:33.097592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b620f-180b-4343-a407-9fe18fadd511 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:33.098031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b620f-180b-4343-a407-9fe18fadd511 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:33.098541 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b620f-180b-4343-a407-9fe18fadd511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:33.111897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b620f-180b-4343-a407-9fe18fadd511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:33.113619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b620f-180b-4343-a407-9fe18fadd511 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-550b620f-180b-4343-a407-9fe18fadd511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:33.131167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:33.132321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:33.133450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:33.133450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:33.133450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:33.133450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:33.135425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 502/975] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:33.141718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b4864-b57c-43bd-9a40-86f5957061f6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:33.241617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:33.258617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b4864-b57c-43bd-9a40-86f5957061f6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:33.295614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114643fb-f7ef-4fa3-8b33-518d293b3874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:33.296234 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114643fb-f7ef-4fa3-8b33-518d293b3874 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:33.296515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114643fb-f7ef-4fa3-8b33-518d293b3874 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:33.296785 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114643fb-f7ef-4fa3-8b33-518d293b3874 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:33.297474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114643fb-f7ef-4fa3-8b33-518d293b3874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:33.297776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114643fb-f7ef-4fa3-8b33-518d293b3874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:33.299158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114643fb-f7ef-4fa3-8b33-518d293b3874 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:33.312430 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 474/976] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:33.318199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b620f-180b-4343-a407-9fe18fadd511 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:33.424327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:33.434085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b620f-180b-4343-a407-9fe18fadd511 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:33.475521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43fbe1-a3f3-4f22-8d28-5e809b349702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:33.476164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43fbe1-a3f3-4f22-8d28-5e809b349702 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:33.476444 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43fbe1-a3f3-4f22-8d28-5e809b349702 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:33.476738 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43fbe1-a3f3-4f22-8d28-5e809b349702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:33.483649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43fbe1-a3f3-4f22-8d28-5e809b349702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:33.485089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43fbe1-a3f3-4f22-8d28-5e809b349702 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-fb43fbe1-a3f3-4f22-8d28-5e809b349702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:33.496492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:33.497466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:33.498377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:33.498377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:33.498377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:33.498377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:33.498377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:33.498377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:33.498377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:33.498377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:33.499724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 503/977] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:33.503486 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114643fb-f7ef-4fa3-8b33-518d293b3874 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:33.610795 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114643fb-f7ef-4fa3-8b33-518d293b3874 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:33.644623 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2180d5f-43ec-40e8-843d-0e4a9739ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:33.645281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2180d5f-43ec-40e8-843d-0e4a9739ebc5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:33.646337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2180d5f-43ec-40e8-843d-0e4a9739ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:33.646337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2180d5f-43ec-40e8-843d-0e4a9739ebc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:33.647128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2180d5f-43ec-40e8-843d-0e4a9739ebc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:33.647439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2180d5f-43ec-40e8-843d-0e4a9739ebc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:33.648862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2180d5f-43ec-40e8-843d-0e4a9739ebc5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:33.665641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 475/978] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:33.666885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43fbe1-a3f3-4f22-8d28-5e809b349702 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:33.772603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43fbe1-a3f3-4f22-8d28-5e809b349702 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:33.806132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a260a-bb58-4932-bf72-bb2c154d5e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:33.806776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a260a-bb58-4932-bf72-bb2c154d5e39 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:33.807061 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a260a-bb58-4932-bf72-bb2c154d5e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:33.807339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a260a-bb58-4932-bf72-bb2c154d5e39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:33.808117 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a260a-bb58-4932-bf72-bb2c154d5e39 None admin] RBAC: Adding query filter params (role.id=f934e462c48447a48fbec7721badecdf, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=42a5e67e8b854faa8689654156c994d5) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:33.808429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a260a-bb58-4932-bf72-bb2c154d5e39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:33.809870 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a260a-bb58-4932-bf72-bb2c154d5e39 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:33.822504 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 504/979] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:33 2022] GET /identity/v3/role_assignments?user.id=42a5e67e8b854faa8689654156c994d5&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=f934e462c48447a48fbec7721badecdf => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:33.982698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a5c0e-3b86-441b-b9f0-1f77bef77914 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:33.982924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a5c0e-3b86-441b-b9f0-1f77bef77914 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:33.983209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a5c0e-3b86-441b-b9f0-1f77bef77914 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:33.984573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 476/980] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:33.990299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff829ed7-5545-45c6-aadb-af9b7526114c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:33.990620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff829ed7-5545-45c6-aadb-af9b7526114c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:33.990898 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff829ed7-5545-45c6-aadb-af9b7526114c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:34.010146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ff829ed7-5545-45c6-aadb-af9b7526114c None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:34.011390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ff829ed7-5545-45c6-aadb-af9b7526114c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:34.023086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:34.086207 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 505/981] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:34.109754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a5c0e-3b86-441b-b9f0-1f77bef77914 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:34.119525 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:34.212853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a5c0e-3b86-441b-b9f0-1f77bef77914 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:34.247386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bb9c6-ca10-4761-b29d-0efa0f750864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:34.248093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bb9c6-ca10-4761-b29d-0efa0f750864 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:34.248478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bb9c6-ca10-4761-b29d-0efa0f750864 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:34.248855 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bb9c6-ca10-4761-b29d-0efa0f750864 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:34.249585 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bb9c6-ca10-4761-b29d-0efa0f750864 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:34.251125 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bb9c6-ca10-4761-b29d-0efa0f750864 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-c18bb9c6-ca10-4761-b29d-0efa0f750864 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:34.260071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:34.261291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:34.262320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:34.262320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:34.262320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:34.262320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:34.262320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:34.262320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:34.262320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:34.262320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:34.262320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:34.262320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:34.262320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:34.262320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:34.262320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:34.262320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:34.264296 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 477/982] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 4 22:13:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:34.270130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff829ed7-5545-45c6-aadb-af9b7526114c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:34.370681 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff829ed7-5545-45c6-aadb-af9b7526114c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:34.403970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98979a5-17bc-4962-b1e7-327ba7e0960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:34.404586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98979a5-17bc-4962-b1e7-327ba7e0960d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:34.404891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98979a5-17bc-4962-b1e7-327ba7e0960d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:34.405145 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98979a5-17bc-4962-b1e7-327ba7e0960d None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:34.405820 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98979a5-17bc-4962-b1e7-327ba7e0960d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:34.406127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98979a5-17bc-4962-b1e7-327ba7e0960d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:34.407538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98979a5-17bc-4962-b1e7-327ba7e0960d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:34.412910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 506/983] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 4 22:13:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:34.418337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bb9c6-ca10-4761-b29d-0efa0f750864 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:34.498146 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:34.530821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bb9c6-ca10-4761-b29d-0efa0f750864 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:34.564658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b4c6e-cf6c-4fca-badc-1610427e58f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:34.565278 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b4c6e-cf6c-4fca-badc-1610427e58f0 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:34.565561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b4c6e-cf6c-4fca-badc-1610427e58f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:34.565839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b4c6e-cf6c-4fca-badc-1610427e58f0 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:34.566553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b4c6e-cf6c-4fca-badc-1610427e58f0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:34.566865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b4c6e-cf6c-4fca-badc-1610427e58f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:34.568256 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b4c6e-cf6c-4fca-badc-1610427e58f0 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:34.573404 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 478/984] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 4 22:13:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:34.579316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98979a5-17bc-4962-b1e7-327ba7e0960d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:34.592474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:34.600191 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94544499-6bfc-4e0c-b777-0e8a1965bb0d None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:34.600472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94544499-6bfc-4e0c-b777-0e8a1965bb0d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:34.600755 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94544499-6bfc-4e0c-b777-0e8a1965bb0d None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:34.602439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 479/985] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:13:34.608030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a50d0c-bf33-420e-97ef-bc8501838360 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:34.608394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a50d0c-bf33-420e-97ef-bc8501838360 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:34.608683 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a50d0c-bf33-420e-97ef-bc8501838360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:34.627834 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c6a50d0c-bf33-420e-97ef-bc8501838360 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:34.629479 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c6a50d0c-bf33-420e-97ef-bc8501838360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:34.686918 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98979a5-17bc-4962-b1e7-327ba7e0960d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:34.704951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 480/986] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 22:13:34.727334 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a50d0c-bf33-420e-97ef-bc8501838360 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:34.729008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ca523-0659-4fe2-be50-8c7846a35bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:34.729939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca523-0659-4fe2-be50-8c7846a35bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:34.731037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca523-0659-4fe2-be50-8c7846a35bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:34.731319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca523-0659-4fe2-be50-8c7846a35bb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:34.732088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ca523-0659-4fe2-be50-8c7846a35bb6 None admin] RBAC: Adding query filter params (interface=admin, service_id=09166732288b4ae0ba5986c8e872b767, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:34.732402 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ca523-0659-4fe2-be50-8c7846a35bb6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:34.733785 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ca523-0659-4fe2-be50-8c7846a35bb6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:34.744464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 507/987] 10.222.0.27 () {56 vars in 1249 bytes} [Thu Aug 4 22:13:34 2022] GET /identity/v3/endpoints?service_id=09166732288b4ae0ba5986c8e872b767&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:34.745438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ca523-0659-4fe2-be50-8c7846a35bb6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:34.797466 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:34.822777 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:34.840823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a50d0c-bf33-420e-97ef-bc8501838360 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:34.855819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ca523-0659-4fe2-be50-8c7846a35bb6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:34.885823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6e23d-86d5-4f38-8f31-7284bdb3c04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:34.886472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6e23d-86d5-4f38-8f31-7284bdb3c04f None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:34.886758 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6e23d-86d5-4f38-8f31-7284bdb3c04f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:34.887032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6e23d-86d5-4f38-8f31-7284bdb3c04f None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:34.887839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6e23d-86d5-4f38-8f31-7284bdb3c04f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:34.890452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6e23d-86d5-4f38-8f31-7284bdb3c04f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:34.900672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dded1a-72f9-42ac-ac40-119cd6eddf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:34.901309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dded1a-72f9-42ac-ac40-119cd6eddf18 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:34.901575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dded1a-72f9-42ac-ac40-119cd6eddf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:34.901839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dded1a-72f9-42ac-ac40-119cd6eddf18 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:34.902555 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dded1a-72f9-42ac-ac40-119cd6eddf18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:34.904110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dded1a-72f9-42ac-ac40-119cd6eddf18 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:34.907862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 481/988] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 4 22:13:34 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:13:34.912987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 508/989] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 4 22:13:34 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:13:35.887038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059d6d6-5b29-407b-8baa-d43b8f5c2d2c None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:35.887557 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059d6d6-5b29-407b-8baa-d43b8f5c2d2c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:35.887637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059d6d6-5b29-407b-8baa-d43b8f5c2d2c None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:35.888967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 482/990] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:35.894074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744c5b-723f-430c-a883-23fe5b05a25f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:35.894500 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744c5b-723f-430c-a883-23fe5b05a25f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:35.894673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb744c5b-723f-430c-a883-23fe5b05a25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:35.913141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-eb744c5b-723f-430c-a883-23fe5b05a25f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:35.914318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-eb744c5b-723f-430c-a883-23fe5b05a25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:36.000185 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 509/991] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:36.021993 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059d6d6-5b29-407b-8baa-d43b8f5c2d2c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:36.132810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059d6d6-5b29-407b-8baa-d43b8f5c2d2c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:36.156556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:36.168829 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ab854-068c-4ce0-a994-8fab97b1bc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:36.169461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ab854-068c-4ce0-a994-8fab97b1bc8e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:36.169736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ab854-068c-4ce0-a994-8fab97b1bc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:36.170004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ab854-068c-4ce0-a994-8fab97b1bc8e None admin] PATH_INFO: `/v3/services/image` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:36.170642 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ab854-068c-4ce0-a994-8fab97b1bc8e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:36.172021 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ab854-068c-4ce0-a994-8fab97b1bc8e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-fd3ab854-068c-4ce0-a994-8fab97b1bc8e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:36.181104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:36.182135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:36.183325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:36.183325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:36.183325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:36.183325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:36.183325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:36.183325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:36.183325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:36.183325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:36.183325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:36.183325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:36.183325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:36.183325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:36.183325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 22:13:36.183325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:36.186725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 483/992] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Aug 4 22:13:36 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:36.188232 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb744c5b-723f-430c-a883-23fe5b05a25f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:36.249001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:36.293892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb744c5b-723f-430c-a883-23fe5b05a25f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:36.328663 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8b600-bce3-470e-ab18-ef534deca66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:36.329276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8b600-bce3-470e-ab18-ef534deca66d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:36.329552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8b600-bce3-470e-ab18-ef534deca66d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:36.329822 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8b600-bce3-470e-ab18-ef534deca66d None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:36.330511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8b600-bce3-470e-ab18-ef534deca66d None admin] RBAC: Adding query filter params (name=image) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:36.330817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8b600-bce3-470e-ab18-ef534deca66d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:36.332172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8b600-bce3-470e-ab18-ef534deca66d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:36.337009 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 510/993] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:36.342611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ab854-068c-4ce0-a994-8fab97b1bc8e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:36.442073 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ab854-068c-4ce0-a994-8fab97b1bc8e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:36.480581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c04197-edb8-47d4-bc11-343d6baf5e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:36.481198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04197-edb8-47d4-bc11-343d6baf5e3c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:36.481477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04197-edb8-47d4-bc11-343d6baf5e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:36.481798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04197-edb8-47d4-bc11-343d6baf5e3c None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:36.482497 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c04197-edb8-47d4-bc11-343d6baf5e3c None admin] RBAC: Adding query filter params (type=image) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:36.482804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c04197-edb8-47d4-bc11-343d6baf5e3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:36.484159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c04197-edb8-47d4-bc11-343d6baf5e3c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:36.488813 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 484/994] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:36.972902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9e64-0dd3-4a4d-8938-9222af2d80e6 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:36.973452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9e64-0dd3-4a4d-8938-9222af2d80e6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:36.973452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb9e64-0dd3-4a4d-8938-9222af2d80e6 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:36.975654 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 511/995] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:36.980359 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004dd4a-5586-4e11-844b-b984ded0e940 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:36.980643 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004dd4a-5586-4e11-844b-b984ded0e940 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:36.980916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004dd4a-5586-4e11-844b-b984ded0e940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:36.981134 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950ac0-b447-4c7c-a0b4-d6fb30452b7f None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:36.981577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950ac0-b447-4c7c-a0b4-d6fb30452b7f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:36.981753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1950ac0-b447-4c7c-a0b4-d6fb30452b7f None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:36.983212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 485/996] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:36.988179 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e448e-816a-4f87-aad2-ae0cd5d3f59b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:36.988562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e448e-816a-4f87-aad2-ae0cd5d3f59b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:36.988957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e448e-816a-4f87-aad2-ae0cd5d3f59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:36.998766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1004dd4a-5586-4e11-844b-b984ded0e940 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:36.999953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1004dd4a-5586-4e11-844b-b984ded0e940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:37.007528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-602e448e-816a-4f87-aad2-ae0cd5d3f59b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:37.008748 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-602e448e-816a-4f87-aad2-ae0cd5d3f59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:37.061136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:37.072164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 512/997] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:37.082730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 486/998] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 22:13:37.096437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004dd4a-5586-4e11-844b-b984ded0e940 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:37.105207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e448e-816a-4f87-aad2-ae0cd5d3f59b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:37.162715 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:37.207745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e448e-816a-4f87-aad2-ae0cd5d3f59b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:37.208693 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004dd4a-5586-4e11-844b-b984ded0e940 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:37.244203 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251bf9-697a-4f7d-be17-cf8838fad222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:37.244737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251bf9-697a-4f7d-be17-cf8838fad222 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:37.245015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251bf9-697a-4f7d-be17-cf8838fad222 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:37.245283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251bf9-697a-4f7d-be17-cf8838fad222 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:37.245395 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a7823-d382-4c00-a4b5-4e7790839b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:37.245904 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64251bf9-697a-4f7d-be17-cf8838fad222 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:37.246011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a7823-d382-4c00-a4b5-4e7790839b17 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:37.246197 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a7823-d382-4c00-a4b5-4e7790839b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:37.246502 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a7823-d382-4c00-a4b5-4e7790839b17 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:37.247133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a7823-d382-4c00-a4b5-4e7790839b17 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:37.247287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64251bf9-697a-4f7d-be17-cf8838fad222 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:37.248489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a7823-d382-4c00-a4b5-4e7790839b17 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-64251bf9-697a-4f7d-be17-cf8838fad222 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:37.256438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:37.257405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:37.258247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:37.258247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:37.258247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:37.258247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:37.258247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:37.258247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:37.258247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:37.258247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:37.258247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:37.258247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:37.258247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:37.258247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:37.258247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 22:13:37.258247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-835a7823-d382-4c00-a4b5-4e7790839b17 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:37.259130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:37.260011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:37.260844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:37.260844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:37.260844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:37.260844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:37.260844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:37.260844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:37.260844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:37.260844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:37.260844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:37.260844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:37.260844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:37.260844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:37.260844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 04 22:13:37.260844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:37.262844 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 487/999] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:37.263148 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 513/1000] 10.222.0.27 () {56 vars in 1126 bytes} [Thu Aug 4 22:13:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:37.263520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251bf9-697a-4f7d-be17-cf8838fad222 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:37.266133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a7823-d382-4c00-a4b5-4e7790839b17 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:37.311806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:37.370037 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251bf9-697a-4f7d-be17-cf8838fad222 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:37.375540 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a7823-d382-4c00-a4b5-4e7790839b17 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:37.401454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:37.404929 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcc5f1-f73a-4ff2-a89e-61468192dbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:37.405273 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcc5f1-f73a-4ff2-a89e-61468192dbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:37.405556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcc5f1-f73a-4ff2-a89e-61468192dbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:37.405886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcc5f1-f73a-4ff2-a89e-61468192dbe7 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:37.406598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcc5f1-f73a-4ff2-a89e-61468192dbe7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:37.406909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcc5f1-f73a-4ff2-a89e-61468192dbe7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:37.408268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcc5f1-f73a-4ff2-a89e-61468192dbe7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:37.413310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 488/1001] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 4 22:13:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:37.414270 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd881b4c-ac01-4165-9546-923b242f13fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:37.414930 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd881b4c-ac01-4165-9546-923b242f13fd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:37.415207 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd881b4c-ac01-4165-9546-923b242f13fd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:37.415476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd881b4c-ac01-4165-9546-923b242f13fd None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:37.416144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd881b4c-ac01-4165-9546-923b242f13fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:37.416446 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd881b4c-ac01-4165-9546-923b242f13fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:37.417789 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd881b4c-ac01-4165-9546-923b242f13fd None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:37.419224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcc5f1-f73a-4ff2-a89e-61468192dbe7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:37.427416 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 514/1002] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 4 22:13:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:37.428990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd881b4c-ac01-4165-9546-923b242f13fd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:37.538349 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcc5f1-f73a-4ff2-a89e-61468192dbe7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:37.545066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd881b4c-ac01-4165-9546-923b242f13fd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:37.552944 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:37.578962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a29286-c784-44f8-ad68-0172d0d7a597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:37.579587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a29286-c784-44f8-ad68-0172d0d7a597 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:37.579877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a29286-c784-44f8-ad68-0172d0d7a597 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:37.580155 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a29286-c784-44f8-ad68-0172d0d7a597 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:37.580834 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a29286-c784-44f8-ad68-0172d0d7a597 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:37.581146 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a29286-c784-44f8-ad68-0172d0d7a597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:37.581685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd748a85-9b34-44c0-b21b-c28aba39c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:37.582318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748a85-9b34-44c0-b21b-c28aba39c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:37.582557 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a29286-c784-44f8-ad68-0172d0d7a597 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:37.582653 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748a85-9b34-44c0-b21b-c28aba39c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:37.582891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd748a85-9b34-44c0-b21b-c28aba39c9a3 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:37.583618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd748a85-9b34-44c0-b21b-c28aba39c9a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:37.584018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd748a85-9b34-44c0-b21b-c28aba39c9a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:37.585353 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd748a85-9b34-44c0-b21b-c28aba39c9a3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:37.588987 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 489/1003] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 4 22:13:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:37.596599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 515/1004] 10.222.0.27 () {56 vars in 1122 bytes} [Thu Aug 4 22:13:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:37.596814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a29286-c784-44f8-ad68-0172d0d7a597 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:37.597457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd748a85-9b34-44c0-b21b-c28aba39c9a3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:37.653454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:37.700010 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a29286-c784-44f8-ad68-0172d0d7a597 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:37.707231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd748a85-9b34-44c0-b21b-c28aba39c9a3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:37.734782 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762582ea-e39f-4854-9552-7282acf81e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:37.735399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762582ea-e39f-4854-9552-7282acf81e88 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:37.735683 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762582ea-e39f-4854-9552-7282acf81e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:37.735957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762582ea-e39f-4854-9552-7282acf81e88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:37.736707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762582ea-e39f-4854-9552-7282acf81e88 None admin] RBAC: Adding query filter params (interface=public, service_id=625ceaa4556f449fb27c849c91583797, region_id=RegionOne) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:37.737024 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762582ea-e39f-4854-9552-7282acf81e88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:37.738381 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762582ea-e39f-4854-9552-7282acf81e88 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:37.742706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed09fe8-a9c4-4477-926f-c56de6c5c951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:37.743524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed09fe8-a9c4-4477-926f-c56de6c5c951 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:37.743899 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 490/1005] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 4 22:13:37 2022] GET /identity/v3/endpoints?service_id=625ceaa4556f449fb27c849c91583797&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:37.744198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed09fe8-a9c4-4477-926f-c56de6c5c951 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:37.744625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed09fe8-a9c4-4477-926f-c56de6c5c951 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:37.745333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed09fe8-a9c4-4477-926f-c56de6c5c951 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:37.746714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed09fe8-a9c4-4477-926f-c56de6c5c951 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:37.749223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762582ea-e39f-4854-9552-7282acf81e88 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:37.774450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 516/1006] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:13:37 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:13:37.805263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:37.871930 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762582ea-e39f-4854-9552-7282acf81e88 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:37.914909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799d697-0b9e-4459-877f-18d868275300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:37.915841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d697-0b9e-4459-877f-18d868275300 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:37.915841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d697-0b9e-4459-877f-18d868275300 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:37.916147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d697-0b9e-4459-877f-18d868275300 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:37.916967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799d697-0b9e-4459-877f-18d868275300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:37.918661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799d697-0b9e-4459-877f-18d868275300 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:37.925488 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 491/1007] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 4 22:13:37 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:13:38.507915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1da60-eed6-4d82-89cf-387c5157e759 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:38.508418 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1da60-eed6-4d82-89cf-387c5157e759 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:38.508497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1da60-eed6-4d82-89cf-387c5157e759 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:38.509960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 517/1008] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:38.514833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041920-e2d5-44c4-ac35-88d8132b6101 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:38.515236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041920-e2d5-44c4-ac35-88d8132b6101 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:38.515416 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98041920-e2d5-44c4-ac35-88d8132b6101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:38.533463 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-98041920-e2d5-44c4-ac35-88d8132b6101 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:38.534658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-98041920-e2d5-44c4-ac35-88d8132b6101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:38.602979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 492/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:38 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:38.625367 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1da60-eed6-4d82-89cf-387c5157e759 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:38.727685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1da60-eed6-4d82-89cf-387c5157e759 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:38.737958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:38.763009 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f465242-659b-4719-bb89-7089773f48a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:38.763860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f465242-659b-4719-bb89-7089773f48a6 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:38.764341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f465242-659b-4719-bb89-7089773f48a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:38.764797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f465242-659b-4719-bb89-7089773f48a6 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:38.765655 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f465242-659b-4719-bb89-7089773f48a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:38.767203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f465242-659b-4719-bb89-7089773f48a6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:38.790905 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 518/1010] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 4 22:13:38 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:13:39.806140 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09772ed0-cefe-4bcc-bffc-257f7eb4d4b2 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:39.806676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09772ed0-cefe-4bcc-bffc-257f7eb4d4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:39.806676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09772ed0-cefe-4bcc-bffc-257f7eb4d4b2 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:39.808133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 493/1011] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:39.813235 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b50c4-9a2d-4929-b321-f6205150e9f9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:39.813636 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b50c4-9a2d-4929-b321-f6205150e9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:39.813797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b50c4-9a2d-4929-b321-f6205150e9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:39.832401 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8b6b50c4-9a2d-4929-b321-f6205150e9f9 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:39.833616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8b6b50c4-9a2d-4929-b321-f6205150e9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:39.911259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 519/1012] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:39 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:39.934330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09772ed0-cefe-4bcc-bffc-257f7eb4d4b2 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:39.948250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f13446-5c22-4b27-9643-05b316eb459b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:39.948541 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f13446-5c22-4b27-9643-05b316eb459b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:39.948803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f13446-5c22-4b27-9643-05b316eb459b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:39.950286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 520/1013] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:13:39.955751 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e1704-7720-454b-b7a8-45292e7a6ab4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:39.956040 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e1704-7720-454b-b7a8-45292e7a6ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:39.956317 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e1704-7720-454b-b7a8-45292e7a6ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:39.965931 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:39.975633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e01e1704-7720-454b-b7a8-45292e7a6ab4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:39.976188 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e01e1704-7720-454b-b7a8-45292e7a6ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:40.045134 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 521/1014] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:39 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 22:13:40.049460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09772ed0-cefe-4bcc-bffc-257f7eb4d4b2 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:40.068582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e1704-7720-454b-b7a8-45292e7a6ab4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:40.085659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73754281-3148-42f1-86e4-8a7564103714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:40.086305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73754281-3148-42f1-86e4-8a7564103714 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:40.086608 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73754281-3148-42f1-86e4-8a7564103714 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:40.086910 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73754281-3148-42f1-86e4-8a7564103714 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:40.088117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73754281-3148-42f1-86e4-8a7564103714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:40.089529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73754281-3148-42f1-86e4-8a7564103714 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:40.095978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 494/1015] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:40.096759 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73754281-3148-42f1-86e4-8a7564103714 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:40.098064 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:40.179841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e1704-7720-454b-b7a8-45292e7a6ab4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:40.204342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:40.210960 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73754281-3148-42f1-86e4-8a7564103714 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:40.215456 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4455cc6-b781-47f7-81df-3f9ab185919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:40.216147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455cc6-b781-47f7-81df-3f9ab185919e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:40.216431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455cc6-b781-47f7-81df-3f9ab185919e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:40.216705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455cc6-b781-47f7-81df-3f9ab185919e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:40.217333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4455cc6-b781-47f7-81df-3f9ab185919e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:40.218745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4455cc6-b781-47f7-81df-3f9ab185919e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-d4455cc6-b781-47f7-81df-3f9ab185919e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:40.228307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:40.229288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:40.230152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 522/1016] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:40.235179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4455cc6-b781-47f7-81df-3f9ab185919e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:40.250075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58906aff-f1d0-4d77-9689-af4cfc24e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:40.250747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58906aff-f1d0-4d77-9689-af4cfc24e4fc None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:40.251071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58906aff-f1d0-4d77-9689-af4cfc24e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:40.251371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58906aff-f1d0-4d77-9689-af4cfc24e4fc None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:40.252057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58906aff-f1d0-4d77-9689-af4cfc24e4fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:40.253489 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58906aff-f1d0-4d77-9689-af4cfc24e4fc None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:40.282919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 495/1017] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 4 22:13:40 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:13:40.336900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:40.349269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4455cc6-b781-47f7-81df-3f9ab185919e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:40.386301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289fa17-d3e7-4c2a-8e1c-b5e5f7422831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:40.386960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289fa17-d3e7-4c2a-8e1c-b5e5f7422831 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:40.387242 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289fa17-d3e7-4c2a-8e1c-b5e5f7422831 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:40.387517 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289fa17-d3e7-4c2a-8e1c-b5e5f7422831 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:40.388202 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289fa17-d3e7-4c2a-8e1c-b5e5f7422831 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:40.388511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289fa17-d3e7-4c2a-8e1c-b5e5f7422831 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:40.389913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289fa17-d3e7-4c2a-8e1c-b5e5f7422831 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:40.400491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 523/1018] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 4 22:13:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:40.401355 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58906aff-f1d0-4d77-9689-af4cfc24e4fc None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:40.518707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58906aff-f1d0-4d77-9689-af4cfc24e4fc None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:40.553039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf3e6-f9bb-4fb1-8555-d72c1fd6c286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:40.553659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf3e6-f9bb-4fb1-8555-d72c1fd6c286 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:40.553939 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf3e6-f9bb-4fb1-8555-d72c1fd6c286 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:40.554212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf3e6-f9bb-4fb1-8555-d72c1fd6c286 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:40.554929 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bf3e6-f9bb-4fb1-8555-d72c1fd6c286 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:40.555224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bf3e6-f9bb-4fb1-8555-d72c1fd6c286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:40.556581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bf3e6-f9bb-4fb1-8555-d72c1fd6c286 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:40.566084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 496/1019] 10.222.0.27 () {56 vars in 1112 bytes} [Thu Aug 4 22:13:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:40.567291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289fa17-d3e7-4c2a-8e1c-b5e5f7422831 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:40.671749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289fa17-d3e7-4c2a-8e1c-b5e5f7422831 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:40.705335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ef31-6741-4480-8ca5-42ae204852c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:40.705952 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ef31-6741-4480-8ca5-42ae204852c3 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:40.706230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ef31-6741-4480-8ca5-42ae204852c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:40.706569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ef31-6741-4480-8ca5-42ae204852c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:40.707277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0ef31-6741-4480-8ca5-42ae204852c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:40.709170 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0ef31-6741-4480-8ca5-42ae204852c3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:40.734451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 524/1020] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:13:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:13:40.815120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b580a4c-8a9b-4f3d-924c-82affecfedd9 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:40.815676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b580a4c-8a9b-4f3d-924c-82affecfedd9 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:40.815676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b580a4c-8a9b-4f3d-924c-82affecfedd9 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:40.817238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 497/1021] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:40.822846 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772af831-fe02-439d-a925-dfdc75d66489 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:40.823383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772af831-fe02-439d-a925-dfdc75d66489 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:40.823383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772af831-fe02-439d-a925-dfdc75d66489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:40.842991 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-772af831-fe02-439d-a925-dfdc75d66489 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:40.844239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-772af831-fe02-439d-a925-dfdc75d66489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:40.849167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:40.927010 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 525/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:40.949678 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b580a4c-8a9b-4f3d-924c-82affecfedd9 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:40.967181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:41.062995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b580a4c-8a9b-4f3d-924c-82affecfedd9 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:41.098713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8b265-4c19-4a15-b98a-a7c9a5884ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:41.099360 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8b265-4c19-4a15-b98a-a7c9a5884ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:41.099640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8b265-4c19-4a15-b98a-a7c9a5884ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:41.099912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8b265-4c19-4a15-b98a-a7c9a5884ee1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:41.100539 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8b265-4c19-4a15-b98a-a7c9a5884ee1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:41.101930 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8b265-4c19-4a15-b98a-a7c9a5884ee1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-5ee8b265-4c19-4a15-b98a-a7c9a5884ee1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:41.110725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:41.111732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:41.117827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 498/1023] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Aug 4 22:13:40 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:41.120422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772af831-fe02-439d-a925-dfdc75d66489 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:41.221985 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772af831-fe02-439d-a925-dfdc75d66489 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:41.256602 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b26348-1a37-403a-b4e3-8e476dcea26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:41.257227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26348-1a37-403a-b4e3-8e476dcea26c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:41.257511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26348-1a37-403a-b4e3-8e476dcea26c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:41.257788 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b26348-1a37-403a-b4e3-8e476dcea26c None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:41.258552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b26348-1a37-403a-b4e3-8e476dcea26c None admin] RBAC: Adding query filter params (name=image) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:41.258865 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b26348-1a37-403a-b4e3-8e476dcea26c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:41.260302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b26348-1a37-403a-b4e3-8e476dcea26c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:41.262141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:41.270475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 526/1024] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:41.272514 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8b265-4c19-4a15-b98a-a7c9a5884ee1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:41.353793 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:41.378213 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8b265-4c19-4a15-b98a-a7c9a5884ee1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:41.411916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad23c0b-b7bf-4057-bacb-d09d8eabce0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:41.412537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad23c0b-b7bf-4057-bacb-d09d8eabce0a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:41.412818 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad23c0b-b7bf-4057-bacb-d09d8eabce0a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:41.413089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad23c0b-b7bf-4057-bacb-d09d8eabce0a None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:41.413762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad23c0b-b7bf-4057-bacb-d09d8eabce0a None admin] RBAC: Adding query filter params (type=image) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:41.414069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad23c0b-b7bf-4057-bacb-d09d8eabce0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:41.415456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad23c0b-b7bf-4057-bacb-d09d8eabce0a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:41.420502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 499/1025] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:41.426190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b26348-1a37-403a-b4e3-8e476dcea26c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:41.538629 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b26348-1a37-403a-b4e3-8e476dcea26c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:41.572643 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32410c-73c9-4d3a-8b4a-b543e32a4b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:41.573260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32410c-73c9-4d3a-8b4a-b543e32a4b4d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:41.573540 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32410c-73c9-4d3a-8b4a-b543e32a4b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:41.573814 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32410c-73c9-4d3a-8b4a-b543e32a4b4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:41.574589 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32410c-73c9-4d3a-8b4a-b543e32a4b4d None admin] RBAC: Adding query filter params (interface=public, service_id=4d349a7140c14947a32e38d2e737a156, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:41.574904 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32410c-73c9-4d3a-8b4a-b543e32a4b4d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:41.576570 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32410c-73c9-4d3a-8b4a-b543e32a4b4d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:41.586397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 527/1026] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 4 22:13:41 2022] GET /identity/v3/endpoints?service_id=4d349a7140c14947a32e38d2e737a156&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:41.588026 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad23c0b-b7bf-4057-bacb-d09d8eabce0a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:41.694065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad23c0b-b7bf-4057-bacb-d09d8eabce0a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:41.727685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc8018-c065-4170-ae00-e9fa9e96c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:41.728301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc8018-c065-4170-ae00-e9fa9e96c689 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:41.728587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc8018-c065-4170-ae00-e9fa9e96c689 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:41.728863 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc8018-c065-4170-ae00-e9fa9e96c689 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:41.729509 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc8018-c065-4170-ae00-e9fa9e96c689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:41.730905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc8018-c065-4170-ae00-e9fa9e96c689 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:41.737658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 500/1027] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 4 22:13:41 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:13:42.325147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d29ab0-7a15-4f35-a294-9af3e8822ee1 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:42.325669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d29ab0-7a15-4f35-a294-9af3e8822ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:42.325669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d29ab0-7a15-4f35-a294-9af3e8822ee1 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:42.327501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 528/1028] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:42.332343 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26892cf3-3e27-4552-b5b4-eb0940795cc7 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:42.332753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26892cf3-3e27-4552-b5b4-eb0940795cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:42.333496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26892cf3-3e27-4552-b5b4-eb0940795cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:42.340543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:42.352415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-26892cf3-3e27-4552-b5b4-eb0940795cc7 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:42.353586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-26892cf3-3e27-4552-b5b4-eb0940795cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:42.418769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 501/1029] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:42.442941 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d29ab0-7a15-4f35-a294-9af3e8822ee1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:42.511011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:42.557945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d29ab0-7a15-4f35-a294-9af3e8822ee1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:42.595782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154445be-b715-4f52-9749-db481036aecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:42.596350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154445be-b715-4f52-9749-db481036aecd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:42.596636 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154445be-b715-4f52-9749-db481036aecd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:42.596914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154445be-b715-4f52-9749-db481036aecd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:42.598277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154445be-b715-4f52-9749-db481036aecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:42.599789 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154445be-b715-4f52-9749-db481036aecd None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:42.602065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 529/1030] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:42.607386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26892cf3-3e27-4552-b5b4-eb0940795cc7 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:42.732968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26892cf3-3e27-4552-b5b4-eb0940795cc7 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:42.769192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1f867-4f38-4fe6-b738-f1791133416b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:42.770220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1f867-4f38-4fe6-b738-f1791133416b None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:42.770770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1f867-4f38-4fe6-b738-f1791133416b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:42.771276 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1f867-4f38-4fe6-b738-f1791133416b None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:42.772177 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1f867-4f38-4fe6-b738-f1791133416b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:42.773833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1f867-4f38-4fe6-b738-f1791133416b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:42.782136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:42.803565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 502/1031] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:13:42 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:13:42.849921 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b829f-2a9b-47f2-b247-231e10a3435e None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:42.850098 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b829f-2a9b-47f2-b247-231e10a3435e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:42.850385 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b829f-2a9b-47f2-b247-231e10a3435e None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:42.852071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 530/1032] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:42.857742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e47a6-ce74-4ef2-a2fb-4a6baebeb9f8 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:42.858062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e47a6-ce74-4ef2-a2fb-4a6baebeb9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:42.858315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e47a6-ce74-4ef2-a2fb-4a6baebeb9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:42.879760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-607e47a6-ce74-4ef2-a2fb-4a6baebeb9f8 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:42.882345 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-607e47a6-ce74-4ef2-a2fb-4a6baebeb9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:42.968201 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 503/1033] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:42.996066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b829f-2a9b-47f2-b247-231e10a3435e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:43.104206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b829f-2a9b-47f2-b247-231e10a3435e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:43.133426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:43.139365 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1265c-e082-4bd2-92d8-1e41ba7a2fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:43.140005 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1265c-e082-4bd2-92d8-1e41ba7a2fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:43.140285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1265c-e082-4bd2-92d8-1e41ba7a2fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:43.140558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1265c-e082-4bd2-92d8-1e41ba7a2fa6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:43.151160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1265c-e082-4bd2-92d8-1e41ba7a2fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b2c1265c-e082-4bd2-92d8-1e41ba7a2fa6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:43.156052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:43.157198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:43.158164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:43.158164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:43.158164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:43.158164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:43.158164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:43.158164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:43.158164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:43.158164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:43.158164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:43.158164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:43.158164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 22:13:43.158164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:43.158164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 531/1034] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Aug 4 22:13:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:43.164182 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e47a6-ce74-4ef2-a2fb-4a6baebeb9f8 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:43.263706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e47a6-ce74-4ef2-a2fb-4a6baebeb9f8 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:43.283592 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:43.300192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2091f-d151-4dcc-89c1-ef8eb881d8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:43.300817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2091f-d151-4dcc-89c1-ef8eb881d8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:43.301101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2091f-d151-4dcc-89c1-ef8eb881d8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:43.301377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2091f-d151-4dcc-89c1-ef8eb881d8d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:43.302718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2091f-d151-4dcc-89c1-ef8eb881d8d8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:43.303032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2091f-d151-4dcc-89c1-ef8eb881d8d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:43.304403 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2091f-d151-4dcc-89c1-ef8eb881d8d8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:43.312927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 504/1035] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Aug 4 22:13:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:43.318479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1265c-e082-4bd2-92d8-1e41ba7a2fa6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:43.420259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1265c-e082-4bd2-92d8-1e41ba7a2fa6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:43.459586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820c6c-6d71-4fde-a186-6a3d58eb6d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:43.460224 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820c6c-6d71-4fde-a186-6a3d58eb6d46 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:43.460499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820c6c-6d71-4fde-a186-6a3d58eb6d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:43.460769 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820c6c-6d71-4fde-a186-6a3d58eb6d46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:43.475480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42820c6c-6d71-4fde-a186-6a3d58eb6d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:43.476945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42820c6c-6d71-4fde-a186-6a3d58eb6d46 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-42820c6c-6d71-4fde-a186-6a3d58eb6d46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:43.492609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:43.493566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:43.494492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:43.494492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:43.494492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:43.494492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:43.494492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 532/1036] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:43.500858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2091f-d151-4dcc-89c1-ef8eb881d8d8 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:43.603295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2091f-d151-4dcc-89c1-ef8eb881d8d8 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:43.636453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5f7e7-addd-44f1-9bd8-b58ac48f9c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:43.637071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5f7e7-addd-44f1-9bd8-b58ac48f9c07 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:43.637351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5f7e7-addd-44f1-9bd8-b58ac48f9c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:43.637644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5f7e7-addd-44f1-9bd8-b58ac48f9c07 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:43.638311 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5f7e7-addd-44f1-9bd8-b58ac48f9c07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:43.638647 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5f7e7-addd-44f1-9bd8-b58ac48f9c07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:43.640008 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5f7e7-addd-44f1-9bd8-b58ac48f9c07 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:43.652577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 505/1037] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:43.657974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820c6c-6d71-4fde-a186-6a3d58eb6d46 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:43.704160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:43.758979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820c6c-6d71-4fde-a186-6a3d58eb6d46 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:43.792594 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaad0f3-8bda-45b0-8304-f33451b139b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:43.793319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaad0f3-8bda-45b0-8304-f33451b139b3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:43.793600 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaad0f3-8bda-45b0-8304-f33451b139b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:43.793872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaad0f3-8bda-45b0-8304-f33451b139b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:43.794878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88203-87fd-4504-b5ff-6f67c8a65874 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:43.795233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88203-87fd-4504-b5ff-6f67c8a65874 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:43.795611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce88203-87fd-4504-b5ff-6f67c8a65874 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:43.797295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 506/1038] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:13:43.801955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7e1b4-1485-4485-a2ab-27d2e61be478 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:43.802187 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaad0f3-8bda-45b0-8304-f33451b139b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:43.802300 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7e1b4-1485-4485-a2ab-27d2e61be478 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:43.802552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7e1b4-1485-4485-a2ab-27d2e61be478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:43.804053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaad0f3-8bda-45b0-8304-f33451b139b3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-eaaad0f3-8bda-45b0-8304-f33451b139b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:43.815684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:43.816845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:43.818060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:43.818060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:43.818060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:43.818060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:43.818060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:43.818060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:43.818060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:43.818060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:43.818060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:13:43.818060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:43.824804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-71b7e1b4-1485-4485-a2ab-27d2e61be478 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:43.824804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-71b7e1b4-1485-4485-a2ab-27d2e61be478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:43.825094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 533/1039] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 4 22:13:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:43.825535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaad0f3-8bda-45b0-8304-f33451b139b3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:43.860256 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:43.898439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 507/1040] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 22:13:43.917507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7e1b4-1485-4485-a2ab-27d2e61be478 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:43.933654 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaad0f3-8bda-45b0-8304-f33451b139b3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:43.936883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:43.974871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10018e-626c-42c5-b7de-204916ba18d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:43.975414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10018e-626c-42c5-b7de-204916ba18d3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:43.975754 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10018e-626c-42c5-b7de-204916ba18d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:43.975997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10018e-626c-42c5-b7de-204916ba18d3 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:43.976767 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10018e-626c-42c5-b7de-204916ba18d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:43.977075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10018e-626c-42c5-b7de-204916ba18d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:43.978548 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10018e-626c-42c5-b7de-204916ba18d3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:43.996943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 534/1041] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 4 22:13:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:44.002585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10018e-626c-42c5-b7de-204916ba18d3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:44.029382 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7e1b4-1485-4485-a2ab-27d2e61be478 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:44.066824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88717c-31f2-44dc-8952-8601b9da2d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:44.067997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88717c-31f2-44dc-8952-8601b9da2d90 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:44.068279 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88717c-31f2-44dc-8952-8601b9da2d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:44.068552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88717c-31f2-44dc-8952-8601b9da2d90 None admin] PATH_INFO: `/v3/services/image` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:44.069184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88717c-31f2-44dc-8952-8601b9da2d90 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:44.070576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88717c-31f2-44dc-8952-8601b9da2d90 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-dd88717c-31f2-44dc-8952-8601b9da2d90 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:44.079706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:44.080942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:44.081779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 508/1042] 10.222.0.27 () {56 vars in 1105 bytes} [Thu Aug 4 22:13:43 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:44.088971 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88717c-31f2-44dc-8952-8601b9da2d90 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:44.119362 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10018e-626c-42c5-b7de-204916ba18d3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:44.127859 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:44.154301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a21482-a7f8-4ebc-bffc-dd4d190c0169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:44.154946 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a21482-a7f8-4ebc-bffc-dd4d190c0169 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:44.155227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a21482-a7f8-4ebc-bffc-dd4d190c0169 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:44.155499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a21482-a7f8-4ebc-bffc-dd4d190c0169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:44.190822 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:44.206556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88717c-31f2-44dc-8952-8601b9da2d90 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:44.234635 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a21482-a7f8-4ebc-bffc-dd4d190c0169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:44.236041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a21482-a7f8-4ebc-bffc-dd4d190c0169 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:44.247123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251daf2e-b6ce-49ad-a3e8-f6250f675e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:44.247745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251daf2e-b6ce-49ad-a3e8-f6250f675e95 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:44.248023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251daf2e-b6ce-49ad-a3e8-f6250f675e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:44.248299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251daf2e-b6ce-49ad-a3e8-f6250f675e95 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:44.248972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251daf2e-b6ce-49ad-a3e8-f6250f675e95 None admin] RBAC: Adding query filter params (name=image) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:44.249283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251daf2e-b6ce-49ad-a3e8-f6250f675e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:44.250650 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251daf2e-b6ce-49ad-a3e8-f6250f675e95 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:44.256349 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 509/1043] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:44.261563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251daf2e-b6ce-49ad-a3e8-f6250f675e95 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:44.342380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 535/1044] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:44 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 22:13:44.347919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a21482-a7f8-4ebc-bffc-dd4d190c0169 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:44.361648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:44.367171 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251daf2e-b6ce-49ad-a3e8-f6250f675e95 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:44.405935 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794df32-d7e6-4857-99df-f7f72f5923d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:44.406595 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794df32-d7e6-4857-99df-f7f72f5923d6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:44.406880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794df32-d7e6-4857-99df-f7f72f5923d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:44.407153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794df32-d7e6-4857-99df-f7f72f5923d6 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:44.407916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794df32-d7e6-4857-99df-f7f72f5923d6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:44.408212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794df32-d7e6-4857-99df-f7f72f5923d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:44.409500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794df32-d7e6-4857-99df-f7f72f5923d6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:44.412916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:44.414707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 510/1045] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:44.420216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794df32-d7e6-4857-99df-f7f72f5923d6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:44.460476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a21482-a7f8-4ebc-bffc-dd4d190c0169 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:44.500984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841d99d-83f4-4e38-82b0-a58b21eedf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:44.501692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841d99d-83f4-4e38-82b0-a58b21eedf7a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:44.501980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841d99d-83f4-4e38-82b0-a58b21eedf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:44.502398 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841d99d-83f4-4e38-82b0-a58b21eedf7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:44.516536 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841d99d-83f4-4e38-82b0-a58b21eedf7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:44.518021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841d99d-83f4-4e38-82b0-a58b21eedf7a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-9841d99d-83f4-4e38-82b0-a58b21eedf7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:44.532896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:44.533838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:44.534764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:44.534764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:44.534764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:44.534764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:44.534764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 536/1046] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:44.537654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794df32-d7e6-4857-99df-f7f72f5923d6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:44.539667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841d99d-83f4-4e38-82b0-a58b21eedf7a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:44.577601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebee3b-4d08-4425-af89-449c484f73b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:44.578245 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebee3b-4d08-4425-af89-449c484f73b5 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:44.578560 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebee3b-4d08-4425-af89-449c484f73b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:44.578831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebee3b-4d08-4425-af89-449c484f73b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:44.579535 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebee3b-4d08-4425-af89-449c484f73b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:44.580891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebee3b-4d08-4425-af89-449c484f73b5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:44.611315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 511/1047] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:13:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:13:44.654126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841d99d-83f4-4e38-82b0-a58b21eedf7a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:44.671799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:44.702558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814755f-a80e-488c-a44e-2dd481e58219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:44.703189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814755f-a80e-488c-a44e-2dd481e58219 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:44.703483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814755f-a80e-488c-a44e-2dd481e58219 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:44.703748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814755f-a80e-488c-a44e-2dd481e58219 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:44.704532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814755f-a80e-488c-a44e-2dd481e58219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:44.704912 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814755f-a80e-488c-a44e-2dd481e58219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:44.706550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814755f-a80e-488c-a44e-2dd481e58219 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:44.725166 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 537/1048] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:44.726505 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebee3b-4d08-4425-af89-449c484f73b5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:44.750672 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:44.835976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebee3b-4d08-4425-af89-449c484f73b5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:44.870038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4ab91-efb4-450b-9800-add3aadc4cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:44.870739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4ab91-efb4-450b-9800-add3aadc4cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:44.871022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4ab91-efb4-450b-9800-add3aadc4cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:44.871299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4ab91-efb4-450b-9800-add3aadc4cc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:44.878075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4ab91-efb4-450b-9800-add3aadc4cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:44.879543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4ab91-efb4-450b-9800-add3aadc4cc5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-afe4ab91-efb4-450b-9800-add3aadc4cc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:44.890925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:44.891902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:44.892869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:44.892869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:44.892869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:44.892869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:44.892869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:44.892869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:44.892869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:44.892869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:44.892869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 512/1049] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:44.899202 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814755f-a80e-488c-a44e-2dd481e58219 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:44.948576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f992a-e79e-4335-bf26-4aff83ad07cd None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:44.948865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f992a-e79e-4335-bf26-4aff83ad07cd None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:44.949139 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f992a-e79e-4335-bf26-4aff83ad07cd None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:44.950820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 513/1050] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:13:44.955867 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f720f-0c48-4204-92f3-51de6378808c None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:44.956153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f720f-0c48-4204-92f3-51de6378808c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:44.956434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f720f-0c48-4204-92f3-51de6378808c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:44.975434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-797f720f-0c48-4204-92f3-51de6378808c None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:44.976607 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-797f720f-0c48-4204-92f3-51de6378808c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:45.005974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814755f-a80e-488c-a44e-2dd481e58219 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:45.041848 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97b3ba-049a-4f07-a055-3a550a2a9b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:45.042493 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97b3ba-049a-4f07-a055-3a550a2a9b8c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:45.042780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97b3ba-049a-4f07-a055-3a550a2a9b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:45.043058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97b3ba-049a-4f07-a055-3a550a2a9b8c None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:45.043806 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97b3ba-049a-4f07-a055-3a550a2a9b8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:45.044118 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97b3ba-049a-4f07-a055-3a550a2a9b8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:45.045547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97b3ba-049a-4f07-a055-3a550a2a9b8c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:45.052606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 514/1051] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 22:13:45.062874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 538/1052] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:45.064212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f720f-0c48-4204-92f3-51de6378808c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:45.076219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97b3ba-049a-4f07-a055-3a550a2a9b8c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:45.077477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:45.115952 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:45.174028 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f720f-0c48-4204-92f3-51de6378808c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:45.189347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97b3ba-049a-4f07-a055-3a550a2a9b8c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:45.213540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4cd18-4a4a-4731-938e-07918965593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:45.214293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4cd18-4a4a-4731-938e-07918965593e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:45.214743 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4cd18-4a4a-4731-938e-07918965593e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:45.215200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4cd18-4a4a-4731-938e-07918965593e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:45.216025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4cd18-4a4a-4731-938e-07918965593e None admin] RBAC: Adding query filter params (role.id=f934e462c48447a48fbec7721badecdf, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=04899781f67746e193a05bdc004804cc) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:45.216463 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4cd18-4a4a-4731-938e-07918965593e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:45.218004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4cd18-4a4a-4731-938e-07918965593e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:45.223847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 515/1053] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:45 2022] GET /identity/v3/role_assignments?user.id=04899781f67746e193a05bdc004804cc&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=f934e462c48447a48fbec7721badecdf => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:45.228900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a02124-bea3-4971-a01d-b512ba800fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:45.229569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a02124-bea3-4971-a01d-b512ba800fdf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:45.229851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a02124-bea3-4971-a01d-b512ba800fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:45.230126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a02124-bea3-4971-a01d-b512ba800fdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:45.243730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a02124-bea3-4971-a01d-b512ba800fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-67a02124-bea3-4971-a01d-b512ba800fdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:45.248845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:45.249867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:45.250958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:45.250958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:45.250958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:45.250958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:45.250958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:45.250958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:45.250958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:45.250958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:45.250958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:45.250958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:45.250958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:45.250958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:45.254862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 539/1054] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:13:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:45.256998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4cd18-4a4a-4731-938e-07918965593e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:45.343346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:45.372332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4cd18-4a4a-4731-938e-07918965593e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:45.406754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875241e0-06d6-4aa8-bb1f-7d76ccf50b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:45.407374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875241e0-06d6-4aa8-bb1f-7d76ccf50b24 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:45.407654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875241e0-06d6-4aa8-bb1f-7d76ccf50b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:45.407927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875241e0-06d6-4aa8-bb1f-7d76ccf50b24 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:45.408636 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875241e0-06d6-4aa8-bb1f-7d76ccf50b24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:45.408940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875241e0-06d6-4aa8-bb1f-7d76ccf50b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:45.410294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875241e0-06d6-4aa8-bb1f-7d76ccf50b24 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:45.419777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 516/1055] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:13:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:45.425448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a02124-bea3-4971-a01d-b512ba800fdf None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:45.523890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:45.535004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a02124-bea3-4971-a01d-b512ba800fdf None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:45.570247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e890de-f5fe-40a4-9ec3-f49e1e269bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:45.570922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e890de-f5fe-40a4-9ec3-f49e1e269bdb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:45.571206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e890de-f5fe-40a4-9ec3-f49e1e269bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:45.571482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e890de-f5fe-40a4-9ec3-f49e1e269bdb None admin] PATH_INFO: `/v3/users/ca1229b68a354a77a3293383c6f2581a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:45.585076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e890de-f5fe-40a4-9ec3-f49e1e269bdb None admin] RBAC: Authorizing `identity:get_user(user_id=ca1229b68a354a77a3293383c6f2581a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:45.586543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e890de-f5fe-40a4-9ec3-f49e1e269bdb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:45.588414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 540/1056] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:13:45 2022] GET /identity/v3/users/ca1229b68a354a77a3293383c6f2581a => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:45.593961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875241e0-06d6-4aa8-bb1f-7d76ccf50b24 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:45.695716 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875241e0-06d6-4aa8-bb1f-7d76ccf50b24 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:45.731000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce562e-f3a0-478e-a960-7ee9a8548079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:45.731704 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce562e-f3a0-478e-a960-7ee9a8548079 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:45.731985 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce562e-f3a0-478e-a960-7ee9a8548079 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:45.732260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce562e-f3a0-478e-a960-7ee9a8548079 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:45.736349 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:45.803343 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce562e-f3a0-478e-a960-7ee9a8548079 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:45.804786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce562e-f3a0-478e-a960-7ee9a8548079 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:45.906472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 517/1057] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 22:13:45.909608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e890de-f5fe-40a4-9ec3-f49e1e269bdb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:46.012129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e890de-f5fe-40a4-9ec3-f49e1e269bdb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:46.045032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f9dfa-9528-474e-9ca1-d4257a645c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:46.045673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f9dfa-9528-474e-9ca1-d4257a645c90 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:46.045954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f9dfa-9528-474e-9ca1-d4257a645c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:46.046225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f9dfa-9528-474e-9ca1-d4257a645c90 None admin] PATH_INFO: `/v3/projects/7a72ac70a0ab41a4a3f686316135d55d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:46.047409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f9dfa-9528-474e-9ca1-d4257a645c90 None admin] RBAC: Authorizing `identity:get_project(project_id=7a72ac70a0ab41a4a3f686316135d55d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:46.048840 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f9dfa-9528-474e-9ca1-d4257a645c90 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:46.055905 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 541/1058] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:13:45 2022] GET /identity/v3/projects/7a72ac70a0ab41a4a3f686316135d55d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:46.057413 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce562e-f3a0-478e-a960-7ee9a8548079 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:46.094029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:46.164923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce562e-f3a0-478e-a960-7ee9a8548079 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:46.203445 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb50a6-4ed6-458e-8d35-68938c0c4b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:46.204482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb50a6-4ed6-458e-8d35-68938c0c4b77 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:46.204990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb50a6-4ed6-458e-8d35-68938c0c4b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:46.205487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb50a6-4ed6-458e-8d35-68938c0c4b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:46.207009 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb50a6-4ed6-458e-8d35-68938c0c4b77 None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=7a72ac70a0ab41a4a3f686316135d55d, user.id=ca1229b68a354a77a3293383c6f2581a) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:46.207573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb50a6-4ed6-458e-8d35-68938c0c4b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:46.210270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb50a6-4ed6-458e-8d35-68938c0c4b77 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:46.226433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 518/1059] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:46 2022] GET /identity/v3/role_assignments?user.id=ca1229b68a354a77a3293383c6f2581a&scope.project.id=7a72ac70a0ab41a4a3f686316135d55d&role.id=0053c24ce06147938dbb61657a531c94 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:46.638172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacfef0-ba61-45a1-8b41-0e4d0f61857b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:46.638731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacfef0-ba61-45a1-8b41-0e4d0f61857b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:46.638731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacfef0-ba61-45a1-8b41-0e4d0f61857b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:46.640118 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 542/1060] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:46.645178 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eff5b6-5a13-4b63-85ce-90d891745ac8 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:46.646126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eff5b6-5a13-4b63-85ce-90d891745ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:46.646291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eff5b6-5a13-4b63-85ce-90d891745ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:46.665602 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-68eff5b6-5a13-4b63-85ce-90d891745ac8 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:46.666805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-68eff5b6-5a13-4b63-85ce-90d891745ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:46.735431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 519/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:46.756591 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacfef0-ba61-45a1-8b41-0e4d0f61857b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:46.775156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:46.860689 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacfef0-ba61-45a1-8b41-0e4d0f61857b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:46.894515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21241fc0-f074-4ef6-81cc-3b3ff58151bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:46.895127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21241fc0-f074-4ef6-81cc-3b3ff58151bf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:46.895978 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21241fc0-f074-4ef6-81cc-3b3ff58151bf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:46.896251 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21241fc0-f074-4ef6-81cc-3b3ff58151bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:46.964346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21241fc0-f074-4ef6-81cc-3b3ff58151bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:46.965794 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21241fc0-f074-4ef6-81cc-3b3ff58151bf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:46.982379 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:47.063484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 543/1062] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:13:47.069629 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eff5b6-5a13-4b63-85ce-90d891745ac8 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:47.100697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:47.172267 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eff5b6-5a13-4b63-85ce-90d891745ac8 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:47.206364 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175bff6-9688-4761-a671-4e10bf62afe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:47.207026 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175bff6-9688-4761-a671-4e10bf62afe5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:47.207304 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175bff6-9688-4761-a671-4e10bf62afe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:47.207576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175bff6-9688-4761-a671-4e10bf62afe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:47.218676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175bff6-9688-4761-a671-4e10bf62afe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:47.220126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175bff6-9688-4761-a671-4e10bf62afe5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:47.224409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e4c4-cbc4-4da8-a122-eaa57aa573c9 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:47.224698 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e4c4-cbc4-4da8-a122-eaa57aa573c9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:47.224971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e4c4-cbc4-4da8-a122-eaa57aa573c9 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:47.226483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 544/1063] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:13:47.231614 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31871495-aea7-4b6a-82c2-3619212cf3c6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:47.231895 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31871495-aea7-4b6a-82c2-3619212cf3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:47.232167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31871495-aea7-4b6a-82c2-3619212cf3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-c175bff6-9688-4761-a671-4e10bf62afe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:47.238450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:47.239958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:47.240874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:47.240874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:47.240874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:47.240874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:47.246104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 520/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:47.246960 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175bff6-9688-4761-a671-4e10bf62afe5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:47.251173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-31871495-aea7-4b6a-82c2-3619212cf3c6 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:47.252345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-31871495-aea7-4b6a-82c2-3619212cf3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:47.327807 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 545/1065] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 22:13:47.335946 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:47.349641 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31871495-aea7-4b6a-82c2-3619212cf3c6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:47.356501 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175bff6-9688-4761-a671-4e10bf62afe5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:47.393164 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e84c4-ef96-4c32-b92e-c9b2c68a04d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:47.393789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e84c4-ef96-4c32-b92e-c9b2c68a04d7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:47.394067 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e84c4-ef96-4c32-b92e-c9b2c68a04d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:47.394341 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e84c4-ef96-4c32-b92e-c9b2c68a04d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:47.395106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e84c4-ef96-4c32-b92e-c9b2c68a04d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:47.395450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e84c4-ef96-4c32-b92e-c9b2c68a04d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:47.397230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e84c4-ef96-4c32-b92e-c9b2c68a04d7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:47.403694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:47.410700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 521/1066] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:47.478032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31871495-aea7-4b6a-82c2-3619212cf3c6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:47.516606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb07641-b2ec-40c0-be71-7d197c935e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:47.517319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb07641-b2ec-40c0-be71-7d197c935e0b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:47.517597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb07641-b2ec-40c0-be71-7d197c935e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:47.517866 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb07641-b2ec-40c0-be71-7d197c935e0b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:47.530826 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb07641-b2ec-40c0-be71-7d197c935e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-ffb07641-b2ec-40c0-be71-7d197c935e0b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:47.535734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:47.536724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:47.537582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:47.537582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:47.537582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:47.537582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:47.537582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:47.537582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:47.537582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:47.537582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:47.537582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:47.537582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:47.537582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 22:13:47.537582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:47.542019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 546/1067] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Aug 4 22:13:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:47.543405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e84c4-ef96-4c32-b92e-c9b2c68a04d7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:47.654050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e84c4-ef96-4c32-b92e-c9b2c68a04d7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:47.694449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc84d4-ce0f-47e0-93fe-8e8aa8ebd2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:47.695496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc84d4-ce0f-47e0-93fe-8e8aa8ebd2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:47.695989 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc84d4-ce0f-47e0-93fe-8e8aa8ebd2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:47.696431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc84d4-ce0f-47e0-93fe-8e8aa8ebd2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:47.697498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc84d4-ce0f-47e0-93fe-8e8aa8ebd2e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:47.698046 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc84d4-ce0f-47e0-93fe-8e8aa8ebd2e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:47.699436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc84d4-ce0f-47e0-93fe-8e8aa8ebd2e8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:47.708666 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 522/1068] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Aug 4 22:13:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:47.714772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb07641-b2ec-40c0-be71-7d197c935e0b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:47.811424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb07641-b2ec-40c0-be71-7d197c935e0b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:47.818295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:47.844891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182aa5aa-9bad-415a-8c90-3774a4b2af0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:47.845522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182aa5aa-9bad-415a-8c90-3774a4b2af0b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:47.845798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182aa5aa-9bad-415a-8c90-3774a4b2af0b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:47.846066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182aa5aa-9bad-415a-8c90-3774a4b2af0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:47.856273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182aa5aa-9bad-415a-8c90-3774a4b2af0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:47.857725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182aa5aa-9bad-415a-8c90-3774a4b2af0b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-182aa5aa-9bad-415a-8c90-3774a4b2af0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:47.872256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:47.873165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:47.874095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:47.874095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:47.874095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:47.874095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:47.874095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 547/1069] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:47.879184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc84d4-ce0f-47e0-93fe-8e8aa8ebd2e8 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:47.882992 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:47.978518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc84d4-ce0f-47e0-93fe-8e8aa8ebd2e8 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:48.010720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ab64c-f6ec-42ec-aeb5-44dfa8212549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:48.011331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ab64c-f6ec-42ec-aeb5-44dfa8212549 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:48.011607 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ab64c-f6ec-42ec-aeb5-44dfa8212549 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:48.011876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ab64c-f6ec-42ec-aeb5-44dfa8212549 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:48.012558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ab64c-f6ec-42ec-aeb5-44dfa8212549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:48.012861 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ab64c-f6ec-42ec-aeb5-44dfa8212549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:48.014207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ab64c-f6ec-42ec-aeb5-44dfa8212549 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:48.026570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 523/1070] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:48.032877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182aa5aa-9bad-415a-8c90-3774a4b2af0b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:48.131566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182aa5aa-9bad-415a-8c90-3774a4b2af0b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:48.164798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79dd02-147a-42bf-813e-a2e6884dbc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:48.165432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79dd02-147a-42bf-813e-a2e6884dbc35 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:48.165719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79dd02-147a-42bf-813e-a2e6884dbc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:48.165997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79dd02-147a-42bf-813e-a2e6884dbc35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:48.173340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79dd02-147a-42bf-813e-a2e6884dbc35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:48.174817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79dd02-147a-42bf-813e-a2e6884dbc35 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-6c79dd02-147a-42bf-813e-a2e6884dbc35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:48.185795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:48.186967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:48.188078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:48.188078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:48.188078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:48.188078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:48.188078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:48.188078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:48.188078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:48.188078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:48.188078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:13:48.188078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:48.188078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 548/1071] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 4 22:13:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:48.192731 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ab64c-f6ec-42ec-aeb5-44dfa8212549 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:48.215104 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c69623-f684-40da-8458-4352d5b92195 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:48.215390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c69623-f684-40da-8458-4352d5b92195 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:48.215721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c69623-f684-40da-8458-4352d5b92195 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:48.217193 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 549/1072] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:48.221870 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeed785-6f91-45e5-892d-bd0bee50712f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:48.222150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeed785-6f91-45e5-892d-bd0bee50712f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:48.222493 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeed785-6f91-45e5-892d-bd0bee50712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:48.249946 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cdeed785-6f91-45e5-892d-bd0bee50712f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:48.251083 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cdeed785-6f91-45e5-892d-bd0bee50712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:48.259370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:48.264582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:48.299673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ab64c-f6ec-42ec-aeb5-44dfa8212549 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:48.319856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 550/1073] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:48.336472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224bb07-a63c-4d31-883f-a5297969a93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:48.337087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224bb07-a63c-4d31-883f-a5297969a93c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:48.337370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224bb07-a63c-4d31-883f-a5297969a93c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:48.337643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224bb07-a63c-4d31-883f-a5297969a93c None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:48.338451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224bb07-a63c-4d31-883f-a5297969a93c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:48.338761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224bb07-a63c-4d31-883f-a5297969a93c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:48.340167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224bb07-a63c-4d31-883f-a5297969a93c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:48.342371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeed785-6f91-45e5-892d-bd0bee50712f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:48.357951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 524/1074] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 4 22:13:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:48.363455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224bb07-a63c-4d31-883f-a5297969a93c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:48.442794 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeed785-6f91-45e5-892d-bd0bee50712f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:48.462958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224bb07-a63c-4d31-883f-a5297969a93c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:48.479244 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f47c4-36aa-4401-a47f-b30934908070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:48.479885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f47c4-36aa-4401-a47f-b30934908070 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:48.480167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f47c4-36aa-4401-a47f-b30934908070 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:48.480441 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f47c4-36aa-4401-a47f-b30934908070 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:48.485731 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:48.493464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f47c4-36aa-4401-a47f-b30934908070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-5b7f47c4-36aa-4401-a47f-b30934908070 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:48.496705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:48.497688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:48.507329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:48.507329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:48.507329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:48.507329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:48.507329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:48.507329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:48.507329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:48.507329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:48.507329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:48.507329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:48.507329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:48.507329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:48.507329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 551/1075] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:13:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:48.508212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d29b4-ca0c-4b59-9e39-24f6d7727b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:48.508212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d29b4-ca0c-4b59-9e39-24f6d7727b8a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:48.508212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d29b4-ca0c-4b59-9e39-24f6d7727b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:48.508212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d29b4-ca0c-4b59-9e39-24f6d7727b8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:48.508711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f47c4-36aa-4401-a47f-b30934908070 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:48.510242 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d29b4-ca0c-4b59-9e39-24f6d7727b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:48.511708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d29b4-ca0c-4b59-9e39-24f6d7727b8a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:48.516572 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-348d29b4-ca0c-4b59-9e39-24f6d7727b8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:48.527100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:48.528174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:48.529159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:48.529159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:48.529159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:48.529159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:48.529159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 525/1076] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:48.533891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d29b4-ca0c-4b59-9e39-24f6d7727b8a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:48.617250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f47c4-36aa-4401-a47f-b30934908070 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:48.650107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d29b4-ca0c-4b59-9e39-24f6d7727b8a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:48.652252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33ae16-fc68-4258-be96-5598f17f6d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:48.652872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33ae16-fc68-4258-be96-5598f17f6d4b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:48.653153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33ae16-fc68-4258-be96-5598f17f6d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:48.653430 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33ae16-fc68-4258-be96-5598f17f6d4b None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:48.654142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33ae16-fc68-4258-be96-5598f17f6d4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:48.654485 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33ae16-fc68-4258-be96-5598f17f6d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:48.655869 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33ae16-fc68-4258-be96-5598f17f6d4b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:48.663941 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 552/1077] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:13:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:48.669828 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33ae16-fc68-4258-be96-5598f17f6d4b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:48.682940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ff980-0964-46fa-8891-75f437946245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:48.683558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ff980-0964-46fa-8891-75f437946245 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:48.683841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ff980-0964-46fa-8891-75f437946245 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:48.684117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ff980-0964-46fa-8891-75f437946245 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:48.684807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ff980-0964-46fa-8891-75f437946245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:48.685118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ff980-0964-46fa-8891-75f437946245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:48.686492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ff980-0964-46fa-8891-75f437946245 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:48.703771 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 526/1078] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:48.704785 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ff980-0964-46fa-8891-75f437946245 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:48.738326 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:48.739521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:48.770949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33ae16-fc68-4258-be96-5598f17f6d4b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:48.804295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609ba27-1ce1-4dba-aeb2-a2e0d193bf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:48.804938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609ba27-1ce1-4dba-aeb2-a2e0d193bf3c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:48.805220 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609ba27-1ce1-4dba-aeb2-a2e0d193bf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:48.805497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609ba27-1ce1-4dba-aeb2-a2e0d193bf3c None admin] PATH_INFO: `/v3/users/ca1229b68a354a77a3293383c6f2581a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:48.805867 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ff980-0964-46fa-8891-75f437946245 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:48.806691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609ba27-1ce1-4dba-aeb2-a2e0d193bf3c None admin] RBAC: Authorizing `identity:get_user(user_id=ca1229b68a354a77a3293383c6f2581a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:48.808122 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609ba27-1ce1-4dba-aeb2-a2e0d193bf3c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:48.809728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 553/1079] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:13:48 2022] GET /identity/v3/users/ca1229b68a354a77a3293383c6f2581a => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:48.815407 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609ba27-1ce1-4dba-aeb2-a2e0d193bf3c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:48.841077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09401-9a2f-4d54-9745-6b609663e4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:48.841714 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09401-9a2f-4d54-9745-6b609663e4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:48.842001 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09401-9a2f-4d54-9745-6b609663e4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:48.842276 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09401-9a2f-4d54-9745-6b609663e4c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:48.849040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09401-9a2f-4d54-9745-6b609663e4c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:48.850518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09401-9a2f-4d54-9745-6b609663e4c8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-16d09401-9a2f-4d54-9745-6b609663e4c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:48.861697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:48.862707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:48.864645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:48.864645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:48.864645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:48.864645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:48.864645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:48.864645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:48.864645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:48.864645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:48.864645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 527/1080] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:48.869036 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09401-9a2f-4d54-9745-6b609663e4c8 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:48.914608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609ba27-1ce1-4dba-aeb2-a2e0d193bf3c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:48.947948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae7f25-889f-4bcf-a817-531daf6ec66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:48.948586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7f25-889f-4bcf-a817-531daf6ec66b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:48.948869 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7f25-889f-4bcf-a817-531daf6ec66b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:48.949148 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7f25-889f-4bcf-a817-531daf6ec66b None admin] PATH_INFO: `/v3/projects/7a72ac70a0ab41a4a3f686316135d55d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:48.950304 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae7f25-889f-4bcf-a817-531daf6ec66b None admin] RBAC: Authorizing `identity:get_project(project_id=7a72ac70a0ab41a4a3f686316135d55d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:48.951772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae7f25-889f-4bcf-a817-531daf6ec66b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:48.953689 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 554/1081] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:13:48 2022] GET /identity/v3/projects/7a72ac70a0ab41a4a3f686316135d55d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:48.959737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae7f25-889f-4bcf-a817-531daf6ec66b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:48.966707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:48.968358 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:48.974460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09401-9a2f-4d54-9745-6b609663e4c8 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:49.009298 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caab5c-a890-40b5-b43b-28b1afbbdb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:49.009914 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caab5c-a890-40b5-b43b-28b1afbbdb97 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:49.010192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caab5c-a890-40b5-b43b-28b1afbbdb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:49.010505 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caab5c-a890-40b5-b43b-28b1afbbdb97 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:49.011247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caab5c-a890-40b5-b43b-28b1afbbdb97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:49.011552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caab5c-a890-40b5-b43b-28b1afbbdb97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:49.012967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caab5c-a890-40b5-b43b-28b1afbbdb97 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:49.024842 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 528/1082] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:49.030788 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caab5c-a890-40b5-b43b-28b1afbbdb97 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:49.064527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae7f25-889f-4bcf-a817-531daf6ec66b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:49.098226 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5a738-2b0f-4211-b2ae-5db11fc26504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:49.099441 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5a738-2b0f-4211-b2ae-5db11fc26504 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:49.099721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5a738-2b0f-4211-b2ae-5db11fc26504 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:49.099993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5a738-2b0f-4211-b2ae-5db11fc26504 None admin] PATH_INFO: `/v3/projects/7a72ac70a0ab41a4a3f686316135d55d/users/ca1229b68a354a77a3293383c6f2581a/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:49.101906 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5a738-2b0f-4211-b2ae-5db11fc26504 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a72ac70a0ab41a4a3f686316135d55d, user_id=ca1229b68a354a77a3293383c6f2581a, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:49.103370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5a738-2b0f-4211-b2ae-5db11fc26504 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:49.118610 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 555/1083] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:13:48 2022] PUT /identity/v3/projects/7a72ac70a0ab41a4a3f686316135d55d/users/ca1229b68a354a77a3293383c6f2581a/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:13:49.133217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caab5c-a890-40b5-b43b-28b1afbbdb97 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:49.170056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3afdb8-cda2-4a63-bcfd-7d905437b101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:49.170846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3afdb8-cda2-4a63-bcfd-7d905437b101 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:49.171131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3afdb8-cda2-4a63-bcfd-7d905437b101 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:49.171412 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3afdb8-cda2-4a63-bcfd-7d905437b101 None admin] PATH_INFO: `/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/04899781f67746e193a05bdc004804cc/roles/f934e462c48447a48fbec7721badecdf` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:49.173757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3afdb8-cda2-4a63-bcfd-7d905437b101 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe696ab97a143959fa7e33cda768cfc, user_id=04899781f67746e193a05bdc004804cc, role_id=f934e462c48447a48fbec7721badecdf)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:49.175256 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3afdb8-cda2-4a63-bcfd-7d905437b101 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:49.191148 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 529/1084] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:13:49 2022] PUT /identity/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/04899781f67746e193a05bdc004804cc/roles/f934e462c48447a48fbec7721badecdf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:13:51.101264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33d322-dcfd-47b8-906d-bf8e9582721f None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:51.101797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33d322-dcfd-47b8-906d-bf8e9582721f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:51.101797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33d322-dcfd-47b8-906d-bf8e9582721f None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:51.103218 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 556/1085] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:51.108522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd02e1-04ea-4ca0-89e2-dcf41b555424 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:51.108999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd02e1-04ea-4ca0-89e2-dcf41b555424 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:51.109216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd02e1-04ea-4ca0-89e2-dcf41b555424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:51.126988 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-79fd02e1-04ea-4ca0-89e2-dcf41b555424 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:51.128169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-79fd02e1-04ea-4ca0-89e2-dcf41b555424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:51.137308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:51.188148 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0e8a0-2b97-4290-b913-1396d71dbacb None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:51.188437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0e8a0-2b97-4290-b913-1396d71dbacb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:51.188718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0e8a0-2b97-4290-b913-1396d71dbacb None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:51.190072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 557/1086] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:13:51.194892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48ddca-eea1-4595-995c-2fe3a5c872c8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:51.195180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48ddca-eea1-4595-995c-2fe3a5c872c8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:51.195369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 530/1087] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:51.195459 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48ddca-eea1-4595-995c-2fe3a5c872c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:51.213981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5b48ddca-eea1-4595-995c-2fe3a5c872c8 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:51.215185 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5b48ddca-eea1-4595-995c-2fe3a5c872c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:51.219321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd02e1-04ea-4ca0-89e2-dcf41b555424 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:51.274296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:51.283745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 558/1088] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 22:13:51.307271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48ddca-eea1-4595-995c-2fe3a5c872c8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:51.316797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd02e1-04ea-4ca0-89e2-dcf41b555424 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:51.351114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c1147-a278-4519-91c1-e0d0f3bbb132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:51.351805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1147-a278-4519-91c1-e0d0f3bbb132 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:51.352037 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1147-a278-4519-91c1-e0d0f3bbb132 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:51.352316 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c1147-a278-4519-91c1-e0d0f3bbb132 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:51.362197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c1147-a278-4519-91c1-e0d0f3bbb132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a50c1147-a278-4519-91c1-e0d0f3bbb132 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:51.367033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:51.367990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:51.368858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:51.368858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:51.368858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:51.368858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:51.368858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:51.368858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:51.368858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:51.368858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:51.368858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:51.368858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:51.368858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:13:51.368858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:51.368858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 531/1089] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:13:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:51.374033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c1147-a278-4519-91c1-e0d0f3bbb132 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:51.377930 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:51.405405 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48ddca-eea1-4595-995c-2fe3a5c872c8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:51.440280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab35f88-c206-465c-aa94-46a042d4c519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:51.440922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab35f88-c206-465c-aa94-46a042d4c519 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:51.441202 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab35f88-c206-465c-aa94-46a042d4c519 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:51.441477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab35f88-c206-465c-aa94-46a042d4c519 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:51.452420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab35f88-c206-465c-aa94-46a042d4c519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2ab35f88-c206-465c-aa94-46a042d4c519 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:13:51.457284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:51.458842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:51.459702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:51.459702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:51.459702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:51.459702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:51.459702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:13:51.459702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:13:51.459702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:13:51.459702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:13:51.459702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:13:51.459702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:13:51.459702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 04 22:13:51.459702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:51.459702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 559/1090] 10.222.0.27 () {56 vars in 1120 bytes} [Thu Aug 4 22:13:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:51.465120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab35f88-c206-465c-aa94-46a042d4c519 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:51.483127 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c1147-a278-4519-91c1-e0d0f3bbb132 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:51.517814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b8f3d-fc0c-48ed-8e54-f9eae937eb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:51.518443 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b8f3d-fc0c-48ed-8e54-f9eae937eb46 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:51.518728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b8f3d-fc0c-48ed-8e54-f9eae937eb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:51.519000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b8f3d-fc0c-48ed-8e54-f9eae937eb46 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:51.519706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b8f3d-fc0c-48ed-8e54-f9eae937eb46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:51.520007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b8f3d-fc0c-48ed-8e54-f9eae937eb46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:51.521961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b8f3d-fc0c-48ed-8e54-f9eae937eb46 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:51.524309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:51.530732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 532/1091] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:13:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:51.536401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b8f3d-fc0c-48ed-8e54-f9eae937eb46 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:51.570187 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab35f88-c206-465c-aa94-46a042d4c519 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:51.600334 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:51.603686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540ce05-e966-4f38-a61a-6ee0c9b7c1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:51.604237 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540ce05-e966-4f38-a61a-6ee0c9b7c1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:51.604517 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540ce05-e966-4f38-a61a-6ee0c9b7c1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:51.604795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540ce05-e966-4f38-a61a-6ee0c9b7c1f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:51.605497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540ce05-e966-4f38-a61a-6ee0c9b7c1f5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:51.605804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540ce05-e966-4f38-a61a-6ee0c9b7c1f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:51.607206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540ce05-e966-4f38-a61a-6ee0c9b7c1f5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:51.615138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 560/1092] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Aug 4 22:13:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:51.620822 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540ce05-e966-4f38-a61a-6ee0c9b7c1f5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:51.635495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b8f3d-fc0c-48ed-8e54-f9eae937eb46 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:51.669194 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02f328-d526-457b-8a0c-a3553a96b2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:51.669821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02f328-d526-457b-8a0c-a3553a96b2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:51.670095 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02f328-d526-457b-8a0c-a3553a96b2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:51.670364 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02f328-d526-457b-8a0c-a3553a96b2b7 None admin] PATH_INFO: `/v3/users/ca1229b68a354a77a3293383c6f2581a` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:51.671548 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02f328-d526-457b-8a0c-a3553a96b2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=ca1229b68a354a77a3293383c6f2581a)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:51.672958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02f328-d526-457b-8a0c-a3553a96b2b7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:51.674726 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 533/1093] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:13:51 2022] GET /identity/v3/users/ca1229b68a354a77a3293383c6f2581a => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:51.680151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02f328-d526-457b-8a0c-a3553a96b2b7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:51.719638 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540ce05-e966-4f38-a61a-6ee0c9b7c1f5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:51.735837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:51.753650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91e555-aeb7-4be7-ad4b-129cd7dd7e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:51.754284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91e555-aeb7-4be7-ad4b-129cd7dd7e62 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:51.754620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91e555-aeb7-4be7-ad4b-129cd7dd7e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:51.755437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91e555-aeb7-4be7-ad4b-129cd7dd7e62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:51.766095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91e555-aeb7-4be7-ad4b-129cd7dd7e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:51.767586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91e555-aeb7-4be7-ad4b-129cd7dd7e62 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:51.778342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02f328-d526-457b-8a0c-a3553a96b2b7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0e91e555-aeb7-4be7-ad4b-129cd7dd7e62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:51.781488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:51.782603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:51.783564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:51.783564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:51.783564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:51.783564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:51.783564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 561/1094] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:51.788779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91e555-aeb7-4be7-ad4b-129cd7dd7e62 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:51.812792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b6c5d-89b3-420f-9150-8b0428f9cd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:51.813416 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6c5d-89b3-420f-9150-8b0428f9cd2c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:51.813701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6c5d-89b3-420f-9150-8b0428f9cd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:51.813983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6c5d-89b3-420f-9150-8b0428f9cd2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:51.817944 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:51.884305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b6c5d-89b3-420f-9150-8b0428f9cd2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:51.885671 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b6c5d-89b3-420f-9150-8b0428f9cd2c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:51.890112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91e555-aeb7-4be7-ad4b-129cd7dd7e62 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:51.923375 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74231e95-febc-40b1-ade4-0e94f0f96cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:51.923987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74231e95-febc-40b1-ade4-0e94f0f96cca None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:51.924279 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74231e95-febc-40b1-ade4-0e94f0f96cca None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:51.924553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74231e95-febc-40b1-ade4-0e94f0f96cca None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:51.925236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74231e95-febc-40b1-ade4-0e94f0f96cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:51.925548 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74231e95-febc-40b1-ade4-0e94f0f96cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:51.927479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74231e95-febc-40b1-ade4-0e94f0f96cca None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:51.939240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 562/1095] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:51.945551 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74231e95-febc-40b1-ade4-0e94f0f96cca None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:51.975477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:51.983769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 534/1096] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 22:13:51.990506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b6c5d-89b3-420f-9150-8b0428f9cd2c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:52.022783 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:52.044688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74231e95-febc-40b1-ade4-0e94f0f96cca None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:52.079115 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0fac4-a536-492c-a75a-666cc077f083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:52.079746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0fac4-a536-492c-a75a-666cc077f083 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:52.080019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0fac4-a536-492c-a75a-666cc077f083 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:52.080296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0fac4-a536-492c-a75a-666cc077f083 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:52.087251 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0fac4-a536-492c-a75a-666cc077f083 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:52.088769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b6c5d-89b3-420f-9150-8b0428f9cd2c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:52.088956 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0fac4-a536-492c-a75a-666cc077f083 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-70e0fac4-a536-492c-a75a-666cc077f083 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:13:52.102429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:52.103975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:52.104928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:52.104928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:52.104928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:13:52.104928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:13:52.104928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:13:52.104928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:13:52.104928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:13:52.104928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:13:52.104928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 04 22:13:52.104928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:13:52.104928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 563/1097] 10.222.0.27 () {56 vars in 1093 bytes} [Thu Aug 4 22:13:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:52.115199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0fac4-a536-492c-a75a-666cc077f083 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:52.126553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192f5dc-1e33-4c47-8e98-d1ab0b5a7ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:52.127211 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192f5dc-1e33-4c47-8e98-d1ab0b5a7ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:52.127496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192f5dc-1e33-4c47-8e98-d1ab0b5a7ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:52.127772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192f5dc-1e33-4c47-8e98-d1ab0b5a7ca7 None admin] PATH_INFO: `/v3/projects/7a72ac70a0ab41a4a3f686316135d55d` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:52.128952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192f5dc-1e33-4c47-8e98-d1ab0b5a7ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=7a72ac70a0ab41a4a3f686316135d55d)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:52.130426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192f5dc-1e33-4c47-8e98-d1ab0b5a7ca7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:52.132132 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 535/1098] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:13:51 2022] GET /identity/v3/projects/7a72ac70a0ab41a4a3f686316135d55d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:52.138083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192f5dc-1e33-4c47-8e98-d1ab0b5a7ca7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:52.206245 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:52.217361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0fac4-a536-492c-a75a-666cc077f083 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:52.235259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192f5dc-1e33-4c47-8e98-d1ab0b5a7ca7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:52.236776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:52.251259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd87da-d052-4f05-9a22-d3ce461a9455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:52.251875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd87da-d052-4f05-9a22-d3ce461a9455 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:52.252157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd87da-d052-4f05-9a22-d3ce461a9455 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:52.252440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd87da-d052-4f05-9a22-d3ce461a9455 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:52.253230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd87da-d052-4f05-9a22-d3ce461a9455 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:52.253538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd87da-d052-4f05-9a22-d3ce461a9455 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:52.255004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd87da-d052-4f05-9a22-d3ce461a9455 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:52.269741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f5fda-8c49-4673-8bea-bf3eae526de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:52.270581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f5fda-8c49-4673-8bea-bf3eae526de4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:52.270714 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f5fda-8c49-4673-8bea-bf3eae526de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:52.270968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f5fda-8c49-4673-8bea-bf3eae526de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:52.271755 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f5fda-8c49-4673-8bea-bf3eae526de4 None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=7a72ac70a0ab41a4a3f686316135d55d, user.id=ca1229b68a354a77a3293383c6f2581a) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:52.272070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f5fda-8c49-4673-8bea-bf3eae526de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:52.273504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f5fda-8c49-4673-8bea-bf3eae526de4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:52.273684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 564/1099] 10.222.0.27 () {56 vars in 1133 bytes} [Thu Aug 4 22:13:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:13:52.280261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 536/1100] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:52 2022] GET /identity/v3/role_assignments?user.id=ca1229b68a354a77a3293383c6f2581a&scope.project.id=7a72ac70a0ab41a4a3f686316135d55d&role.id=0053c24ce06147938dbb61657a531c94 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:52.280466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd87da-d052-4f05-9a22-d3ce461a9455 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:52.393609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd87da-d052-4f05-9a22-d3ce461a9455 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:52.429375 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752ff99-c1fe-4918-a29c-a2e7684ec92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:52.430101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ff99-c1fe-4918-a29c-a2e7684ec92e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:52.430458 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ff99-c1fe-4918-a29c-a2e7684ec92e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:52.430740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ff99-c1fe-4918-a29c-a2e7684ec92e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:52.448654 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:52.500766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752ff99-c1fe-4918-a29c-a2e7684ec92e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:52.502240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752ff99-c1fe-4918-a29c-a2e7684ec92e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:52.597529 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 565/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 04 22:13:52.604131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f5fda-8c49-4673-8bea-bf3eae526de4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:52.700784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f5fda-8c49-4673-8bea-bf3eae526de4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:52.735024 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ea055-fcec-4efc-8320-cb1b7e44db92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:52.735664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ea055-fcec-4efc-8320-cb1b7e44db92 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:52.735949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ea055-fcec-4efc-8320-cb1b7e44db92 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:52.736226 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ea055-fcec-4efc-8320-cb1b7e44db92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:52.747407 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ea055-fcec-4efc-8320-cb1b7e44db92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:52.748761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ea055-fcec-4efc-8320-cb1b7e44db92 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-6b0ea055-fcec-4efc-8320-cb1b7e44db92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:13:52.762643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:52.763701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:52.765089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:13:52.765089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:13:52.765089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:13:52.765089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:52.765089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 537/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:13:52.769394 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752ff99-c1fe-4918-a29c-a2e7684ec92e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:52.817615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:52.868479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752ff99-c1fe-4918-a29c-a2e7684ec92e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:52.902142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bddf31-5ddf-45fb-b03c-00cd6cf11824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:52.902789 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bddf31-5ddf-45fb-b03c-00cd6cf11824 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:52.903073 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bddf31-5ddf-45fb-b03c-00cd6cf11824 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:52.903346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bddf31-5ddf-45fb-b03c-00cd6cf11824 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:52.904033 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bddf31-5ddf-45fb-b03c-00cd6cf11824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:52.904340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bddf31-5ddf-45fb-b03c-00cd6cf11824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:52.905704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bddf31-5ddf-45fb-b03c-00cd6cf11824 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:52.916857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 566/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:52.922430 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ea055-fcec-4efc-8320-cb1b7e44db92 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:52.941724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:53.023471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ea055-fcec-4efc-8320-cb1b7e44db92 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:53.055779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2c530-282f-4b43-abe9-00b7a0031aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:53.056419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c530-282f-4b43-abe9-00b7a0031aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:53.056703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c530-282f-4b43-abe9-00b7a0031aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:53.056981 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c530-282f-4b43-abe9-00b7a0031aa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:53.063647 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2c530-282f-4b43-abe9-00b7a0031aa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:53.065088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2c530-282f-4b43-abe9-00b7a0031aa8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-aad2c530-282f-4b43-abe9-00b7a0031aa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:13:53.076730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:13:53.078049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:13:53.084661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:13:53.084661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:13:53.084661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:13:53.084661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:13:53.084661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:13:53.084661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:13:53.084661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:13:53.084661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:13:53.084661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 538/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:13:53.085296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bddf31-5ddf-45fb-b03c-00cd6cf11824 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:53.179382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bddf31-5ddf-45fb-b03c-00cd6cf11824 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:53.187809 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:53.213170 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f44b4d-01f1-4fef-a177-4fd0015a6f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:53.213769 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44b4d-01f1-4fef-a177-4fd0015a6f28 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:53.214047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44b4d-01f1-4fef-a177-4fd0015a6f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:53.214324 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44b4d-01f1-4fef-a177-4fd0015a6f28 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:53.215080 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f44b4d-01f1-4fef-a177-4fd0015a6f28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:53.215383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f44b4d-01f1-4fef-a177-4fd0015a6f28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:53.216799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f44b4d-01f1-4fef-a177-4fd0015a6f28 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:53.229227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 567/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:53.235147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2c530-282f-4b43-abe9-00b7a0031aa8 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:53.311347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:53.333907 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2c530-282f-4b43-abe9-00b7a0031aa8 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:53.366646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7a894-77c0-412c-b9f0-6528436a7947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:53.367266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a894-77c0-412c-b9f0-6528436a7947 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:53.367549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a894-77c0-412c-b9f0-6528436a7947 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:53.367826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a894-77c0-412c-b9f0-6528436a7947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:53.368615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7a894-77c0-412c-b9f0-6528436a7947 None admin] RBAC: Adding query filter params (role.id=f934e462c48447a48fbec7721badecdf, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=04899781f67746e193a05bdc004804cc) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:53.368925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7a894-77c0-412c-b9f0-6528436a7947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:53.370342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7a894-77c0-412c-b9f0-6528436a7947 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:53.376231 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 539/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:53 2022] GET /identity/v3/role_assignments?user.id=04899781f67746e193a05bdc004804cc&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=f934e462c48447a48fbec7721badecdf => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:54.325966 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ce1eb-4c52-420a-8bf4-61e7a074023b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:54.326552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ce1eb-4c52-420a-8bf4-61e7a074023b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:54.326696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ce1eb-4c52-420a-8bf4-61e7a074023b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:54.328331 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 568/1107] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:54.334361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2aa0b-c328-4262-9a69-b82c79797329 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:54.334808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2aa0b-c328-4262-9a69-b82c79797329 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:54.334946 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2aa0b-c328-4262-9a69-b82c79797329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:54.353213 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-bbd2aa0b-c328-4262-9a69-b82c79797329 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:54.354393 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-bbd2aa0b-c328-4262-9a69-b82c79797329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:54.422044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 540/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:54.446577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ce1eb-4c52-420a-8bf4-61e7a074023b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:54.545191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ce1eb-4c52-420a-8bf4-61e7a074023b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:54.577730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6458-4cd2-4392-8f00-6d114afeb72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:54.578294 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6458-4cd2-4392-8f00-6d114afeb72f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:54.578601 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6458-4cd2-4392-8f00-6d114afeb72f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:54.578871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6458-4cd2-4392-8f00-6d114afeb72f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:54.580010 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be6458-4cd2-4392-8f00-6d114afeb72f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:54.581469 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be6458-4cd2-4392-8f00-6d114afeb72f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:54.583682 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 569/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:13:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:54.589415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2aa0b-c328-4262-9a69-b82c79797329 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:54.657219 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:54.685151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2aa0b-c328-4262-9a69-b82c79797329 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:54.718375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7636d4-973f-486b-b4ad-6ce9c3a54aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:54.719012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7636d4-973f-486b-b4ad-6ce9c3a54aa2 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:54.719293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7636d4-973f-486b-b4ad-6ce9c3a54aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:54.719569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7636d4-973f-486b-b4ad-6ce9c3a54aa2 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:54.720244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7636d4-973f-486b-b4ad-6ce9c3a54aa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:54.721658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7636d4-973f-486b-b4ad-6ce9c3a54aa2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:54.742978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 541/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:13:54 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:13:56.741979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afd5a2-5944-4b25-920b-16aa3d21cc91 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:56.742536 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afd5a2-5944-4b25-920b-16aa3d21cc91 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:56.742536 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afd5a2-5944-4b25-920b-16aa3d21cc91 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:56.743862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 570/1111] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:56.749055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d213be-349c-4b29-9f0c-52bab4002ebb None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:56.749444 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d213be-349c-4b29-9f0c-52bab4002ebb None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:56.749614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d213be-349c-4b29-9f0c-52bab4002ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:56.768238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b5d213be-349c-4b29-9f0c-52bab4002ebb None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:56.769422 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b5d213be-349c-4b29-9f0c-52bab4002ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:56.833619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 542/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:56.856787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afd5a2-5944-4b25-920b-16aa3d21cc91 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:56.892162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:56.955668 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afd5a2-5944-4b25-920b-16aa3d21cc91 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:56.989482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97f72b-8f21-4071-92e7-f08a05d97a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:56.990120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97f72b-8f21-4071-92e7-f08a05d97a7f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:56.990420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97f72b-8f21-4071-92e7-f08a05d97a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:56.990706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97f72b-8f21-4071-92e7-f08a05d97a7f None admin] PATH_INFO: `/v3/roles/b371b8f12e7348e8b01784eeddeca2ac` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:56.992199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97f72b-8f21-4071-92e7-f08a05d97a7f None admin] RBAC: Authorizing `identity:get_role(role_id=b371b8f12e7348e8b01784eeddeca2ac)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:56.993521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97f72b-8f21-4071-92e7-f08a05d97a7f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:56.994891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 571/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:13:56 2022] GET /identity/v3/roles/b371b8f12e7348e8b01784eeddeca2ac => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:57.000622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d213be-349c-4b29-9f0c-52bab4002ebb None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:57.056399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:57.099508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d213be-349c-4b29-9f0c-52bab4002ebb None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:57.132694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44c625-2e11-4f2d-a6d6-e2c625a6d04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:57.133324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44c625-2e11-4f2d-a6d6-e2c625a6d04c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:57.133603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44c625-2e11-4f2d-a6d6-e2c625a6d04c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:57.133875 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44c625-2e11-4f2d-a6d6-e2c625a6d04c None admin] PATH_INFO: `/v3/users/a7824a7c9f3e457a88a6175df86f88ea` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:57.146888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44c625-2e11-4f2d-a6d6-e2c625a6d04c None admin] RBAC: Authorizing `identity:get_user(user_id=a7824a7c9f3e457a88a6175df86f88ea)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:57.148349 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44c625-2e11-4f2d-a6d6-e2c625a6d04c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:57.149967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 543/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:13:56 2022] GET /identity/v3/users/a7824a7c9f3e457a88a6175df86f88ea => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:57.155660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97f72b-8f21-4071-92e7-f08a05d97a7f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:57.251660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97f72b-8f21-4071-92e7-f08a05d97a7f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:57.253862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:57.284721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4e329-609d-40be-ab64-2b12670ebba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:57.285325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4e329-609d-40be-ab64-2b12670ebba0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:57.285603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4e329-609d-40be-ab64-2b12670ebba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:57.286595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4e329-609d-40be-ab64-2b12670ebba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:57.350860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4e329-609d-40be-ab64-2b12670ebba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:57.352302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4e329-609d-40be-ab64-2b12670ebba0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:57.445275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 572/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:13:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:13:57.451358 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44c625-2e11-4f2d-a6d6-e2c625a6d04c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:57.550431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44c625-2e11-4f2d-a6d6-e2c625a6d04c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:57.566300 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:57.584664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df611ba4-861c-4bf9-b4bd-8e353eb6a582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:57.585291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df611ba4-861c-4bf9-b4bd-8e353eb6a582 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:57.585569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df611ba4-861c-4bf9-b4bd-8e353eb6a582 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:57.585839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df611ba4-861c-4bf9-b4bd-8e353eb6a582 None admin] PATH_INFO: `/v3/projects/7a72ac70a0ab41a4a3f686316135d55d` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:57.587002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df611ba4-861c-4bf9-b4bd-8e353eb6a582 None admin] RBAC: Authorizing `identity:get_project(project_id=7a72ac70a0ab41a4a3f686316135d55d)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:57.588406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df611ba4-861c-4bf9-b4bd-8e353eb6a582 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:57.590059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 544/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:13:57 2022] GET /identity/v3/projects/7a72ac70a0ab41a4a3f686316135d55d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:57.596363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4e329-609d-40be-ab64-2b12670ebba0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:57.599449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:57.691257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4e329-609d-40be-ab64-2b12670ebba0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:57.724406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdcbfc-75ab-47b4-9297-27522fe3a500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:57.725005 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdcbfc-75ab-47b4-9297-27522fe3a500 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:57.725284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdcbfc-75ab-47b4-9297-27522fe3a500 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:57.725556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdcbfc-75ab-47b4-9297-27522fe3a500 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:57.726330 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdcbfc-75ab-47b4-9297-27522fe3a500 None admin] RBAC: Adding query filter params (role.id=b371b8f12e7348e8b01784eeddeca2ac, scope.project.id=7a72ac70a0ab41a4a3f686316135d55d, user.id=a7824a7c9f3e457a88a6175df86f88ea) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:13:57.726669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdcbfc-75ab-47b4-9297-27522fe3a500 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:57.728102 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdcbfc-75ab-47b4-9297-27522fe3a500 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:57.733337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 573/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:13:57 2022] GET /identity/v3/role_assignments?user.id=a7824a7c9f3e457a88a6175df86f88ea&scope.project.id=7a72ac70a0ab41a4a3f686316135d55d&role.id=b371b8f12e7348e8b01784eeddeca2ac => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:59.667091 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fec804-9e57-4803-b395-9ed14b8e7175 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:59.667638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fec804-9e57-4803-b395-9ed14b8e7175 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:59.667638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fec804-9e57-4803-b395-9ed14b8e7175 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:59.669011 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 545/1118] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:13:59.674802 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e7f62-102f-4bac-98f3-7952484add33 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:59.675206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e7f62-102f-4bac-98f3-7952484add33 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:59.675350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e7f62-102f-4bac-98f3-7952484add33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:59.694094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4e1e7f62-102f-4bac-98f3-7952484add33 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:13:59.695295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4e1e7f62-102f-4bac-98f3-7952484add33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:13:59.753622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:13:59.759209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 574/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:13:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:13:59.780971 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fec804-9e57-4803-b395-9ed14b8e7175 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:13:59.877896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fec804-9e57-4803-b395-9ed14b8e7175 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:13:59.910627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b1e90-eb4d-4f32-abe1-47676cfdb700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:13:59.911269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b1e90-eb4d-4f32-abe1-47676cfdb700 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:13:59.911550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b1e90-eb4d-4f32-abe1-47676cfdb700 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:13:59.911822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b1e90-eb4d-4f32-abe1-47676cfdb700 None admin] PATH_INFO: `/v3/roles/b371b8f12e7348e8b01784eeddeca2ac` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:13:59.913240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b1e90-eb4d-4f32-abe1-47676cfdb700 None admin] RBAC: Authorizing `identity:get_role(role_id=b371b8f12e7348e8b01784eeddeca2ac)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:13:59.914616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b1e90-eb4d-4f32-abe1-47676cfdb700 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:13:59.915930 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 546/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:13:59 2022] GET /identity/v3/roles/b371b8f12e7348e8b01784eeddeca2ac => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:13:59.921587 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e7f62-102f-4bac-98f3-7952484add33 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:00.016562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e7f62-102f-4bac-98f3-7952484add33 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:00.048709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b358d9e-7ee3-4243-9acd-9af8fabbb82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:00.049335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358d9e-7ee3-4243-9acd-9af8fabbb82a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:00.049614 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358d9e-7ee3-4243-9acd-9af8fabbb82a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:00.049887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358d9e-7ee3-4243-9acd-9af8fabbb82a None admin] PATH_INFO: `/v3/users/a7824a7c9f3e457a88a6175df86f88ea` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:00.051035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b358d9e-7ee3-4243-9acd-9af8fabbb82a None admin] RBAC: Authorizing `identity:get_user(user_id=a7824a7c9f3e457a88a6175df86f88ea)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:00.053003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b358d9e-7ee3-4243-9acd-9af8fabbb82a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:00.054588 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 575/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:13:59 2022] GET /identity/v3/users/a7824a7c9f3e457a88a6175df86f88ea => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:00.060302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b1e90-eb4d-4f32-abe1-47676cfdb700 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:00.111573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:00.156861 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b1e90-eb4d-4f32-abe1-47676cfdb700 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:00.189402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027e397-4d05-48cb-a0d8-0a6a9cfb105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:00.190026 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027e397-4d05-48cb-a0d8-0a6a9cfb105b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:00.190310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027e397-4d05-48cb-a0d8-0a6a9cfb105b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:00.190620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027e397-4d05-48cb-a0d8-0a6a9cfb105b None admin] PATH_INFO: `/v3/projects/7a72ac70a0ab41a4a3f686316135d55d` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:00.191765 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027e397-4d05-48cb-a0d8-0a6a9cfb105b None admin] RBAC: Authorizing `identity:get_project(project_id=7a72ac70a0ab41a4a3f686316135d55d)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:00.193739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027e397-4d05-48cb-a0d8-0a6a9cfb105b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:00.195413 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 547/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:14:00 2022] GET /identity/v3/projects/7a72ac70a0ab41a4a3f686316135d55d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:00.201246 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b358d9e-7ee3-4243-9acd-9af8fabbb82a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:00.264146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:00.297058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b358d9e-7ee3-4243-9acd-9af8fabbb82a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:00.330214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00e068-03f9-4363-97e5-7b31b0172763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:00.330895 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00e068-03f9-4363-97e5-7b31b0172763 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:00.331182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00e068-03f9-4363-97e5-7b31b0172763 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:00.331459 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00e068-03f9-4363-97e5-7b31b0172763 None admin] PATH_INFO: `/v3/projects/7a72ac70a0ab41a4a3f686316135d55d/users/a7824a7c9f3e457a88a6175df86f88ea/roles/b371b8f12e7348e8b01784eeddeca2ac` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:00.333637 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00e068-03f9-4363-97e5-7b31b0172763 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a72ac70a0ab41a4a3f686316135d55d, user_id=a7824a7c9f3e457a88a6175df86f88ea, role_id=b371b8f12e7348e8b01784eeddeca2ac)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:00.335120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00e068-03f9-4363-97e5-7b31b0172763 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:00.347513 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 576/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:14:00 2022] PUT /identity/v3/projects/7a72ac70a0ab41a4a3f686316135d55d/users/a7824a7c9f3e457a88a6175df86f88ea/roles/b371b8f12e7348e8b01784eeddeca2ac => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:14:02.321308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbc47a-8cb1-44aa-87a9-e24879407325 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:02.321947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbc47a-8cb1-44aa-87a9-e24879407325 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:02.321947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbc47a-8cb1-44aa-87a9-e24879407325 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:02.323256 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 548/1124] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:14:02.328524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf10cb6-bbe4-4925-a904-a20bc5d649c3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:02.328975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf10cb6-bbe4-4925-a904-a20bc5d649c3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:02.329085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf10cb6-bbe4-4925-a904-a20bc5d649c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:02.347099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-dcf10cb6-bbe4-4925-a904-a20bc5d649c3 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:14:02.348278 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dcf10cb6-bbe4-4925-a904-a20bc5d649c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:14:02.423197 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 577/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:14:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:14:02.447684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbc47a-8cb1-44aa-87a9-e24879407325 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:02.545222 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbc47a-8cb1-44aa-87a9-e24879407325 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:02.564830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:02.579366 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ed95a-d9ff-419a-8d40-47df1602389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:02.579940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ed95a-d9ff-419a-8d40-47df1602389b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:02.580226 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ed95a-d9ff-419a-8d40-47df1602389b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:02.580504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ed95a-d9ff-419a-8d40-47df1602389b None admin] PATH_INFO: `/v3/roles/b371b8f12e7348e8b01784eeddeca2ac` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:02.581941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ed95a-d9ff-419a-8d40-47df1602389b None admin] RBAC: Authorizing `identity:get_role(role_id=b371b8f12e7348e8b01784eeddeca2ac)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:02.583374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ed95a-d9ff-419a-8d40-47df1602389b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:02.584714 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 549/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:14:02 2022] GET /identity/v3/roles/b371b8f12e7348e8b01784eeddeca2ac => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:02.590712 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf10cb6-bbe4-4925-a904-a20bc5d649c3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:02.645814 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:02.689862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf10cb6-bbe4-4925-a904-a20bc5d649c3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:02.723457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa276f-2545-4b27-a4ca-c22c196e3800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:02.724085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa276f-2545-4b27-a4ca-c22c196e3800 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:02.724368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa276f-2545-4b27-a4ca-c22c196e3800 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:02.724646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa276f-2545-4b27-a4ca-c22c196e3800 None admin] PATH_INFO: `/v3/users/a7824a7c9f3e457a88a6175df86f88ea` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:02.725801 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa276f-2545-4b27-a4ca-c22c196e3800 None admin] RBAC: Authorizing `identity:get_user(user_id=a7824a7c9f3e457a88a6175df86f88ea)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:02.727287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa276f-2545-4b27-a4ca-c22c196e3800 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:02.728875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 578/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:14:02 2022] GET /identity/v3/users/a7824a7c9f3e457a88a6175df86f88ea => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:02.734645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ed95a-d9ff-419a-8d40-47df1602389b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:02.831969 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ed95a-d9ff-419a-8d40-47df1602389b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:02.865087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da61032-b545-4940-b205-4c494262ed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:02.865677 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da61032-b545-4940-b205-4c494262ed58 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:02.865951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da61032-b545-4940-b205-4c494262ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:02.866217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da61032-b545-4940-b205-4c494262ed58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:02.917559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:02.929818 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da61032-b545-4940-b205-4c494262ed58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:02.931271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da61032-b545-4940-b205-4c494262ed58 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:03.024465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 550/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:14:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:14:03.030424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa276f-2545-4b27-a4ca-c22c196e3800 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:03.126743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa276f-2545-4b27-a4ca-c22c196e3800 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:03.149575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:03.160977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7326f0b-3ef5-4171-ac28-ed5b1e6e7991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:03.161608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7326f0b-3ef5-4171-ac28-ed5b1e6e7991 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:03.161893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7326f0b-3ef5-4171-ac28-ed5b1e6e7991 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:03.162177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7326f0b-3ef5-4171-ac28-ed5b1e6e7991 None admin] PATH_INFO: `/v3/projects/7a72ac70a0ab41a4a3f686316135d55d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:03.163369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7326f0b-3ef5-4171-ac28-ed5b1e6e7991 None admin] RBAC: Authorizing `identity:get_project(project_id=7a72ac70a0ab41a4a3f686316135d55d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:03.164806 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7326f0b-3ef5-4171-ac28-ed5b1e6e7991 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:03.166490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 579/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:14:03 2022] GET /identity/v3/projects/7a72ac70a0ab41a4a3f686316135d55d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:14:03.172597 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da61032-b545-4940-b205-4c494262ed58 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:03.261530 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:03.273300 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da61032-b545-4940-b205-4c494262ed58 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:03.305551 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c64ed3-a38b-4feb-8b55-98beda36651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:03.306154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64ed3-a38b-4feb-8b55-98beda36651a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:03.306455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64ed3-a38b-4feb-8b55-98beda36651a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:03.306730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c64ed3-a38b-4feb-8b55-98beda36651a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:03.307503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c64ed3-a38b-4feb-8b55-98beda36651a None admin] RBAC: Adding query filter params (role.id=b371b8f12e7348e8b01784eeddeca2ac, scope.project.id=7a72ac70a0ab41a4a3f686316135d55d, user.id=a7824a7c9f3e457a88a6175df86f88ea) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:14:03.307808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c64ed3-a38b-4feb-8b55-98beda36651a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:03.309209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c64ed3-a38b-4feb-8b55-98beda36651a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:03.314776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 551/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:14:03 2022] GET /identity/v3/role_assignments?user.id=a7824a7c9f3e457a88a6175df86f88ea&scope.project.id=7a72ac70a0ab41a4a3f686316135d55d&role.id=b371b8f12e7348e8b01784eeddeca2ac => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:05.318925 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de6f4-ba9c-4cf6-8c86-ee47b52c6dac None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:05.319451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de6f4-ba9c-4cf6-8c86-ee47b52c6dac None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:05.319451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de6f4-ba9c-4cf6-8c86-ee47b52c6dac None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:05.320827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 580/1131] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:14:05.325972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909ca41-4d99-4c03-81dc-d3dbd04b7b5d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:05.326427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909ca41-4d99-4c03-81dc-d3dbd04b7b5d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:05.326537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909ca41-4d99-4c03-81dc-d3dbd04b7b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:05.344673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6909ca41-4d99-4c03-81dc-d3dbd04b7b5d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:14:05.345832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6909ca41-4d99-4c03-81dc-d3dbd04b7b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:14:05.409133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 552/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:14:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:14:05.432236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de6f4-ba9c-4cf6-8c86-ee47b52c6dac None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:05.535327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de6f4-ba9c-4cf6-8c86-ee47b52c6dac None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:05.568550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b092a-33c0-4187-83b5-d9b9fb0c9d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:05.569236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b092a-33c0-4187-83b5-d9b9fb0c9d68 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:05.569466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b092a-33c0-4187-83b5-d9b9fb0c9d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:05.569739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b092a-33c0-4187-83b5-d9b9fb0c9d68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:05.570909 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b092a-33c0-4187-83b5-d9b9fb0c9d68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:05.572340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b092a-33c0-4187-83b5-d9b9fb0c9d68 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:05.573927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 581/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:14:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:05.580015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909ca41-4d99-4c03-81dc-d3dbd04b7b5d None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:05.656776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:05.675000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909ca41-4d99-4c03-81dc-d3dbd04b7b5d None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:05.707561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dd4b0-471e-4fa6-9f15-33f5360cc527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:05.708166 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dd4b0-471e-4fa6-9f15-33f5360cc527 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:05.708445 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dd4b0-471e-4fa6-9f15-33f5360cc527 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:05.708716 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dd4b0-471e-4fa6-9f15-33f5360cc527 None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:05.709397 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895dd4b0-471e-4fa6-9f15-33f5360cc527 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:05.710834 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895dd4b0-471e-4fa6-9f15-33f5360cc527 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:05.736800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 553/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 4 22:14:05 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:14:07.772205 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d88d9b-6c93-49a2-95e7-e860e122b06d None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:07.772705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d88d9b-6c93-49a2-95e7-e860e122b06d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:07.772705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d88d9b-6c93-49a2-95e7-e860e122b06d None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:07.774016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 582/1135] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:14:07.779313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bc7f4-2be6-4d45-b686-1dfaad6b666c None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:07.779744 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bc7f4-2be6-4d45-b686-1dfaad6b666c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:07.779874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bc7f4-2be6-4d45-b686-1dfaad6b666c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:07.798103 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-695bc7f4-2be6-4d45-b686-1dfaad6b666c None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:14:07.799316 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-695bc7f4-2be6-4d45-b686-1dfaad6b666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:14:07.863834 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 554/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:14:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:14:07.888110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d88d9b-6c93-49a2-95e7-e860e122b06d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:07.948330 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:07.989354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d88d9b-6c93-49a2-95e7-e860e122b06d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:08.022770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fabd5-30ea-40a9-9039-6069c0188568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:08.023341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fabd5-30ea-40a9-9039-6069c0188568 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:08.023622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fabd5-30ea-40a9-9039-6069c0188568 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:08.023893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fabd5-30ea-40a9-9039-6069c0188568 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:08.025034 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fabd5-30ea-40a9-9039-6069c0188568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:08.026476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fabd5-30ea-40a9-9039-6069c0188568 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:08.028050 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 583/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:14:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:08.033891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bc7f4-2be6-4d45-b686-1dfaad6b666c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:08.094912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:08.131260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bc7f4-2be6-4d45-b686-1dfaad6b666c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:08.163262 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e412c-6c60-457d-ae70-392efcc6bb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:08.163860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e412c-6c60-457d-ae70-392efcc6bb59 None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:08.164137 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e412c-6c60-457d-ae70-392efcc6bb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:08.164409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e412c-6c60-457d-ae70-392efcc6bb59 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:08.165087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e412c-6c60-457d-ae70-392efcc6bb59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:08.166517 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e412c-6c60-457d-ae70-392efcc6bb59 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:08.186541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 555/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:14:08 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:14:10.194727 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687cdfd-ea83-4a3b-9a75-502ba6f4d9d8 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:10.195276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687cdfd-ea83-4a3b-9a75-502ba6f4d9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:10.195276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687cdfd-ea83-4a3b-9a75-502ba6f4d9d8 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:10.196607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 584/1139] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:14:10.201850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df01a61-4c3c-4057-8cf2-fd409719373b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:10.202531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df01a61-4c3c-4057-8cf2-fd409719373b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:10.202687 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df01a61-4c3c-4057-8cf2-fd409719373b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:10.220856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-0df01a61-4c3c-4057-8cf2-fd409719373b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:14:10.222039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0df01a61-4c3c-4057-8cf2-fd409719373b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:14:10.286296 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 556/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:14:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:14:10.309275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687cdfd-ea83-4a3b-9a75-502ba6f4d9d8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:10.407671 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687cdfd-ea83-4a3b-9a75-502ba6f4d9d8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:10.432470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:10.440177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed194ce5-e0c4-4e47-8ec9-fbfa889afb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:10.440796 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed194ce5-e0c4-4e47-8ec9-fbfa889afb94 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:10.441076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed194ce5-e0c4-4e47-8ec9-fbfa889afb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:10.441347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed194ce5-e0c4-4e47-8ec9-fbfa889afb94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:10.451847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed194ce5-e0c4-4e47-8ec9-fbfa889afb94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-ed194ce5-e0c4-4e47-8ec9-fbfa889afb94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:14:10.456901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:14:10.458710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:14:10.459750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:14:10.459750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:14:10.459750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:14:10.459750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:14:10.459750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:14:10.459750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:14:10.459750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:14:10.459750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:14:10.459750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:14:10.459750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:14:10.459750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:14:10.459750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:14:10.459750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 585/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:14:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:14:10.465100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df01a61-4c3c-4057-8cf2-fd409719373b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:10.515229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:10.563442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df01a61-4c3c-4057-8cf2-fd409719373b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:10.596979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee98ef-dbc3-4c15-9630-e44eb7551e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:10.597582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee98ef-dbc3-4c15-9630-e44eb7551e19 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:10.597859 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee98ef-dbc3-4c15-9630-e44eb7551e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:10.598153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee98ef-dbc3-4c15-9630-e44eb7551e19 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:10.598887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee98ef-dbc3-4c15-9630-e44eb7551e19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:14:10.599188 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee98ef-dbc3-4c15-9630-e44eb7551e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:10.600541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee98ef-dbc3-4c15-9630-e44eb7551e19 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:10.608200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 557/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:14:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:10.614588 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed194ce5-e0c4-4e47-8ec9-fbfa889afb94 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:10.711683 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed194ce5-e0c4-4e47-8ec9-fbfa889afb94 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:10.743719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cea8e2-670b-4978-bcdb-7a48f0d9bc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:10.744334 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cea8e2-670b-4978-bcdb-7a48f0d9bc4a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:10.744610 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cea8e2-670b-4978-bcdb-7a48f0d9bc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:10.744880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cea8e2-670b-4978-bcdb-7a48f0d9bc4a None admin] PATH_INFO: `/v3/users/cb30001cdeae4e3cb2ffaab19c19ac3c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:10.759230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cea8e2-670b-4978-bcdb-7a48f0d9bc4a None admin] RBAC: Authorizing `identity:get_user(user_id=cb30001cdeae4e3cb2ffaab19c19ac3c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:10.760657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cea8e2-670b-4978-bcdb-7a48f0d9bc4a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:10.762251 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 586/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:14:10 2022] GET /identity/v3/users/cb30001cdeae4e3cb2ffaab19c19ac3c => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:10.767862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee98ef-dbc3-4c15-9630-e44eb7551e19 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:10.862601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee98ef-dbc3-4c15-9630-e44eb7551e19 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:10.875512 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:10.896618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dda1d-7d37-41dd-924d-07b9a9eacc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:10.897215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dda1d-7d37-41dd-924d-07b9a9eacc06 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:10.897493 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dda1d-7d37-41dd-924d-07b9a9eacc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:10.897763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dda1d-7d37-41dd-924d-07b9a9eacc06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:10.961654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dda1d-7d37-41dd-924d-07b9a9eacc06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:10.963152 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dda1d-7d37-41dd-924d-07b9a9eacc06 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:11.056592 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 558/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:14:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:14:11.062545 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cea8e2-670b-4978-bcdb-7a48f0d9bc4a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:11.111769 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:11.163389 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cea8e2-670b-4978-bcdb-7a48f0d9bc4a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:11.195872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009da043-4bbb-4c80-a9d2-9d9beac2a0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:11.196490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009da043-4bbb-4c80-a9d2-9d9beac2a0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:11.196768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009da043-4bbb-4c80-a9d2-9d9beac2a0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:11.197040 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009da043-4bbb-4c80-a9d2-9d9beac2a0f9 None admin] PATH_INFO: `/v3/projects/54b3362ffbc546b9ab32b949045ccf57` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:11.198183 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009da043-4bbb-4c80-a9d2-9d9beac2a0f9 None admin] RBAC: Authorizing `identity:get_project(project_id=54b3362ffbc546b9ab32b949045ccf57)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:11.199639 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009da043-4bbb-4c80-a9d2-9d9beac2a0f9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:11.201289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 587/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:14:11 2022] GET /identity/v3/projects/54b3362ffbc546b9ab32b949045ccf57 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:11.208039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dda1d-7d37-41dd-924d-07b9a9eacc06 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:11.221616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:11.302598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dda1d-7d37-41dd-924d-07b9a9eacc06 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:11.335807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137f34f-c35e-4149-9a9a-89f736f1d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:11.336401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137f34f-c35e-4149-9a9a-89f736f1d669 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:11.336678 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137f34f-c35e-4149-9a9a-89f736f1d669 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:11.336945 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137f34f-c35e-4149-9a9a-89f736f1d669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:11.337720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137f34f-c35e-4149-9a9a-89f736f1d669 None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=54b3362ffbc546b9ab32b949045ccf57, user.id=cb30001cdeae4e3cb2ffaab19c19ac3c) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:14:11.338023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137f34f-c35e-4149-9a9a-89f736f1d669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:11.339449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137f34f-c35e-4149-9a9a-89f736f1d669 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:11.344640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 559/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:14:11 2022] GET /identity/v3/role_assignments?user.id=cb30001cdeae4e3cb2ffaab19c19ac3c&scope.project.id=54b3362ffbc546b9ab32b949045ccf57&role.id=0053c24ce06147938dbb61657a531c94 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:14:13.315882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cefd39-bb55-48bd-8491-32375f444904 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:13.316434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cefd39-bb55-48bd-8491-32375f444904 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:13.316434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cefd39-bb55-48bd-8491-32375f444904 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:13.318310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 588/1147] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:14:13.323451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f73abc-99c8-4d15-90fd-27b921a4f62e None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:13.323818 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f73abc-99c8-4d15-90fd-27b921a4f62e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:13.324011 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f73abc-99c8-4d15-90fd-27b921a4f62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:13.342545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-12f73abc-99c8-4d15-90fd-27b921a4f62e None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:14:13.343723 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-12f73abc-99c8-4d15-90fd-27b921a4f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:14:13.406868 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 560/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:14:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:14:13.428343 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cefd39-bb55-48bd-8491-32375f444904 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:13.527891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cefd39-bb55-48bd-8491-32375f444904 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:13.541263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:13.561295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0b48b-918c-438b-9a15-88a5b06a061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:13.561919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0b48b-918c-438b-9a15-88a5b06a061f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:13.562200 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0b48b-918c-438b-9a15-88a5b06a061f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:13.562507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0b48b-918c-438b-9a15-88a5b06a061f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:13.572894 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0b48b-918c-438b-9a15-88a5b06a061f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0ea0b48b-918c-438b-9a15-88a5b06a061f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:14:13.577907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:14:13.579092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:14:13.580174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:14:13.580174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:14:13.580174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:14:13.580174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:14:13.580174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:14:13.580174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:14:13.580174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:14:13.580174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:14:13.580174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:14:13.580174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:14:13.580174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:14:13.580174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:14:13.580174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 589/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:14:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:14:13.585081 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f73abc-99c8-4d15-90fd-27b921a4f62e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:13.593070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:13.681606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f73abc-99c8-4d15-90fd-27b921a4f62e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:13.714693 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0f81f-7d1f-4344-9671-b21726b970d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:13.715363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0f81f-7d1f-4344-9671-b21726b970d6 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:13.715583 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0f81f-7d1f-4344-9671-b21726b970d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:13.715857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0f81f-7d1f-4344-9671-b21726b970d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:13.716562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0f81f-7d1f-4344-9671-b21726b970d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:14:13.716876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0f81f-7d1f-4344-9671-b21726b970d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:13.718238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0f81f-7d1f-4344-9671-b21726b970d6 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:13.726083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 561/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:14:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:13.731980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0b48b-918c-438b-9a15-88a5b06a061f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:13.829192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0b48b-918c-438b-9a15-88a5b06a061f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:13.861512 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264aeab-2380-45d5-924e-4569ec7f2364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:13.862127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264aeab-2380-45d5-924e-4569ec7f2364 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:13.862437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264aeab-2380-45d5-924e-4569ec7f2364 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:13.862709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264aeab-2380-45d5-924e-4569ec7f2364 None admin] PATH_INFO: `/v3/users/cb30001cdeae4e3cb2ffaab19c19ac3c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:13.864385 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264aeab-2380-45d5-924e-4569ec7f2364 None admin] RBAC: Authorizing `identity:get_user(user_id=cb30001cdeae4e3cb2ffaab19c19ac3c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:13.865812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264aeab-2380-45d5-924e-4569ec7f2364 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:13.867412 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 590/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:14:13 2022] GET /identity/v3/users/cb30001cdeae4e3cb2ffaab19c19ac3c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:13.873051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0f81f-7d1f-4344-9671-b21726b970d6 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:13.936413 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:13.968336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0f81f-7d1f-4344-9671-b21726b970d6 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:14.000489 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccfccf-ef02-406a-89c2-b4e7de29fbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:14.001116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccfccf-ef02-406a-89c2-b4e7de29fbff None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:14.001399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccfccf-ef02-406a-89c2-b4e7de29fbff None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:14.001694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccfccf-ef02-406a-89c2-b4e7de29fbff None admin] PATH_INFO: `/v3/projects/54b3362ffbc546b9ab32b949045ccf57` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:14.002843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccfccf-ef02-406a-89c2-b4e7de29fbff None admin] RBAC: Authorizing `identity:get_project(project_id=54b3362ffbc546b9ab32b949045ccf57)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:14.004762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccfccf-ef02-406a-89c2-b4e7de29fbff None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:14.006441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 562/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:14:13 2022] GET /identity/v3/projects/54b3362ffbc546b9ab32b949045ccf57 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:14.012241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264aeab-2380-45d5-924e-4569ec7f2364 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:14.054689 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:14.110847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264aeab-2380-45d5-924e-4569ec7f2364 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:14.143533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53666cb-22e3-4b14-8d12-6578c4390bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:14.144187 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53666cb-22e3-4b14-8d12-6578c4390bcb None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:14.144468 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53666cb-22e3-4b14-8d12-6578c4390bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:14.144744 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53666cb-22e3-4b14-8d12-6578c4390bcb None admin] PATH_INFO: `/v3/projects/54b3362ffbc546b9ab32b949045ccf57/users/cb30001cdeae4e3cb2ffaab19c19ac3c/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:14.147248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53666cb-22e3-4b14-8d12-6578c4390bcb None admin] RBAC: Authorizing `identity:create_grant(project_id=54b3362ffbc546b9ab32b949045ccf57, user_id=cb30001cdeae4e3cb2ffaab19c19ac3c, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:14.148680 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53666cb-22e3-4b14-8d12-6578c4390bcb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:14.161395 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 591/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:14:14 2022] PUT /identity/v3/projects/54b3362ffbc546b9ab32b949045ccf57/users/cb30001cdeae4e3cb2ffaab19c19ac3c/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:14:16.121847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63b04-de5b-42ec-9767-4a535d8f5378 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:16.122433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63b04-de5b-42ec-9767-4a535d8f5378 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:16.122433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63b04-de5b-42ec-9767-4a535d8f5378 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:16.123794 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 563/1154] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:14:16.128895 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298db3f-f849-40df-8255-0c0f19177f75 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:16.129831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298db3f-f849-40df-8255-0c0f19177f75 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:16.129948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298db3f-f849-40df-8255-0c0f19177f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:16.148429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a298db3f-f849-40df-8255-0c0f19177f75 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:14:16.149623 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a298db3f-f849-40df-8255-0c0f19177f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:14:16.214616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 592/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:14:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:14:16.237402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f63b04-de5b-42ec-9767-4a535d8f5378 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:16.336906 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f63b04-de5b-42ec-9767-4a535d8f5378 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:16.368901 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb4478-4ee9-44b8-9750-20cef4936aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:16.369526 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb4478-4ee9-44b8-9750-20cef4936aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:16.369810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb4478-4ee9-44b8-9750-20cef4936aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:16.370088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb4478-4ee9-44b8-9750-20cef4936aa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:16.372713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:16.381179 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb4478-4ee9-44b8-9750-20cef4936aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-1ebb4478-4ee9-44b8-9750-20cef4936aa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:14:16.386027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:14:16.387160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:14:16.388090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:14:16.388090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:14:16.388090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:14:16.388090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:14:16.388090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:14:16.388090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:14:16.388090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:14:16.388090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:14:16.388090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:14:16.388090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:14:16.388090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:14:16.388090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:14:16.388090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 564/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:14:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:14:16.393119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298db3f-f849-40df-8255-0c0f19177f75 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:16.422678 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:16.489960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298db3f-f849-40df-8255-0c0f19177f75 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:16.522744 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a866d63-8e83-4e08-90d6-37cba6782696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:16.523700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a866d63-8e83-4e08-90d6-37cba6782696 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:16.524176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a866d63-8e83-4e08-90d6-37cba6782696 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:16.524621 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a866d63-8e83-4e08-90d6-37cba6782696 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:16.525346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a866d63-8e83-4e08-90d6-37cba6782696 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:14:16.525857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a866d63-8e83-4e08-90d6-37cba6782696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:16.529844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a866d63-8e83-4e08-90d6-37cba6782696 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:16.537457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 593/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:14:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:16.543464 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb4478-4ee9-44b8-9750-20cef4936aa3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:16.638347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb4478-4ee9-44b8-9750-20cef4936aa3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:16.672508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c4630-4fb4-4f4f-b077-e34da893637f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:16.673147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c4630-4fb4-4f4f-b077-e34da893637f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:16.673430 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c4630-4fb4-4f4f-b077-e34da893637f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:16.673705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c4630-4fb4-4f4f-b077-e34da893637f None admin] PATH_INFO: `/v3/users/cb30001cdeae4e3cb2ffaab19c19ac3c` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:16.674895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c4630-4fb4-4f4f-b077-e34da893637f None admin] RBAC: Authorizing `identity:get_user(user_id=cb30001cdeae4e3cb2ffaab19c19ac3c)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:16.676384 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c4630-4fb4-4f4f-b077-e34da893637f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:16.677992 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 565/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:14:16 2022] GET /identity/v3/users/cb30001cdeae4e3cb2ffaab19c19ac3c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:16.683750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a866d63-8e83-4e08-90d6-37cba6782696 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:16.775658 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:16.782646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a866d63-8e83-4e08-90d6-37cba6782696 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:16.815080 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd4855-bf46-4c0c-b4a9-65ded998023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:16.815674 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4855-bf46-4c0c-b4a9-65ded998023b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:16.815963 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4855-bf46-4c0c-b4a9-65ded998023b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:16.816237 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4855-bf46-4c0c-b4a9-65ded998023b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:16.881100 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd4855-bf46-4c0c-b4a9-65ded998023b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:16.882576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd4855-bf46-4c0c-b4a9-65ded998023b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:16.971259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:16.978600 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 594/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:14:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:14:16.984425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c4630-4fb4-4f4f-b077-e34da893637f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:17.044864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:17.081862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c4630-4fb4-4f4f-b077-e34da893637f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:17.116043 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4941b2d-2e46-4797-8f9f-1371b12235de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:17.116671 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4941b2d-2e46-4797-8f9f-1371b12235de None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:17.116952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4941b2d-2e46-4797-8f9f-1371b12235de None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:17.117230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4941b2d-2e46-4797-8f9f-1371b12235de None admin] PATH_INFO: `/v3/projects/54b3362ffbc546b9ab32b949045ccf57` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:17.118379 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4941b2d-2e46-4797-8f9f-1371b12235de None admin] RBAC: Authorizing `identity:get_project(project_id=54b3362ffbc546b9ab32b949045ccf57)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:17.119828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4941b2d-2e46-4797-8f9f-1371b12235de None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:17.121501 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 566/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:14:16 2022] GET /identity/v3/projects/54b3362ffbc546b9ab32b949045ccf57 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:17.127551 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd4855-bf46-4c0c-b4a9-65ded998023b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:17.229060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd4855-bf46-4c0c-b4a9-65ded998023b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:17.261027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5bbaf-6e14-4cbb-bf70-9ea90594834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:17.261623 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5bbaf-6e14-4cbb-bf70-9ea90594834c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:17.261904 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5bbaf-6e14-4cbb-bf70-9ea90594834c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:17.262255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5bbaf-6e14-4cbb-bf70-9ea90594834c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:17.263056 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5bbaf-6e14-4cbb-bf70-9ea90594834c None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=54b3362ffbc546b9ab32b949045ccf57, user.id=cb30001cdeae4e3cb2ffaab19c19ac3c) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:14:17.263365 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5bbaf-6e14-4cbb-bf70-9ea90594834c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:17.264778 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5bbaf-6e14-4cbb-bf70-9ea90594834c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:17.270867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 595/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:14:17 2022] GET /identity/v3/role_assignments?user.id=cb30001cdeae4e3cb2ffaab19c19ac3c&scope.project.id=54b3362ffbc546b9ab32b949045ccf57&role.id=0053c24ce06147938dbb61657a531c94 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:19.307569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf75f-eee7-4981-944a-01414c37a004 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:19.308125 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf75f-eee7-4981-944a-01414c37a004 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:19.308125 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adf75f-eee7-4981-944a-01414c37a004 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:19.309462 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 567/1162] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:14:19.314561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07110-79c1-4aa7-bc00-d8e9a3416f98 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:19.314981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07110-79c1-4aa7-bc00-d8e9a3416f98 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:19.315108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07110-79c1-4aa7-bc00-d8e9a3416f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:19.332860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9ad07110-79c1-4aa7-bc00-d8e9a3416f98 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:14:19.334030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9ad07110-79c1-4aa7-bc00-d8e9a3416f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:14:19.385387 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:19.398584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 596/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:14:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:14:19.420799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adf75f-eee7-4981-944a-01414c37a004 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:19.519156 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adf75f-eee7-4981-944a-01414c37a004 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:19.548076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:19.553216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02295cf-5946-4f16-bba4-76740d3a5ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:19.553825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02295cf-5946-4f16-bba4-76740d3a5ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:19.554106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02295cf-5946-4f16-bba4-76740d3a5ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:19.554377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02295cf-5946-4f16-bba4-76740d3a5ab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:19.618755 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02295cf-5946-4f16-bba4-76740d3a5ab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:19.620191 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02295cf-5946-4f16-bba4-76740d3a5ab3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:19.714283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 568/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:14:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:14:19.720380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad07110-79c1-4aa7-bc00-d8e9a3416f98 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:19.814546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad07110-79c1-4aa7-bc00-d8e9a3416f98 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:19.849473 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94903a50-9972-48e3-bcba-5b70470902df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:19.850090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94903a50-9972-48e3-bcba-5b70470902df None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:19.850366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94903a50-9972-48e3-bcba-5b70470902df None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:19.850667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94903a50-9972-48e3-bcba-5b70470902df None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:19.857062 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94903a50-9972-48e3-bcba-5b70470902df None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:19.858522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94903a50-9972-48e3-bcba-5b70470902df None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-94903a50-9972-48e3-bcba-5b70470902df None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:14:19.869646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:14:19.870889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:14:19.871972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 597/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 4 22:14:19 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:14:19.876667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02295cf-5946-4f16-bba4-76740d3a5ab3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:19.906480 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:19.971664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02295cf-5946-4f16-bba4-76740d3a5ab3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:20.003528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbad08-b7b3-49f3-bf6b-0e53171d67b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:20.004126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbad08-b7b3-49f3-bf6b-0e53171d67b4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:20.004911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbad08-b7b3-49f3-bf6b-0e53171d67b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:20.005181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbad08-b7b3-49f3-bf6b-0e53171d67b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:20.005856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbad08-b7b3-49f3-bf6b-0e53171d67b4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:14:20.006157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbad08-b7b3-49f3-bf6b-0e53171d67b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:20.007529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbad08-b7b3-49f3-bf6b-0e53171d67b4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:20.014344 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 569/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Thu Aug 4 22:14:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:21.990910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165213c7-dc93-4725-b52b-77ac7efaad52 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:21.991485 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165213c7-dc93-4725-b52b-77ac7efaad52 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:21.991485 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165213c7-dc93-4725-b52b-77ac7efaad52 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:21.992866 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 598/1167] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:14:21.998015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c207a-4f53-4c53-8446-ba700d54f164 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:21.998430 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c207a-4f53-4c53-8446-ba700d54f164 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:21.998601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c207a-4f53-4c53-8446-ba700d54f164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:22.016986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b60c207a-4f53-4c53-8446-ba700d54f164 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:14:22.018148 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b60c207a-4f53-4c53-8446-ba700d54f164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:14:22.087005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 570/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:14:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:14:22.111682 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165213c7-dc93-4725-b52b-77ac7efaad52 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:22.161252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:22.212661 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165213c7-dc93-4725-b52b-77ac7efaad52 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:22.245643 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd38fc-5223-40c8-bdeb-08851d2b9edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:22.246176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd38fc-5223-40c8-bdeb-08851d2b9edf None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:22.246481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd38fc-5223-40c8-bdeb-08851d2b9edf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:22.246756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd38fc-5223-40c8-bdeb-08851d2b9edf None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:22.247463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd38fc-5223-40c8-bdeb-08851d2b9edf None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:22.248827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd38fc-5223-40c8-bdeb-08851d2b9edf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:22.264106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 599/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Thu Aug 4 22:14:22 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:14:24.276401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2d47-08ad-488d-81a6-fac0f5550fcb None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:24.276927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2d47-08ad-488d-81a6-fac0f5550fcb None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:24.277047 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e2d47-08ad-488d-81a6-fac0f5550fcb None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:24.278326 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 571/1170] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:14:24.283426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d05512-1a44-4ed8-af3c-3a633f42f441 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:24.283804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d05512-1a44-4ed8-af3c-3a633f42f441 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:24.283982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d05512-1a44-4ed8-af3c-3a633f42f441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:24.302217 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c8d05512-1a44-4ed8-af3c-3a633f42f441 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:14:24.303438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c8d05512-1a44-4ed8-af3c-3a633f42f441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:14:24.367822 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 600/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:14:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:14:24.390394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e2d47-08ad-488d-81a6-fac0f5550fcb None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:24.418002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:24.498802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e2d47-08ad-488d-81a6-fac0f5550fcb None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:24.531445 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7deeab-f533-467a-82e8-34e5d03f2fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:24.532008 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7deeab-f533-467a-82e8-34e5d03f2fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:24.532289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7deeab-f533-467a-82e8-34e5d03f2fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:24.532565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7deeab-f533-467a-82e8-34e5d03f2fd5 None admin] PATH_INFO: `/v3/domains/f0f549f11a7b46b2b364944b1c705973` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:24.543129 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7deeab-f533-467a-82e8-34e5d03f2fd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f0f549f11a7b46b2b364944b1c705973)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:24.544571 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7deeab-f533-467a-82e8-34e5d03f2fd5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:24.546199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 572/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Thu Aug 4 22:14:24 2022] GET /identity/v3/domains/f0f549f11a7b46b2b364944b1c705973 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:24.552724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d05512-1a44-4ed8-af3c-3a633f42f441 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:24.590749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:24.651312 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d05512-1a44-4ed8-af3c-3a633f42f441 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:24.684450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cdb2a-badb-473e-b93f-380242befa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:24.685063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cdb2a-badb-473e-b93f-380242befa45 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:24.685345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cdb2a-badb-473e-b93f-380242befa45 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:24.685622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cdb2a-badb-473e-b93f-380242befa45 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:24.686301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cdb2a-badb-473e-b93f-380242befa45 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:24.687764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cdb2a-badb-473e-b93f-380242befa45 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:24.714245 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 601/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 4 22:14:24 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:14:26.705391 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3897bb2-cd8b-41db-96dd-07bcd16f4370 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:26.705935 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3897bb2-cd8b-41db-96dd-07bcd16f4370 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:26.705935 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3897bb2-cd8b-41db-96dd-07bcd16f4370 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:26.707351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 573/1174] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:14:26.712939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4c781-57aa-4095-bb40-4ea22c75f1e1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:26.713361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4c781-57aa-4095-bb40-4ea22c75f1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:26.713504 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4c781-57aa-4095-bb40-4ea22c75f1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:26.731354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-82d4c781-57aa-4095-bb40-4ea22c75f1e1 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:14:26.732479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-82d4c781-57aa-4095-bb40-4ea22c75f1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:14:26.796136 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 602/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:14:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:14:26.820217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3897bb2-cd8b-41db-96dd-07bcd16f4370 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:26.904411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:26.919957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3897bb2-cd8b-41db-96dd-07bcd16f4370 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:26.952789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524f54-aa3d-469d-b442-3506f4b7f569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:26.953419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524f54-aa3d-469d-b442-3506f4b7f569 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:26.953702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524f54-aa3d-469d-b442-3506f4b7f569 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:26.953979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524f54-aa3d-469d-b442-3506f4b7f569 None admin] PATH_INFO: `/v3/domains/f0f549f11a7b46b2b364944b1c705973` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:26.955153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25524f54-aa3d-469d-b442-3506f4b7f569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f0f549f11a7b46b2b364944b1c705973)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:26.956574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25524f54-aa3d-469d-b442-3506f4b7f569 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:26.958789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 574/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Thu Aug 4 22:14:26 2022] GET /identity/v3/domains/f0f549f11a7b46b2b364944b1c705973 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:26.964428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4c781-57aa-4095-bb40-4ea22c75f1e1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:26.984976 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:27.061525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4c781-57aa-4095-bb40-4ea22c75f1e1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:27.094740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c55a2f-3883-49df-b095-4f71bcb620fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:27.095349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c55a2f-3883-49df-b095-4f71bcb620fb None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:27.095631 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c55a2f-3883-49df-b095-4f71bcb620fb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:27.095905 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c55a2f-3883-49df-b095-4f71bcb620fb None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:27.096595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c55a2f-3883-49df-b095-4f71bcb620fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:27.098048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c55a2f-3883-49df-b095-4f71bcb620fb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:27.119247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 603/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:14:26 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:14:29.145043 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a4835-f9e1-4048-a1f5-87644472f2a3 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:29.145573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a4835-f9e1-4048-a1f5-87644472f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:29.145573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a4835-f9e1-4048-a1f5-87644472f2a3 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:29.146988 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 575/1178] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:14:29.152243 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfab44d-017f-486c-a86e-eeb15cdcc292 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:29.152645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfab44d-017f-486c-a86e-eeb15cdcc292 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:29.152799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfab44d-017f-486c-a86e-eeb15cdcc292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:29.170920 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6dfab44d-017f-486c-a86e-eeb15cdcc292 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:14:29.172094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6dfab44d-017f-486c-a86e-eeb15cdcc292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:14:29.237026 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 604/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:14:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:14:29.260390 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a4835-f9e1-4048-a1f5-87644472f2a3 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:29.359791 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a4835-f9e1-4048-a1f5-87644472f2a3 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:29.392955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff52d26-c090-4800-a779-4da35a208737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:29.393583 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff52d26-c090-4800-a779-4da35a208737 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:29.393867 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff52d26-c090-4800-a779-4da35a208737 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:29.394143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff52d26-c090-4800-a779-4da35a208737 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:29.404015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff52d26-c090-4800-a779-4da35a208737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-bff52d26-c090-4800-a779-4da35a208737 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:14:29.408820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:14:29.409933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:14:29.410860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:14:29.410860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:14:29.410860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:14:29.410860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:14:29.410860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:14:29.410860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:14:29.410860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:14:29.410860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:14:29.410860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:14:29.410860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:14:29.410860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:14:29.410860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:14:29.410860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 576/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:14:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:14:29.415892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfab44d-017f-486c-a86e-eeb15cdcc292 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:29.423850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:29.512886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfab44d-017f-486c-a86e-eeb15cdcc292 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:29.545784 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc92f0-235b-44b4-9cb5-796a82bd42ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:29.546380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc92f0-235b-44b4-9cb5-796a82bd42ff None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:29.546692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc92f0-235b-44b4-9cb5-796a82bd42ff None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:29.546964 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc92f0-235b-44b4-9cb5-796a82bd42ff None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:29.547666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc92f0-235b-44b4-9cb5-796a82bd42ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:14:29.547967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc92f0-235b-44b4-9cb5-796a82bd42ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:29.549328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc92f0-235b-44b4-9cb5-796a82bd42ff None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:29.557586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 605/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:14:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:29.563332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff52d26-c090-4800-a779-4da35a208737 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:29.580003 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:29.661732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff52d26-c090-4800-a779-4da35a208737 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:29.694821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c4cb7-f6cf-4697-bc99-3c23718a77f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:29.695456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c4cb7-f6cf-4697-bc99-3c23718a77f4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:29.695737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c4cb7-f6cf-4697-bc99-3c23718a77f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:29.696011 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c4cb7-f6cf-4697-bc99-3c23718a77f4 None admin] PATH_INFO: `/v3/users/c07f5d21e9fe42e6831f17640c24fedb` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:29.709125 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c4cb7-f6cf-4697-bc99-3c23718a77f4 None admin] RBAC: Authorizing `identity:get_user(user_id=c07f5d21e9fe42e6831f17640c24fedb)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:29.710579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c4cb7-f6cf-4697-bc99-3c23718a77f4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:29.712189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 577/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:14:29 2022] GET /identity/v3/users/c07f5d21e9fe42e6831f17640c24fedb => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:29.717852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc92f0-235b-44b4-9cb5-796a82bd42ff None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:29.781925 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:29.814966 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc92f0-235b-44b4-9cb5-796a82bd42ff None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:29.846940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf604745-6e1d-4365-8e3c-c4a8b68a60eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:29.847537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf604745-6e1d-4365-8e3c-c4a8b68a60eb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:29.848341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf604745-6e1d-4365-8e3c-c4a8b68a60eb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:29.848613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf604745-6e1d-4365-8e3c-c4a8b68a60eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:29.914024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf604745-6e1d-4365-8e3c-c4a8b68a60eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:29.915428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf604745-6e1d-4365-8e3c-c4a8b68a60eb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:29.978671 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:30.010982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 606/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:14:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:14:30.016939 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c4cb7-f6cf-4697-bc99-3c23718a77f4 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:30.085582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:30.115322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c4cb7-f6cf-4697-bc99-3c23718a77f4 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:30.148537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c74a8-5a97-46be-9c86-2d7b6dc8a72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:30.149167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c74a8-5a97-46be-9c86-2d7b6dc8a72d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:30.149449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c74a8-5a97-46be-9c86-2d7b6dc8a72d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:30.149723 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c74a8-5a97-46be-9c86-2d7b6dc8a72d None admin] PATH_INFO: `/v3/projects/2650ac9362a2424ca9e64d1abd279f58` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:30.150900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c74a8-5a97-46be-9c86-2d7b6dc8a72d None admin] RBAC: Authorizing `identity:get_project(project_id=2650ac9362a2424ca9e64d1abd279f58)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:30.152316 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c74a8-5a97-46be-9c86-2d7b6dc8a72d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:30.153960 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 578/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:14:30 2022] GET /identity/v3/projects/2650ac9362a2424ca9e64d1abd279f58 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:30.160129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf604745-6e1d-4365-8e3c-c4a8b68a60eb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:30.254764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf604745-6e1d-4365-8e3c-c4a8b68a60eb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:30.286938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb1b51-aa31-4974-a135-4225aa6733ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:30.287535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb1b51-aa31-4974-a135-4225aa6733ae None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:30.287817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb1b51-aa31-4974-a135-4225aa6733ae None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:30.288089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb1b51-aa31-4974-a135-4225aa6733ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:30.288863 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb1b51-aa31-4974-a135-4225aa6733ae None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=2650ac9362a2424ca9e64d1abd279f58, user.id=c07f5d21e9fe42e6831f17640c24fedb) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:14:30.289173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb1b51-aa31-4974-a135-4225aa6733ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:30.290605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb1b51-aa31-4974-a135-4225aa6733ae None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:30.295762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 607/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:14:30 2022] GET /identity/v3/role_assignments?user.id=c07f5d21e9fe42e6831f17640c24fedb&scope.project.id=2650ac9362a2424ca9e64d1abd279f58&role.id=0053c24ce06147938dbb61657a531c94 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:32.262034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779b03f-497e-4281-8bdf-b7fecf5bf93a None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:32.262693 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779b03f-497e-4281-8bdf-b7fecf5bf93a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:32.262693 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779b03f-497e-4281-8bdf-b7fecf5bf93a None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:32.263970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 579/1186] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:14:32.269048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9395f-41a6-4482-a806-26fcfa83e2f3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:32.269453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9395f-41a6-4482-a806-26fcfa83e2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:32.269604 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9395f-41a6-4482-a806-26fcfa83e2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:32.288364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9bf9395f-41a6-4482-a806-26fcfa83e2f3 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:14:32.289554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9bf9395f-41a6-4482-a806-26fcfa83e2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:14:32.314348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:32.355597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 608/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:14:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:14:32.377393 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779b03f-497e-4281-8bdf-b7fecf5bf93a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:32.475873 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779b03f-497e-4281-8bdf-b7fecf5bf93a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:32.507725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f92fef-08a2-4833-b567-a5622446e0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:32.508352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f92fef-08a2-4833-b567-a5622446e0ff None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:32.508629 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f92fef-08a2-4833-b567-a5622446e0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:32.508899 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f92fef-08a2-4833-b567-a5622446e0ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:32.516189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:32.519367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f92fef-08a2-4833-b567-a5622446e0ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-31f92fef-08a2-4833-b567-a5622446e0ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:14:32.524799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:14:32.526030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:14:32.527406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:14:32.527406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:14:32.527406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:14:32.527406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:14:32.527406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:14:32.527406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:14:32.527406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:14:32.527406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:14:32.527406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:14:32.527406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:14:32.527406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:14:32.527406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:14:32.527406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 580/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:14:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:14:32.532022 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9395f-41a6-4482-a806-26fcfa83e2f3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:32.628256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9395f-41a6-4482-a806-26fcfa83e2f3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:32.661298 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a2ee9-9257-461b-9004-507ec573c07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:32.661897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a2ee9-9257-461b-9004-507ec573c07f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:32.662172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a2ee9-9257-461b-9004-507ec573c07f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:32.662464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a2ee9-9257-461b-9004-507ec573c07f None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:32.663167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a2ee9-9257-461b-9004-507ec573c07f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:14:32.663470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a2ee9-9257-461b-9004-507ec573c07f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:32.664826 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a2ee9-9257-461b-9004-507ec573c07f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:32.672592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 609/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:14:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:32.679923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f92fef-08a2-4833-b567-a5622446e0ff None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:32.786186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f92fef-08a2-4833-b567-a5622446e0ff None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:32.822330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7baff4-e9ae-4623-9516-c54d78e424b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:32.823002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7baff4-e9ae-4623-9516-c54d78e424b1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:32.823284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7baff4-e9ae-4623-9516-c54d78e424b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:32.823559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7baff4-e9ae-4623-9516-c54d78e424b1 None admin] PATH_INFO: `/v3/users/c07f5d21e9fe42e6831f17640c24fedb` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:32.824712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7baff4-e9ae-4623-9516-c54d78e424b1 None admin] RBAC: Authorizing `identity:get_user(user_id=c07f5d21e9fe42e6831f17640c24fedb)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:32.826132 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7baff4-e9ae-4623-9516-c54d78e424b1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:32.828042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 581/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:14:32 2022] GET /identity/v3/users/c07f5d21e9fe42e6831f17640c24fedb => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:32.834505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a2ee9-9257-461b-9004-507ec573c07f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:32.860135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:32.932428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a2ee9-9257-461b-9004-507ec573c07f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:32.966688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880650ff-8ac7-4210-bd04-14d227700a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:32.967321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880650ff-8ac7-4210-bd04-14d227700a7e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:32.967601 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880650ff-8ac7-4210-bd04-14d227700a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:32.967876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880650ff-8ac7-4210-bd04-14d227700a7e None admin] PATH_INFO: `/v3/projects/2650ac9362a2424ca9e64d1abd279f58` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:32.969030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880650ff-8ac7-4210-bd04-14d227700a7e None admin] RBAC: Authorizing `identity:get_project(project_id=2650ac9362a2424ca9e64d1abd279f58)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:32.970492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880650ff-8ac7-4210-bd04-14d227700a7e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:32.972149 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 610/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:14:32 2022] GET /identity/v3/projects/2650ac9362a2424ca9e64d1abd279f58 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:32.978337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7baff4-e9ae-4623-9516-c54d78e424b1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:33.042865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:33.076353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7baff4-e9ae-4623-9516-c54d78e424b1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:33.109374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714c74b-02e5-4f3e-9702-50af5387f61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:33.110032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714c74b-02e5-4f3e-9702-50af5387f61b None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:33.110314 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714c74b-02e5-4f3e-9702-50af5387f61b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:33.110617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714c74b-02e5-4f3e-9702-50af5387f61b None admin] PATH_INFO: `/v3/projects/2650ac9362a2424ca9e64d1abd279f58/users/c07f5d21e9fe42e6831f17640c24fedb/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:33.112541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714c74b-02e5-4f3e-9702-50af5387f61b None admin] RBAC: Authorizing `identity:create_grant(project_id=2650ac9362a2424ca9e64d1abd279f58, user_id=c07f5d21e9fe42e6831f17640c24fedb, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:33.114517 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714c74b-02e5-4f3e-9702-50af5387f61b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:33.126857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 582/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:14:32 2022] PUT /identity/v3/projects/2650ac9362a2424ca9e64d1abd279f58/users/c07f5d21e9fe42e6831f17640c24fedb/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:14:35.090768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3678-6790-464e-894f-714ee13c6c8b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:35.091341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3678-6790-464e-894f-714ee13c6c8b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:35.091341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3678-6790-464e-894f-714ee13c6c8b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:35.092689 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 611/1193] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:14:35.098402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54caf9-eaa0-41e7-9313-0b043b3c4c2b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:35.098845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54caf9-eaa0-41e7-9313-0b043b3c4c2b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:35.098975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54caf9-eaa0-41e7-9313-0b043b3c4c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:35.117189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-8a54caf9-eaa0-41e7-9313-0b043b3c4c2b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:14:35.118376 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8a54caf9-eaa0-41e7-9313-0b043b3c4c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:14:35.182621 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 583/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:14:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:14:35.206184 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f3678-6790-464e-894f-714ee13c6c8b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:35.295985 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:35.305963 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f3678-6790-464e-894f-714ee13c6c8b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:35.338997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe9a9f-76dd-4a9e-9d9c-9ba61206b35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:35.339624 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe9a9f-76dd-4a9e-9d9c-9ba61206b35e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:35.339906 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe9a9f-76dd-4a9e-9d9c-9ba61206b35e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:35.340182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe9a9f-76dd-4a9e-9d9c-9ba61206b35e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:35.350540 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe9a9f-76dd-4a9e-9d9c-9ba61206b35e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-f5fe9a9f-76dd-4a9e-9d9c-9ba61206b35e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:14:35.355323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:14:35.356465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:14:35.357554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:14:35.357554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:14:35.357554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:14:35.357554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:14:35.357554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:14:35.357554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:14:35.357554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:14:35.357554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:14:35.357554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:14:35.357554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:14:35.357554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:14:35.357554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:14:35.357554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 612/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:14:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:14:35.362482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54caf9-eaa0-41e7-9313-0b043b3c4c2b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:35.419562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:35.460905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54caf9-eaa0-41e7-9313-0b043b3c4c2b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:35.494105 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2d38f-9927-41af-98c7-5dff63af1afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:35.494749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2d38f-9927-41af-98c7-5dff63af1afe None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:35.495027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2d38f-9927-41af-98c7-5dff63af1afe None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:35.495295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2d38f-9927-41af-98c7-5dff63af1afe None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:35.496009 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2d38f-9927-41af-98c7-5dff63af1afe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:14:35.496311 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2d38f-9927-41af-98c7-5dff63af1afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:35.497660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2d38f-9927-41af-98c7-5dff63af1afe None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:35.505556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 584/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:14:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:35.511337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe9a9f-76dd-4a9e-9d9c-9ba61206b35e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:35.608881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe9a9f-76dd-4a9e-9d9c-9ba61206b35e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:35.641587 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21372824-9d9c-44b5-9689-1ccd1d398a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:35.642209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21372824-9d9c-44b5-9689-1ccd1d398a72 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:35.642520 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21372824-9d9c-44b5-9689-1ccd1d398a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:35.642798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21372824-9d9c-44b5-9689-1ccd1d398a72 None admin] PATH_INFO: `/v3/users/c07f5d21e9fe42e6831f17640c24fedb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:35.643951 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21372824-9d9c-44b5-9689-1ccd1d398a72 None admin] RBAC: Authorizing `identity:get_user(user_id=c07f5d21e9fe42e6831f17640c24fedb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:35.645932 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21372824-9d9c-44b5-9689-1ccd1d398a72 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:35.647534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 613/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Thu Aug 4 22:14:35 2022] GET /identity/v3/users/c07f5d21e9fe42e6831f17640c24fedb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:35.653092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2d38f-9927-41af-98c7-5dff63af1afe None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:35.748295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2d38f-9927-41af-98c7-5dff63af1afe None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:35.767240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:35.781432 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db03e7-b8e9-4db5-835a-f3fbce838aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:35.782033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db03e7-b8e9-4db5-835a-f3fbce838aea None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:35.782308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db03e7-b8e9-4db5-835a-f3fbce838aea None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:35.782615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db03e7-b8e9-4db5-835a-f3fbce838aea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:35.846728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db03e7-b8e9-4db5-835a-f3fbce838aea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:35.848197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db03e7-b8e9-4db5-835a-f3fbce838aea None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:35.942317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 585/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:14:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:14:35.950249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21372824-9d9c-44b5-9689-1ccd1d398a72 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:35.972706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:36.048750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21372824-9d9c-44b5-9689-1ccd1d398a72 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:36.082094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c12f60-c3b3-4fa7-bc0b-ec90a9645cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:36.082752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c12f60-c3b3-4fa7-bc0b-ec90a9645cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:36.083037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c12f60-c3b3-4fa7-bc0b-ec90a9645cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:36.083312 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c12f60-c3b3-4fa7-bc0b-ec90a9645cc0 None admin] PATH_INFO: `/v3/projects/2650ac9362a2424ca9e64d1abd279f58` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:36.084457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c12f60-c3b3-4fa7-bc0b-ec90a9645cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=2650ac9362a2424ca9e64d1abd279f58)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:36.085889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c12f60-c3b3-4fa7-bc0b-ec90a9645cc0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:36.087564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 614/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Thu Aug 4 22:14:35 2022] GET /identity/v3/projects/2650ac9362a2424ca9e64d1abd279f58 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:36.093873 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db03e7-b8e9-4db5-835a-f3fbce838aea None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:14:36.114531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:36.187831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db03e7-b8e9-4db5-835a-f3fbce838aea None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:14:36.220236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fc5c7-9e09-46a2-af8f-1b2d6eedb6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:14:36.220808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc5c7-9e09-46a2-af8f-1b2d6eedb6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:14:36.221084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc5c7-9e09-46a2-af8f-1b2d6eedb6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:14:36.221352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc5c7-9e09-46a2-af8f-1b2d6eedb6a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:14:36.222123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fc5c7-9e09-46a2-af8f-1b2d6eedb6a9 None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=2650ac9362a2424ca9e64d1abd279f58, user.id=c07f5d21e9fe42e6831f17640c24fedb) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:14:36.222452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fc5c7-9e09-46a2-af8f-1b2d6eedb6a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:14:36.223885 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fc5c7-9e09-46a2-af8f-1b2d6eedb6a9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:14:36.229377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 586/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:14:36 2022] GET /identity/v3/role_assignments?user.id=c07f5d21e9fe42e6831f17640c24fedb&scope.project.id=2650ac9362a2424ca9e64d1abd279f58&role.id=0053c24ce06147938dbb61657a531c94 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:14:46.078053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=56 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:14:46.226868 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=58 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:31.456990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8cdf-5965-4932-8ee0-6a25460dbd5c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:31.457596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8cdf-5965-4932-8ee0-6a25460dbd5c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:31.457596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8cdf-5965-4932-8ee0-6a25460dbd5c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:31.462451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 615/1201] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:15:31.464735 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e332e6-6eda-48a7-ae64-c28613719783 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:31.465526 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e332e6-6eda-48a7-ae64-c28613719783 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:31.465965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e332e6-6eda-48a7-ae64-c28613719783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:31.489170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b9e332e6-6eda-48a7-ae64-c28613719783 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:15:31.490899 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b9e332e6-6eda-48a7-ae64-c28613719783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:15:31.583497 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 587/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:15:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:15:31.611285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff8cdf-5965-4932-8ee0-6a25460dbd5c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:31.755333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff8cdf-5965-4932-8ee0-6a25460dbd5c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:31.801201 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6660c4-ab4c-42c2-a377-a1ceaf3bdbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:31.802351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6660c4-ab4c-42c2-a377-a1ceaf3bdbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:31.802878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6660c4-ab4c-42c2-a377-a1ceaf3bdbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:31.803186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6660c4-ab4c-42c2-a377-a1ceaf3bdbd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:31.836949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6660c4-ab4c-42c2-a377-a1ceaf3bdbd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:31.838560 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6660c4-ab4c-42c2-a377-a1ceaf3bdbd8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2b6660c4-ab4c-42c2-a377-a1ceaf3bdbd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:15:31.857852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:31.859192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:31.860182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:15:31.860182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:15:31.860182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:31.860182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:31.860182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 616/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:31.865460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e332e6-6eda-48a7-ae64-c28613719783 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:32.002729 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e332e6-6eda-48a7-ae64-c28613719783 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:32.043254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:32.049878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ae8b0-847d-4450-88f0-3c735f3d7cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:32.051302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ae8b0-847d-4450-88f0-3c735f3d7cbb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:32.051709 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ae8b0-847d-4450-88f0-3c735f3d7cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:32.052013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ae8b0-847d-4450-88f0-3c735f3d7cbb None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:32.052723 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ae8b0-847d-4450-88f0-3c735f3d7cbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:32.053169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ae8b0-847d-4450-88f0-3c735f3d7cbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:32.054673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ae8b0-847d-4450-88f0-3c735f3d7cbb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:32.070601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 588/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:32.074247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6660c4-ab4c-42c2-a377-a1ceaf3bdbd8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:32.139075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:32.208398 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6660c4-ab4c-42c2-a377-a1ceaf3bdbd8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:32.248805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1aca0-e6f8-4be3-93ab-bb23c3095844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:32.249438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1aca0-e6f8-4be3-93ab-bb23c3095844 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:32.249723 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1aca0-e6f8-4be3-93ab-bb23c3095844 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:32.249999 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1aca0-e6f8-4be3-93ab-bb23c3095844 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:32.250721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1aca0-e6f8-4be3-93ab-bb23c3095844 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:32.252182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1aca0-e6f8-4be3-93ab-bb23c3095844 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:32.278708 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 617/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Thu Aug 4 22:15:32 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:15:34.436694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b386f-bb9e-45a3-80db-9f658564a81c None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:34.437393 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b386f-bb9e-45a3-80db-9f658564a81c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:34.437393 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b386f-bb9e-45a3-80db-9f658564a81c None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:34.439139 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 589/1206] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:15:34.444326 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba353f-710d-4d0d-abfa-9270505454a5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:34.444742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba353f-710d-4d0d-abfa-9270505454a5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:34.444945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba353f-710d-4d0d-abfa-9270505454a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:34.466059 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0eba353f-710d-4d0d-abfa-9270505454a5 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:15:34.466957 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0eba353f-710d-4d0d-abfa-9270505454a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:15:34.553238 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 618/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:15:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:15:34.576398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b386f-bb9e-45a3-80db-9f658564a81c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:34.690108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b386f-bb9e-45a3-80db-9f658564a81c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:34.727150 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b14d35-996d-48c1-a4df-88e2273ab9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:34.727794 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b14d35-996d-48c1-a4df-88e2273ab9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:34.728074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b14d35-996d-48c1-a4df-88e2273ab9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:34.728419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b14d35-996d-48c1-a4df-88e2273ab9a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:34.739304 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b14d35-996d-48c1-a4df-88e2273ab9a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d6b14d35-996d-48c1-a4df-88e2273ab9a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:15:34.744154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:34.745208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:34.746749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:34.746749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:34.746749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:34.746749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:34.746749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:15:34.746749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:15:34.746749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:15:34.746749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:15:34.746749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:15:34.746749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:15:34.746749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:15:34.746749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:34.746749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 590/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:15:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:34.751486 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba353f-710d-4d0d-abfa-9270505454a5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:34.799291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:34.879074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba353f-710d-4d0d-abfa-9270505454a5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:34.924554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672178d-8ddb-4376-afb9-7a85a45f96f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:34.925273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672178d-8ddb-4376-afb9-7a85a45f96f5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:34.925611 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672178d-8ddb-4376-afb9-7a85a45f96f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:34.925984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672178d-8ddb-4376-afb9-7a85a45f96f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:34.926844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672178d-8ddb-4376-afb9-7a85a45f96f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:34.927150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672178d-8ddb-4376-afb9-7a85a45f96f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:34.928683 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672178d-8ddb-4376-afb9-7a85a45f96f5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:34.938515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 619/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:15:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:15:34.944511 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b14d35-996d-48c1-a4df-88e2273ab9a3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:35.001710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:35.064216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b14d35-996d-48c1-a4df-88e2273ab9a3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:35.103273 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28df5b-766b-47b1-9961-c53a31d5dd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:35.104220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28df5b-766b-47b1-9961-c53a31d5dd70 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:35.104502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28df5b-766b-47b1-9961-c53a31d5dd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:35.104817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28df5b-766b-47b1-9961-c53a31d5dd70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:35.117170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28df5b-766b-47b1-9961-c53a31d5dd70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:35.118985 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28df5b-766b-47b1-9961-c53a31d5dd70 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-fb28df5b-766b-47b1-9961-c53a31d5dd70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:15:35.134933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:35.138826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:35.139728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:15:35.139728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:15:35.139728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:35.139728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:35.140970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 591/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:35.142309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672178d-8ddb-4376-afb9-7a85a45f96f5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:35.263818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:35.267437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672178d-8ddb-4376-afb9-7a85a45f96f5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:35.324756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9c5e8-4b55-4961-a9ce-65ac46aed99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:35.325385 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9c5e8-4b55-4961-a9ce-65ac46aed99c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:35.325903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9c5e8-4b55-4961-a9ce-65ac46aed99c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:35.326245 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9c5e8-4b55-4961-a9ce-65ac46aed99c None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:35.327091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9c5e8-4b55-4961-a9ce-65ac46aed99c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:35.327408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9c5e8-4b55-4961-a9ce-65ac46aed99c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:35.329090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9c5e8-4b55-4961-a9ce-65ac46aed99c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:35.347539 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 620/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:35.348817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28df5b-766b-47b1-9961-c53a31d5dd70 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:35.464659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28df5b-766b-47b1-9961-c53a31d5dd70 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:35.467141 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:35.506036 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff2c93-66d1-49eb-ad4d-870faf6458ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:35.506746 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff2c93-66d1-49eb-ad4d-870faf6458ab None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:35.507023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff2c93-66d1-49eb-ad4d-870faf6458ab None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:35.507325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff2c93-66d1-49eb-ad4d-870faf6458ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:35.519362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff2c93-66d1-49eb-ad4d-870faf6458ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:35.520336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff2c93-66d1-49eb-ad4d-870faf6458ab None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-92ff2c93-66d1-49eb-ad4d-870faf6458ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:15:35.532257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:35.533487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:35.534745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:35.534745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:35.534745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:15:35.534745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:15:35.534745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:15:35.534745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:15:35.534745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:15:35.534745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:15:35.534745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 22:15:35.534745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:35.539286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9c5e8-4b55-4961-a9ce-65ac46aed99c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:35.539853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 592/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:35.664730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9c5e8-4b55-4961-a9ce-65ac46aed99c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:35.706981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87363b-d588-4caa-a6ac-3c6e36916b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:35.707674 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87363b-d588-4caa-a6ac-3c6e36916b88 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:35.707998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87363b-d588-4caa-a6ac-3c6e36916b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:35.708316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87363b-d588-4caa-a6ac-3c6e36916b88 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:35.709250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87363b-d588-4caa-a6ac-3c6e36916b88 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:35.709588 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87363b-d588-4caa-a6ac-3c6e36916b88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:35.711223 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87363b-d588-4caa-a6ac-3c6e36916b88 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:35.730595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 621/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Aug 4 22:15:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:35.736953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff2c93-66d1-49eb-ad4d-870faf6458ab None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:35.853945 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff2c93-66d1-49eb-ad4d-870faf6458ab None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:35.895818 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3368f-a681-4308-9ea2-3052d0a346e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:35.899218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3368f-a681-4308-9ea2-3052d0a346e8 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:35.899218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3368f-a681-4308-9ea2-3052d0a346e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:35.899218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3368f-a681-4308-9ea2-3052d0a346e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:35.941927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:35.996471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3368f-a681-4308-9ea2-3052d0a346e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:35.998463 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3368f-a681-4308-9ea2-3052d0a346e8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:36.127117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 593/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:15:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:15:36.135097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87363b-d588-4caa-a6ac-3c6e36916b88 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:36.157870 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:36.256740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87363b-d588-4caa-a6ac-3c6e36916b88 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:36.295025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43269048-147b-4d46-8037-a8b5a5566336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:36.295669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43269048-147b-4d46-8037-a8b5a5566336 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:36.295960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43269048-147b-4d46-8037-a8b5a5566336 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:36.296226 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43269048-147b-4d46-8037-a8b5a5566336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:36.307195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43269048-147b-4d46-8037-a8b5a5566336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:36.309298 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43269048-147b-4d46-8037-a8b5a5566336 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-43269048-147b-4d46-8037-a8b5a5566336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:15:36.332765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:36.334023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:36.335237 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:15:36.335237 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:15:36.335237 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:36.335237 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:36.338607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 622/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:36.340351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3368f-a681-4308-9ea2-3052d0a346e8 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:36.416110 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:36.461083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3368f-a681-4308-9ea2-3052d0a346e8 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:36.497694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054669f-974f-4ffd-b49e-d8fa78705d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:36.498386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054669f-974f-4ffd-b49e-d8fa78705d43 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:36.498677 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054669f-974f-4ffd-b49e-d8fa78705d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:36.498894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054669f-974f-4ffd-b49e-d8fa78705d43 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:36.499590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054669f-974f-4ffd-b49e-d8fa78705d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:36.499898 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054669f-974f-4ffd-b49e-d8fa78705d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:36.501241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054669f-974f-4ffd-b49e-d8fa78705d43 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:36.514817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 594/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:15:36.521423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43269048-147b-4d46-8037-a8b5a5566336 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:36.606144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:36.645936 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43269048-147b-4d46-8037-a8b5a5566336 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:36.682456 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d755ad-f252-4bf1-91a6-dfcaa548dc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:36.683034 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d755ad-f252-4bf1-91a6-dfcaa548dc0b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:36.683314 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d755ad-f252-4bf1-91a6-dfcaa548dc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:36.683593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d755ad-f252-4bf1-91a6-dfcaa548dc0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:36.690361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d755ad-f252-4bf1-91a6-dfcaa548dc0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:36.692373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d755ad-f252-4bf1-91a6-dfcaa548dc0b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-a2d755ad-f252-4bf1-91a6-dfcaa548dc0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:15:36.704094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:36.705286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:36.706947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:15:36.706947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:15:36.706947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:15:36.706947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:15:36.706947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:15:36.706947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:15:36.706947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:15:36.706947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:36.706947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 623/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:15:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:36.713159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054669f-974f-4ffd-b49e-d8fa78705d43 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:36.818631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054669f-974f-4ffd-b49e-d8fa78705d43 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:36.842850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:36.857482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a89e0b-f7c5-4328-8088-23cfc89eaa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:36.858081 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89e0b-f7c5-4328-8088-23cfc89eaa8f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:36.858369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89e0b-f7c5-4328-8088-23cfc89eaa8f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:36.858727 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89e0b-f7c5-4328-8088-23cfc89eaa8f None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:36.859488 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a89e0b-f7c5-4328-8088-23cfc89eaa8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:36.859814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a89e0b-f7c5-4328-8088-23cfc89eaa8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:36.861230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a89e0b-f7c5-4328-8088-23cfc89eaa8f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:36.875154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 595/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:36.882027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d755ad-f252-4bf1-91a6-dfcaa548dc0b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:36.993411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d755ad-f252-4bf1-91a6-dfcaa548dc0b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:37.023960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:37.030677 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23f615-1b12-420d-9631-0f2efad83abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:37.031338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23f615-1b12-420d-9631-0f2efad83abb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:37.031625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23f615-1b12-420d-9631-0f2efad83abb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:37.031902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23f615-1b12-420d-9631-0f2efad83abb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:37.032684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23f615-1b12-420d-9631-0f2efad83abb None admin] RBAC: Adding query filter params (role.id=aed7c83a35d741538254f3d4775f4a0e, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=94b2448489cc4ad1a6fd3096ebd3f746) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:37.032998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23f615-1b12-420d-9631-0f2efad83abb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:37.034495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23f615-1b12-420d-9631-0f2efad83abb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:37.040288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 624/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:15:36 2022] GET /identity/v3/role_assignments?user.id=94b2448489cc4ad1a6fd3096ebd3f746&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=aed7c83a35d741538254f3d4775f4a0e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:39.038224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c80a1-d4a8-4a9a-8d74-08dd8d96e5de None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:39.038790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c80a1-d4a8-4a9a-8d74-08dd8d96e5de None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:39.038790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c80a1-d4a8-4a9a-8d74-08dd8d96e5de None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:39.040185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 596/1220] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:15:39.045775 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4617-d789-45a6-9fa4-c764ef9baea4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:39.046252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4617-d789-45a6-9fa4-c764ef9baea4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:39.046389 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4617-d789-45a6-9fa4-c764ef9baea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:39.064708 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-032f4617-d789-45a6-9fa4-c764ef9baea4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:15:39.066667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-032f4617-d789-45a6-9fa4-c764ef9baea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:15:39.145695 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 625/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:15:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 22:15:39.167878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c80a1-d4a8-4a9a-8d74-08dd8d96e5de None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:39.281441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c80a1-d4a8-4a9a-8d74-08dd8d96e5de None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:39.330184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d6e55-b3c0-4ec5-a03e-1faa0c0cc5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:39.330975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d6e55-b3c0-4ec5-a03e-1faa0c0cc5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:39.331337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d6e55-b3c0-4ec5-a03e-1faa0c0cc5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:39.331759 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d6e55-b3c0-4ec5-a03e-1faa0c0cc5d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:39.343998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d6e55-b3c0-4ec5-a03e-1faa0c0cc5d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-dc6d6e55-b3c0-4ec5-a03e-1faa0c0cc5d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:15:39.350185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:39.351441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:39.352741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:39.352741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:39.352741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:39.352741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:39.352741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:15:39.352741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:15:39.352741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:15:39.352741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:15:39.352741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:15:39.352741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:15:39.352741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:15:39.352741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:39.352741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 597/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:15:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:39.358012 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f4617-d789-45a6-9fa4-c764ef9baea4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:39.472295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f4617-d789-45a6-9fa4-c764ef9baea4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:39.499892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:39.511309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f224f80-989b-4362-98b2-798e5e10d513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:39.511960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f224f80-989b-4362-98b2-798e5e10d513 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:39.512244 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f224f80-989b-4362-98b2-798e5e10d513 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:39.512521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f224f80-989b-4362-98b2-798e5e10d513 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:39.513230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f224f80-989b-4362-98b2-798e5e10d513 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:39.513540 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f224f80-989b-4362-98b2-798e5e10d513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:39.515024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f224f80-989b-4362-98b2-798e5e10d513 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:39.523319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 626/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:15:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:39.529028 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d6e55-b3c0-4ec5-a03e-1faa0c0cc5d7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:39.578081 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:39.640589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d6e55-b3c0-4ec5-a03e-1faa0c0cc5d7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:39.678338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f5171-46ea-4118-9fbc-bd956f5ba62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:39.679008 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f5171-46ea-4118-9fbc-bd956f5ba62d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:39.679289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f5171-46ea-4118-9fbc-bd956f5ba62d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:39.679561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f5171-46ea-4118-9fbc-bd956f5ba62d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:39.689502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f5171-46ea-4118-9fbc-bd956f5ba62d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:39.691004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f5171-46ea-4118-9fbc-bd956f5ba62d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-657f5171-46ea-4118-9fbc-bd956f5ba62d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:15:39.705888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:39.707900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:39.708858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:15:39.708858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:15:39.708858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:39.708858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:39.708858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 598/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:39.713273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f224f80-989b-4362-98b2-798e5e10d513 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:39.821895 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f224f80-989b-4362-98b2-798e5e10d513 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:39.857649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3fe0e-9bb7-4651-9853-c08a588075af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:39.858261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3fe0e-9bb7-4651-9853-c08a588075af None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:39.858575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3fe0e-9bb7-4651-9853-c08a588075af None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:39.858847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3fe0e-9bb7-4651-9853-c08a588075af None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:39.859528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3fe0e-9bb7-4651-9853-c08a588075af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:39.859831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3fe0e-9bb7-4651-9853-c08a588075af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:39.861230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3fe0e-9bb7-4651-9853-c08a588075af None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:39.873015 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 627/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:39.879142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f5171-46ea-4118-9fbc-bd956f5ba62d None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:39.976622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:39.983847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f5171-46ea-4118-9fbc-bd956f5ba62d None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:40.020723 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106353b-5623-4e37-b1c1-9219f0faf17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:40.021696 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106353b-5623-4e37-b1c1-9219f0faf17f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:40.021977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106353b-5623-4e37-b1c1-9219f0faf17f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:40.022334 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106353b-5623-4e37-b1c1-9219f0faf17f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:40.030756 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106353b-5623-4e37-b1c1-9219f0faf17f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:40.032363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106353b-5623-4e37-b1c1-9219f0faf17f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d106353b-5623-4e37-b1c1-9219f0faf17f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:15:40.044792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:40.046335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:40.047325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:40.047325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:40.047325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:15:40.047325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:15:40.047325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:15:40.047325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:15:40.047325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:15:40.047325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:15:40.047325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 22:15:40.047325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:40.047325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 599/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:40.052706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3fe0e-9bb7-4651-9853-c08a588075af None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:40.105674 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:40.177759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3fe0e-9bb7-4651-9853-c08a588075af None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:40.213126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4b779-1a14-4c66-ac19-2bad0c505ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:40.213748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4b779-1a14-4c66-ac19-2bad0c505ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:40.214038 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4b779-1a14-4c66-ac19-2bad0c505ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:40.214318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4b779-1a14-4c66-ac19-2bad0c505ad8 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:40.215267 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4b779-1a14-4c66-ac19-2bad0c505ad8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:40.215586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4b779-1a14-4c66-ac19-2bad0c505ad8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:40.217265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4b779-1a14-4c66-ac19-2bad0c505ad8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:40.236006 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 628/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Aug 4 22:15:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:40.243195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106353b-5623-4e37-b1c1-9219f0faf17f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:40.358080 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106353b-5623-4e37-b1c1-9219f0faf17f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:40.391703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482fc0c-fdcb-49fc-8975-abcd9bbcf8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:40.392340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482fc0c-fdcb-49fc-8975-abcd9bbcf8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:40.392615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482fc0c-fdcb-49fc-8975-abcd9bbcf8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:40.392879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482fc0c-fdcb-49fc-8975-abcd9bbcf8b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:40.403328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482fc0c-fdcb-49fc-8975-abcd9bbcf8b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:40.404748 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482fc0c-fdcb-49fc-8975-abcd9bbcf8b7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-a482fc0c-fdcb-49fc-8975-abcd9bbcf8b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:15:40.421309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:40.422439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:40.423546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:15:40.423546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:15:40.423546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:40.423546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:40.423546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 600/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:40.428945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4b779-1a14-4c66-ac19-2bad0c505ad8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:40.543528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4b779-1a14-4c66-ac19-2bad0c505ad8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:40.546249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:40.582776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66887784-8eba-4d56-af57-2ee7b3b12e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:40.583475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66887784-8eba-4d56-af57-2ee7b3b12e5e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:40.583774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66887784-8eba-4d56-af57-2ee7b3b12e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:40.584052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66887784-8eba-4d56-af57-2ee7b3b12e5e None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:40.584792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66887784-8eba-4d56-af57-2ee7b3b12e5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:40.585099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66887784-8eba-4d56-af57-2ee7b3b12e5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:40.586624 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66887784-8eba-4d56-af57-2ee7b3b12e5e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:40.600047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 629/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:40.606090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482fc0c-fdcb-49fc-8975-abcd9bbcf8b7 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:40.618281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:40.724632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482fc0c-fdcb-49fc-8975-abcd9bbcf8b7 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:40.766561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3f513-be52-4fe1-a76b-eb35c7a61ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:40.767265 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3f513-be52-4fe1-a76b-eb35c7a61ebb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:40.767574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3f513-be52-4fe1-a76b-eb35c7a61ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:40.767821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3f513-be52-4fe1-a76b-eb35c7a61ebb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:40.776339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3f513-be52-4fe1-a76b-eb35c7a61ebb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:40.777890 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3f513-be52-4fe1-a76b-eb35c7a61ebb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-7aa3f513-be52-4fe1-a76b-eb35c7a61ebb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:15:40.791049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:40.792237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:40.793437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:15:40.793437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:15:40.793437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:15:40.793437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:15:40.793437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:15:40.793437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:15:40.793437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:15:40.793437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:40.793437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 601/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:15:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:40.799063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66887784-8eba-4d56-af57-2ee7b3b12e5e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:40.917656 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66887784-8eba-4d56-af57-2ee7b3b12e5e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:40.958020 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616ad8a-6f38-4804-9a74-744262e56df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:40.958679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616ad8a-6f38-4804-9a74-744262e56df1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:40.958964 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616ad8a-6f38-4804-9a74-744262e56df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:40.959241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616ad8a-6f38-4804-9a74-744262e56df1 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:40.959998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616ad8a-6f38-4804-9a74-744262e56df1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:40.960312 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616ad8a-6f38-4804-9a74-744262e56df1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:40.961942 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616ad8a-6f38-4804-9a74-744262e56df1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:40.978877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 630/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:15:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:40.981838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3f513-be52-4fe1-a76b-eb35c7a61ebb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:41.053429 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:41.094070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3f513-be52-4fe1-a76b-eb35c7a61ebb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:41.133561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23578968-f8f9-4f9c-9a99-071332ddf4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:41.134240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578968-f8f9-4f9c-9a99-071332ddf4c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:41.134545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578968-f8f9-4f9c-9a99-071332ddf4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:41.134820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23578968-f8f9-4f9c-9a99-071332ddf4c2 None admin] PATH_INFO: `/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/94b2448489cc4ad1a6fd3096ebd3f746/roles/aed7c83a35d741538254f3d4775f4a0e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:41.153769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23578968-f8f9-4f9c-9a99-071332ddf4c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe696ab97a143959fa7e33cda768cfc, user_id=94b2448489cc4ad1a6fd3096ebd3f746, role_id=aed7c83a35d741538254f3d4775f4a0e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:41.155199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23578968-f8f9-4f9c-9a99-071332ddf4c2 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:41.168360 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 602/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:15:40 2022] PUT /identity/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/94b2448489cc4ad1a6fd3096ebd3f746/roles/aed7c83a35d741538254f3d4775f4a0e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:15:43.373401 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec32a2e-7ee0-4af9-a5ad-c41c9d4ce191 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:43.374068 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec32a2e-7ee0-4af9-a5ad-c41c9d4ce191 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:43.374068 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec32a2e-7ee0-4af9-a5ad-c41c9d4ce191 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:43.375547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 631/1233] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:15:43.382269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4c913-e300-4659-abbe-06da6ef2c617 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:43.382813 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4c913-e300-4659-abbe-06da6ef2c617 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:43.382915 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4c913-e300-4659-abbe-06da6ef2c617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:43.402620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-3ca4c913-e300-4659-abbe-06da6ef2c617 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:15:43.404085 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3ca4c913-e300-4659-abbe-06da6ef2c617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:15:43.480996 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 603/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:15:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:15:43.507654 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec32a2e-7ee0-4af9-a5ad-c41c9d4ce191 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:43.538022 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:43.625998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec32a2e-7ee0-4af9-a5ad-c41c9d4ce191 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:43.663627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90221b0-b427-4ac2-b7f5-2c605b3c24aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:43.664262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90221b0-b427-4ac2-b7f5-2c605b3c24aa None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:43.664541 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90221b0-b427-4ac2-b7f5-2c605b3c24aa None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:43.664810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90221b0-b427-4ac2-b7f5-2c605b3c24aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:43.675852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90221b0-b427-4ac2-b7f5-2c605b3c24aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b90221b0-b427-4ac2-b7f5-2c605b3c24aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:15:43.680711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:43.681862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:43.682977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:43.682977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:43.682977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:43.682977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:43.682977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:15:43.682977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:15:43.682977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:15:43.682977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:15:43.682977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:15:43.682977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:15:43.682977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 04 22:15:43.682977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:43.682977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 632/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Thu Aug 4 22:15:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:43.688255 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4c913-e300-4659-abbe-06da6ef2c617 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:43.736957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:43.793044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4c913-e300-4659-abbe-06da6ef2c617 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:43.830269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18f7ae-ce7a-4882-be05-b2078cddc0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:43.830926 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18f7ae-ce7a-4882-be05-b2078cddc0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:43.831730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18f7ae-ce7a-4882-be05-b2078cddc0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:43.832064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18f7ae-ce7a-4882-be05-b2078cddc0d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:43.832811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18f7ae-ce7a-4882-be05-b2078cddc0d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:43.833137 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18f7ae-ce7a-4882-be05-b2078cddc0d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:43.834619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18f7ae-ce7a-4882-be05-b2078cddc0d5 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:43.843346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 604/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Thu Aug 4 22:15:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:43.849852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90221b0-b427-4ac2-b7f5-2c605b3c24aa None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:43.936128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:43.952674 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90221b0-b427-4ac2-b7f5-2c605b3c24aa None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:43.989262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b28218-0c20-4a7d-a5e1-4f6990538811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:43.989950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28218-0c20-4a7d-a5e1-4f6990538811 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:43.990230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28218-0c20-4a7d-a5e1-4f6990538811 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:43.990540 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b28218-0c20-4a7d-a5e1-4f6990538811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:44.000716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b28218-0c20-4a7d-a5e1-4f6990538811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:44.002193 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b28218-0c20-4a7d-a5e1-4f6990538811 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-90b28218-0c20-4a7d-a5e1-4f6990538811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:15:44.018014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:44.019791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:44.020725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:15:44.020725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:15:44.020725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:44.020725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:44.025983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 633/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:44.026917 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18f7ae-ce7a-4882-be05-b2078cddc0d5 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:44.133754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18f7ae-ce7a-4882-be05-b2078cddc0d5 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:44.144510 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:44.173360 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315620ff-84c8-4a19-9a5a-f24229098f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:44.173983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315620ff-84c8-4a19-9a5a-f24229098f3a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:44.174256 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315620ff-84c8-4a19-9a5a-f24229098f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:44.174571 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315620ff-84c8-4a19-9a5a-f24229098f3a None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:44.175267 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315620ff-84c8-4a19-9a5a-f24229098f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:44.175665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315620ff-84c8-4a19-9a5a-f24229098f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:44.177005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315620ff-84c8-4a19-9a5a-f24229098f3a None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:44.188871 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 605/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:15:44.195334 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b28218-0c20-4a7d-a5e1-4f6990538811 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:44.304921 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b28218-0c20-4a7d-a5e1-4f6990538811 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:44.345801 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20040d61-6801-4121-a32c-d234a8316436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:44.346533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20040d61-6801-4121-a32c-d234a8316436 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:44.346941 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20040d61-6801-4121-a32c-d234a8316436 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:44.347190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20040d61-6801-4121-a32c-d234a8316436 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:44.350532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:44.356358 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20040d61-6801-4121-a32c-d234a8316436 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:44.358144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20040d61-6801-4121-a32c-d234a8316436 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-20040d61-6801-4121-a32c-d234a8316436 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:15:44.370163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:44.377179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:44.379165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:44.379165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:44.379165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:15:44.379165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:15:44.379165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:15:44.379165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:15:44.379165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:15:44.379165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:15:44.379165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 22:15:44.379165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:44.379165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 634/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:44.380106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315620ff-84c8-4a19-9a5a-f24229098f3a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:44.487859 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315620ff-84c8-4a19-9a5a-f24229098f3a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:44.523697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d243c8-373b-4330-9172-25983e061fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:44.524313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d243c8-373b-4330-9172-25983e061fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:44.524642 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d243c8-373b-4330-9172-25983e061fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:44.524860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d243c8-373b-4330-9172-25983e061fa1 None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:44.525646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d243c8-373b-4330-9172-25983e061fa1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:44.525939 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d243c8-373b-4330-9172-25983e061fa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:44.527383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d243c8-373b-4330-9172-25983e061fa1 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:44.545539 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 606/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Aug 4 22:15:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:44.551814 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20040d61-6801-4121-a32c-d234a8316436 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:44.662922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20040d61-6801-4121-a32c-d234a8316436 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:44.700815 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d7f96-20ee-49e4-9cd1-6c43d393c208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:44.701527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7f96-20ee-49e4-9cd1-6c43d393c208 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:44.701837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7f96-20ee-49e4-9cd1-6c43d393c208 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:44.702119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7f96-20ee-49e4-9cd1-6c43d393c208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:44.772876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:44.779832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d7f96-20ee-49e4-9cd1-6c43d393c208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:44.781400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d7f96-20ee-49e4-9cd1-6c43d393c208 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:44.890728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 635/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:15:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:15:44.897394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d243c8-373b-4330-9172-25983e061fa1 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:44.928679 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:45.006872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d243c8-373b-4330-9172-25983e061fa1 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:45.042465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f6a1c-4818-4089-8d98-5f4ff176bfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:45.043034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f6a1c-4818-4089-8d98-5f4ff176bfdb None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:45.043311 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f6a1c-4818-4089-8d98-5f4ff176bfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:45.043605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f6a1c-4818-4089-8d98-5f4ff176bfdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:45.053746 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f6a1c-4818-4089-8d98-5f4ff176bfdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:45.055207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f6a1c-4818-4089-8d98-5f4ff176bfdb None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-141f6a1c-4818-4089-8d98-5f4ff176bfdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:15:45.070319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:45.071477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:45.072630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:15:45.072630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:15:45.072630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:45.072630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:45.072630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 607/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:45.079219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d7f96-20ee-49e4-9cd1-6c43d393c208 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:45.193641 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:45.202646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d7f96-20ee-49e4-9cd1-6c43d393c208 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:45.239622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a427e-5154-419d-8cf0-412e4ef0152d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:45.240239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a427e-5154-419d-8cf0-412e4ef0152d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:45.240514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a427e-5154-419d-8cf0-412e4ef0152d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:45.240781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a427e-5154-419d-8cf0-412e4ef0152d None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:45.241466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a427e-5154-419d-8cf0-412e4ef0152d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:45.241766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a427e-5154-419d-8cf0-412e4ef0152d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:45.243358 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a427e-5154-419d-8cf0-412e4ef0152d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:45.255039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 636/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:15:45.261361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f6a1c-4818-4089-8d98-5f4ff176bfdb None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:45.354771 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:45.381563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f6a1c-4818-4089-8d98-5f4ff176bfdb None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:45.417661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886d9e3-949c-4427-9b12-bc13b5f8dd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:45.418329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886d9e3-949c-4427-9b12-bc13b5f8dd43 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:45.418642 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886d9e3-949c-4427-9b12-bc13b5f8dd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:45.418918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886d9e3-949c-4427-9b12-bc13b5f8dd43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:45.427097 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886d9e3-949c-4427-9b12-bc13b5f8dd43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:45.428660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886d9e3-949c-4427-9b12-bc13b5f8dd43 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d886d9e3-949c-4427-9b12-bc13b5f8dd43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:15:45.440180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:45.441851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:45.442823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:15:45.442823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:15:45.442823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:15:45.442823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:15:45.442823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:15:45.442823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:15:45.442823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:15:45.442823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:45.442823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 608/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:15:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 04 22:15:45.448140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a427e-5154-419d-8cf0-412e4ef0152d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:45.553778 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a427e-5154-419d-8cf0-412e4ef0152d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:45.592857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09b50a-3d65-4ba2-ae58-64c9ee4f12e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:45.593573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09b50a-3d65-4ba2-ae58-64c9ee4f12e1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:45.593861 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09b50a-3d65-4ba2-ae58-64c9ee4f12e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:45.594265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09b50a-3d65-4ba2-ae58-64c9ee4f12e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:45.595016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09b50a-3d65-4ba2-ae58-64c9ee4f12e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:45.595329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09b50a-3d65-4ba2-ae58-64c9ee4f12e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:45.596891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09b50a-3d65-4ba2-ae58-64c9ee4f12e1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:45.611048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 637/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:15:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:45.616981 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886d9e3-949c-4427-9b12-bc13b5f8dd43 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:45.730546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886d9e3-949c-4427-9b12-bc13b5f8dd43 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:45.765771 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c93d90-207c-47f8-9c82-297b2ee3f30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:45.766462 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c93d90-207c-47f8-9c82-297b2ee3f30e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:45.766745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c93d90-207c-47f8-9c82-297b2ee3f30e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:45.767040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c93d90-207c-47f8-9c82-297b2ee3f30e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:45.767825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c93d90-207c-47f8-9c82-297b2ee3f30e None admin] RBAC: Adding query filter params (role.id=aed7c83a35d741538254f3d4775f4a0e, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=94b2448489cc4ad1a6fd3096ebd3f746) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:45.768138 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c93d90-207c-47f8-9c82-297b2ee3f30e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:45.769540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c93d90-207c-47f8-9c82-297b2ee3f30e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:45.775596 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 609/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:15:45 2022] GET /identity/v3/role_assignments?user.id=94b2448489cc4ad1a6fd3096ebd3f746&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=aed7c83a35d741538254f3d4775f4a0e => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:47.978688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7b39e-c68f-4b81-ae61-5554f3f4790c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:47.979254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7b39e-c68f-4b81-ae61-5554f3f4790c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:47.979254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7b39e-c68f-4b81-ae61-5554f3f4790c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:47.980596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 638/1247] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:15:47.986442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192affc4-4828-454c-bf8c-9f21e8e54b01 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:47.986891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192affc4-4828-454c-bf8c-9f21e8e54b01 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:47.987139 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192affc4-4828-454c-bf8c-9f21e8e54b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:47.994352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:48.007951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-192affc4-4828-454c-bf8c-9f21e8e54b01 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:15:48.009198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-192affc4-4828-454c-bf8c-9f21e8e54b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:15:48.082365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 610/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:15:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:15:48.115373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7b39e-c68f-4b81-ae61-5554f3f4790c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:48.134733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:48.237775 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7b39e-c68f-4b81-ae61-5554f3f4790c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:48.276191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cacd21-598d-49c6-8309-1a82ed589660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:48.276905 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacd21-598d-49c6-8309-1a82ed589660 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:48.277182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacd21-598d-49c6-8309-1a82ed589660 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:48.277456 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacd21-598d-49c6-8309-1a82ed589660 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:48.288050 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cacd21-598d-49c6-8309-1a82ed589660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-02cacd21-598d-49c6-8309-1a82ed589660 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:15:48.293008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:48.294072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:48.295031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:48.295031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:48.295031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:48.295031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:48.295031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:15:48.295031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:15:48.295031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:15:48.295031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:15:48.295031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:15:48.295031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:15:48.295031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:15:48.295031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:48.295031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 639/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:15:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:48.300965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192affc4-4828-454c-bf8c-9f21e8e54b01 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:48.407317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192affc4-4828-454c-bf8c-9f21e8e54b01 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:48.443425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:48.451778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777ed3e-991f-4956-b855-bc45b0b4c0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:48.452419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ed3e-991f-4956-b855-bc45b0b4c0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:48.452703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ed3e-991f-4956-b855-bc45b0b4c0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:48.452979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ed3e-991f-4956-b855-bc45b0b4c0a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:48.454009 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777ed3e-991f-4956-b855-bc45b0b4c0a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:48.454433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777ed3e-991f-4956-b855-bc45b0b4c0a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:48.455883 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777ed3e-991f-4956-b855-bc45b0b4c0a3 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:48.466098 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 611/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:15:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:48.471766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cacd21-598d-49c6-8309-1a82ed589660 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:48.560208 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:48.586845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cacd21-598d-49c6-8309-1a82ed589660 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:48.623598 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580e250-a8a0-49db-9000-7907168bb3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:48.624292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580e250-a8a0-49db-9000-7907168bb3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:48.624665 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580e250-a8a0-49db-9000-7907168bb3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:48.624948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580e250-a8a0-49db-9000-7907168bb3d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:48.636894 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580e250-a8a0-49db-9000-7907168bb3d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:48.638534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580e250-a8a0-49db-9000-7907168bb3d4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-3580e250-a8a0-49db-9000-7907168bb3d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:15:48.656333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:48.657411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:48.663266 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:15:48.663266 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:15:48.663266 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:48.663266 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:48.663266 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 640/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:48.663620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777ed3e-991f-4956-b855-bc45b0b4c0a3 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:48.786295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777ed3e-991f-4956-b855-bc45b0b4c0a3 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:48.824812 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b006800-a9d4-4607-8874-22c2202211ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:48.825472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b006800-a9d4-4607-8874-22c2202211ca None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:48.825756 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b006800-a9d4-4607-8874-22c2202211ca None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:48.826030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b006800-a9d4-4607-8874-22c2202211ca None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:48.826834 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b006800-a9d4-4607-8874-22c2202211ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:48.827145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b006800-a9d4-4607-8874-22c2202211ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:48.828589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b006800-a9d4-4607-8874-22c2202211ca None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:48.843065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 612/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:48.849287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580e250-a8a0-49db-9000-7907168bb3d4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:48.964203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580e250-a8a0-49db-9000-7907168bb3d4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:48.994155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:49.004003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f235a-bae0-4042-a9af-f7b732a8dc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:49.004678 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f235a-bae0-4042-a9af-f7b732a8dc7a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:49.004962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f235a-bae0-4042-a9af-f7b732a8dc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:49.005239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f235a-bae0-4042-a9af-f7b732a8dc7a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:49.013448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f235a-bae0-4042-a9af-f7b732a8dc7a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:49.014955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f235a-bae0-4042-a9af-f7b732a8dc7a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-114f235a-bae0-4042-a9af-f7b732a8dc7a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:15:49.027024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:49.028160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:49.029268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:49.029268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:49.029268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:15:49.029268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:15:49.029268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:15:49.029268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:15:49.029268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:15:49.029268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:15:49.029268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 22:15:49.029268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:49.029268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 641/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:49.034363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b006800-a9d4-4607-8874-22c2202211ca None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:49.095614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:49.147878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b006800-a9d4-4607-8874-22c2202211ca None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:49.188918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d14c9-34e4-44ed-b5fe-1f7ff4a8196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:49.189545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d14c9-34e4-44ed-b5fe-1f7ff4a8196c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:49.189828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d14c9-34e4-44ed-b5fe-1f7ff4a8196c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:49.190150 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d14c9-34e4-44ed-b5fe-1f7ff4a8196c None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:49.191090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d14c9-34e4-44ed-b5fe-1f7ff4a8196c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:49.191446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d14c9-34e4-44ed-b5fe-1f7ff4a8196c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:49.193176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d14c9-34e4-44ed-b5fe-1f7ff4a8196c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:49.211702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 613/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Aug 4 22:15:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:49.217878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f235a-bae0-4042-a9af-f7b732a8dc7a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:49.336620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f235a-bae0-4042-a9af-f7b732a8dc7a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:49.381645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda0dfe-92ec-4d29-85b9-adf133707465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:49.382637 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda0dfe-92ec-4d29-85b9-adf133707465 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:49.383123 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda0dfe-92ec-4d29-85b9-adf133707465 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:49.383468 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda0dfe-92ec-4d29-85b9-adf133707465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:49.452533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:49.469752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda0dfe-92ec-4d29-85b9-adf133707465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:49.471323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda0dfe-92ec-4d29-85b9-adf133707465 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:49.583973 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 642/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:15:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:15:49.590030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d14c9-34e4-44ed-b5fe-1f7ff4a8196c None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:49.708946 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d14c9-34e4-44ed-b5fe-1f7ff4a8196c None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:49.725169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:49.750238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c6420-0ec1-4ad9-b562-ee52218ef4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:49.751027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6420-0ec1-4ad9-b562-ee52218ef4fe None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:49.751307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6420-0ec1-4ad9-b562-ee52218ef4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:49.751659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6420-0ec1-4ad9-b562-ee52218ef4fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:49.764223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c6420-0ec1-4ad9-b562-ee52218ef4fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:49.765812 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c6420-0ec1-4ad9-b562-ee52218ef4fe None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-839c6420-0ec1-4ad9-b562-ee52218ef4fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:15:49.782579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:49.783721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:49.790617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:15:49.790617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:15:49.790617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:49.790617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:49.790617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 614/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:49.790938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda0dfe-92ec-4d29-85b9-adf133707465 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:49.895172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:49.908031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda0dfe-92ec-4d29-85b9-adf133707465 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:49.946277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ddffc-45ae-408f-a458-955a49e4acb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:49.946934 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ddffc-45ae-408f-a458-955a49e4acb3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:49.947230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ddffc-45ae-408f-a458-955a49e4acb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:49.947492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ddffc-45ae-408f-a458-955a49e4acb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:49.948188 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ddffc-45ae-408f-a458-955a49e4acb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:49.948529 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ddffc-45ae-408f-a458-955a49e4acb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:49.950277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ddffc-45ae-408f-a458-955a49e4acb3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:49.965359 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 643/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:49.971993 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c6420-0ec1-4ad9-b562-ee52218ef4fe None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:50.083475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c6420-0ec1-4ad9-b562-ee52218ef4fe None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:50.118200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d299ba5-754c-497f-9bae-3236b0a45701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:50.118938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d299ba5-754c-497f-9bae-3236b0a45701 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:50.119208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d299ba5-754c-497f-9bae-3236b0a45701 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:50.119478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d299ba5-754c-497f-9bae-3236b0a45701 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:50.127095 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d299ba5-754c-497f-9bae-3236b0a45701 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:50.129078 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d299ba5-754c-497f-9bae-3236b0a45701 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-9d299ba5-754c-497f-9bae-3236b0a45701 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:15:50.140732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:50.148460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:50.149655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:15:50.149655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:15:50.149655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:15:50.149655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:15:50.149655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:15:50.149655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:15:50.149655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:15:50.149655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:50.149655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 615/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:15:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:50.150364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ddffc-45ae-408f-a458-955a49e4acb3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:50.260437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ddffc-45ae-408f-a458-955a49e4acb3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:50.295736 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b14831-c16c-4191-b4d8-7cd8ff5eafd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:50.296451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b14831-c16c-4191-b4d8-7cd8ff5eafd4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:50.296738 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b14831-c16c-4191-b4d8-7cd8ff5eafd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:50.297039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b14831-c16c-4191-b4d8-7cd8ff5eafd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:50.297864 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b14831-c16c-4191-b4d8-7cd8ff5eafd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:50.298199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b14831-c16c-4191-b4d8-7cd8ff5eafd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:50.299709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b14831-c16c-4191-b4d8-7cd8ff5eafd4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:50.313704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 644/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:50.320456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d299ba5-754c-497f-9bae-3236b0a45701 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:50.349833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:50.434387 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d299ba5-754c-497f-9bae-3236b0a45701 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:50.477895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88ad61-fbe6-442b-b298-563ae5882072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:50.478537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88ad61-fbe6-442b-b298-563ae5882072 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:50.478820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88ad61-fbe6-442b-b298-563ae5882072 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:50.479094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88ad61-fbe6-442b-b298-563ae5882072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:50.479878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88ad61-fbe6-442b-b298-563ae5882072 None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=94b2448489cc4ad1a6fd3096ebd3f746) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:50.480189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88ad61-fbe6-442b-b298-563ae5882072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:50.481602 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88ad61-fbe6-442b-b298-563ae5882072 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:50.487820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 616/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:15:50 2022] GET /identity/v3/role_assignments?user.id=94b2448489cc4ad1a6fd3096ebd3f746&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=0053c24ce06147938dbb61657a531c94 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:52.473069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380175-ec2c-438d-9943-b126a18af4ab None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:52.473518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380175-ec2c-438d-9943-b126a18af4ab None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:52.473649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380175-ec2c-438d-9943-b126a18af4ab None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:52.475153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 645/1261] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:15:52.480301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7a5d9-7153-4487-b076-6bbb5e31a3b4 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:52.480707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7a5d9-7153-4487-b076-6bbb5e31a3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:52.480857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7a5d9-7153-4487-b076-6bbb5e31a3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:52.499259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-ccd7a5d9-7153-4487-b076-6bbb5e31a3b4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:15:52.500432 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ccd7a5d9-7153-4487-b076-6bbb5e31a3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:15:52.564326 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 617/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:15:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:15:52.586948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a380175-ec2c-438d-9943-b126a18af4ab None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:52.598218 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:52.686848 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a380175-ec2c-438d-9943-b126a18af4ab None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:52.720201 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8663be-ce33-4cee-9abf-122433547527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:52.720766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8663be-ce33-4cee-9abf-122433547527 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:52.721046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8663be-ce33-4cee-9abf-122433547527 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:52.721317 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8663be-ce33-4cee-9abf-122433547527 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:52.731846 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8663be-ce33-4cee-9abf-122433547527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0d8663be-ce33-4cee-9abf-122433547527 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:15:52.736657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:52.737732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:52.738792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:52.738792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:52.738792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:52.738792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:52.738792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:15:52.738792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:15:52.738792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:15:52.738792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:15:52.738792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:15:52.738792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:15:52.738792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:15:52.738792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:52.738792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 646/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:15:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:52.745681 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7a5d9-7153-4487-b076-6bbb5e31a3b4 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:52.763363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:52.840620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7a5d9-7153-4487-b076-6bbb5e31a3b4 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:52.873214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be5532-a0d4-4b9d-a138-93bee7e1030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:52.873815 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be5532-a0d4-4b9d-a138-93bee7e1030f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:52.874095 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be5532-a0d4-4b9d-a138-93bee7e1030f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:52.874369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be5532-a0d4-4b9d-a138-93bee7e1030f None admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:52.875111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be5532-a0d4-4b9d-a138-93bee7e1030f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:52.875419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be5532-a0d4-4b9d-a138-93bee7e1030f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:52.876775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be5532-a0d4-4b9d-a138-93bee7e1030f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:52.885642 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 618/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:15:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:52.891682 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8663be-ce33-4cee-9abf-122433547527 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:52.957275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:52.989276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8663be-ce33-4cee-9abf-122433547527 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:53.022449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8eff63-45a3-4212-af60-f7dd6257d31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:53.023074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eff63-45a3-4212-af60-f7dd6257d31b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:53.023357 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eff63-45a3-4212-af60-f7dd6257d31b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:53.023630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eff63-45a3-4212-af60-f7dd6257d31b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:53.033296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8eff63-45a3-4212-af60-f7dd6257d31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:53.034802 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8eff63-45a3-4212-af60-f7dd6257d31b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-db8eff63-45a3-4212-af60-f7dd6257d31b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:15:53.048970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:53.050021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:53.051199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:15:53.051199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:15:53.051199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:53.051199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:53.051199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 647/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:53.055777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be5532-a0d4-4b9d-a138-93bee7e1030f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:53.145912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:53.165110 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be5532-a0d4-4b9d-a138-93bee7e1030f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:53.197465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae76d5-c84f-49a0-8f99-a6c4d5220b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:53.198075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae76d5-c84f-49a0-8f99-a6c4d5220b08 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:53.198359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae76d5-c84f-49a0-8f99-a6c4d5220b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:53.198657 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae76d5-c84f-49a0-8f99-a6c4d5220b08 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:53.199340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae76d5-c84f-49a0-8f99-a6c4d5220b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:53.199645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae76d5-c84f-49a0-8f99-a6c4d5220b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:53.200996 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae76d5-c84f-49a0-8f99-a6c4d5220b08 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:53.213106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 619/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:53.218805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8eff63-45a3-4212-af60-f7dd6257d31b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:53.314985 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8eff63-45a3-4212-af60-f7dd6257d31b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:53.334489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:53.348007 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cf0b6-fd81-418c-968c-dd38cddd6075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:53.348660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf0b6-fd81-418c-968c-dd38cddd6075 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:53.348939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf0b6-fd81-418c-968c-dd38cddd6075 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:53.349212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf0b6-fd81-418c-968c-dd38cddd6075 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:53.356403 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cf0b6-fd81-418c-968c-dd38cddd6075 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:53.357850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cf0b6-fd81-418c-968c-dd38cddd6075 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-4d6cf0b6-fd81-418c-968c-dd38cddd6075 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:15:53.369195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:53.370277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:53.371440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:53.371440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:53.371440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:15:53.371440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:15:53.371440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:15:53.371440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:15:53.371440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:15:53.371440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:15:53.371440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 22:15:53.371440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:53.371440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 648/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:53.376305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae76d5-c84f-49a0-8f99-a6c4d5220b08 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:53.478428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae76d5-c84f-49a0-8f99-a6c4d5220b08 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:53.512512 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9224e4-89c8-408f-8adb-17dcd6349b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:53.513120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9224e4-89c8-408f-8adb-17dcd6349b2e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:53.513403 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9224e4-89c8-408f-8adb-17dcd6349b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:53.513678 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9224e4-89c8-408f-8adb-17dcd6349b2e None admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:53.514489 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9224e4-89c8-408f-8adb-17dcd6349b2e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:53.514803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9224e4-89c8-408f-8adb-17dcd6349b2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:53.516226 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9224e4-89c8-408f-8adb-17dcd6349b2e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:53.524663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:53.533208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 620/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Aug 4 22:15:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:53.538955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cf0b6-fd81-418c-968c-dd38cddd6075 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:53.636436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cf0b6-fd81-418c-968c-dd38cddd6075 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:53.668549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e4a4c-91ee-4ea7-86ab-23bb958473ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:53.669161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e4a4c-91ee-4ea7-86ab-23bb958473ae None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:53.669440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e4a4c-91ee-4ea7-86ab-23bb958473ae None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:53.669713 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e4a4c-91ee-4ea7-86ab-23bb958473ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:53.680348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e4a4c-91ee-4ea7-86ab-23bb958473ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:53.681801 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e4a4c-91ee-4ea7-86ab-23bb958473ae None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-8c7e4a4c-91ee-4ea7-86ab-23bb958473ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:15:53.695440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:53.696495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:53.697457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:15:53.697457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:15:53.697457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:53.697457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:53.697457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 649/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:53.702288 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9224e4-89c8-408f-8adb-17dcd6349b2e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:53.797886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9224e4-89c8-408f-8adb-17dcd6349b2e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:53.831287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860fd89-9916-4e86-88dc-2ecec36bb01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:53.831894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860fd89-9916-4e86-88dc-2ecec36bb01f None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:53.832175 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860fd89-9916-4e86-88dc-2ecec36bb01f None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:53.832450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860fd89-9916-4e86-88dc-2ecec36bb01f None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:53.833133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860fd89-9916-4e86-88dc-2ecec36bb01f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:53.833441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860fd89-9916-4e86-88dc-2ecec36bb01f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:53.834828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860fd89-9916-4e86-88dc-2ecec36bb01f None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:53.845611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 621/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:53.851697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e4a4c-91ee-4ea7-86ab-23bb958473ae None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:53.884227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:53.951783 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e4a4c-91ee-4ea7-86ab-23bb958473ae None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:53.984446 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a302a0-5d1c-44c0-b44b-d78f644623aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:53.985062 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a302a0-5d1c-44c0-b44b-d78f644623aa None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:53.985338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a302a0-5d1c-44c0-b44b-d78f644623aa None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:53.985604 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a302a0-5d1c-44c0-b44b-d78f644623aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:53.991990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a302a0-5d1c-44c0-b44b-d78f644623aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:53.993406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a302a0-5d1c-44c0-b44b-d78f644623aa None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-f0a302a0-5d1c-44c0-b44b-d78f644623aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:15:54.004247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:54.005311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:54.006472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:15:54.006472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:15:54.006472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:15:54.006472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:15:54.006472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:15:54.006472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:15:54.006472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:15:54.006472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:54.006472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 650/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:15:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:54.011301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860fd89-9916-4e86-88dc-2ecec36bb01f None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:54.068018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:54.109569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860fd89-9916-4e86-88dc-2ecec36bb01f None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:54.143179 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f672eb-bdb6-40c2-9212-f9a302dded3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:54.144283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f672eb-bdb6-40c2-9212-f9a302dded3d None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:54.144556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f672eb-bdb6-40c2-9212-f9a302dded3d None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:54.144819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f672eb-bdb6-40c2-9212-f9a302dded3d None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:54.145582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f672eb-bdb6-40c2-9212-f9a302dded3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:54.145885 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f672eb-bdb6-40c2-9212-f9a302dded3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:54.147338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f672eb-bdb6-40c2-9212-f9a302dded3d None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:54.162865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 622/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:15:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:54.168983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a302a0-5d1c-44c0-b44b-d78f644623aa None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:54.257688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:54.266771 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a302a0-5d1c-44c0-b44b-d78f644623aa None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:54.301257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63603b3a-fbd3-449f-a10c-c0546aa14953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:54.301911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63603b3a-fbd3-449f-a10c-c0546aa14953 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:54.302196 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63603b3a-fbd3-449f-a10c-c0546aa14953 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:54.302504 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63603b3a-fbd3-449f-a10c-c0546aa14953 None admin] PATH_INFO: `/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/94b2448489cc4ad1a6fd3096ebd3f746/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:54.304403 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63603b3a-fbd3-449f-a10c-c0546aa14953 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebe696ab97a143959fa7e33cda768cfc, user_id=94b2448489cc4ad1a6fd3096ebd3f746, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:54.305841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63603b3a-fbd3-449f-a10c-c0546aa14953 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:54.318370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 651/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Thu Aug 4 22:15:54 2022] PUT /identity/v3/projects/ebe696ab97a143959fa7e33cda768cfc/users/94b2448489cc4ad1a6fd3096ebd3f746/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:15:56.288909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f820b6-1d65-4aca-8cab-d33532608bf5 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:56.289467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f820b6-1d65-4aca-8cab-d33532608bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:56.289467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f820b6-1d65-4aca-8cab-d33532608bf5 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:56.290895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 623/1274] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:15:56.295944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb2631-1ed5-49e1-9828-73233df0caaf None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:56.296343 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb2631-1ed5-49e1-9828-73233df0caaf None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:56.296483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb2631-1ed5-49e1-9828-73233df0caaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:56.314524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-96cb2631-1ed5-49e1-9828-73233df0caaf None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:15:56.316254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-96cb2631-1ed5-49e1-9828-73233df0caaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:15:56.380148 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 652/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:15:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 04 22:15:56.402668 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f820b6-1d65-4aca-8cab-d33532608bf5 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:56.501094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f820b6-1d65-4aca-8cab-d33532608bf5 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:56.518039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:56.534810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead34b88-6eca-4549-b856-4cb59824838a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:56.535443 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34b88-6eca-4549-b856-4cb59824838a None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:56.535725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34b88-6eca-4549-b856-4cb59824838a None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:56.536007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34b88-6eca-4549-b856-4cb59824838a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:56.545847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead34b88-6eca-4549-b856-4cb59824838a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-ead34b88-6eca-4549-b856-4cb59824838a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 04 22:15:56.551143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:56.552260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:56.553472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:56.553472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:56.553472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:56.553472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:56.553472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 04 22:15:56.553472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 04 22:15:56.553472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 04 22:15:56.553472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 04 22:15:56.553472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 04 22:15:56.553472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 04 22:15:56.553472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 04 22:15:56.553472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:56.553472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 624/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Thu Aug 4 22:15:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:56.558560 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb2631-1ed5-49e1-9828-73233df0caaf None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:56.636453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:56.654480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb2631-1ed5-49e1-9828-73233df0caaf None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:56.687662 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37e2c1-e026-49a7-9456-c33e047e4e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:56.688259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37e2c1-e026-49a7-9456-c33e047e4e3a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:56.688537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37e2c1-e026-49a7-9456-c33e047e4e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:56.688809 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37e2c1-e026-49a7-9456-c33e047e4e3a None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:56.689505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37e2c1-e026-49a7-9456-c33e047e4e3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:56.689805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37e2c1-e026-49a7-9456-c33e047e4e3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:56.691233 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37e2c1-e026-49a7-9456-c33e047e4e3a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:56.698973 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 653/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Thu Aug 4 22:15:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:56.704888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead34b88-6eca-4549-b856-4cb59824838a None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:56.801853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead34b88-6eca-4549-b856-4cb59824838a None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:56.834659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ab35-384a-4388-96e9-51a3516c5bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:56.835279 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ab35-384a-4388-96e9-51a3516c5bfe None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:56.835555 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ab35-384a-4388-96e9-51a3516c5bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:56.835830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ab35-384a-4388-96e9-51a3516c5bfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:56.845495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378ab35-384a-4388-96e9-51a3516c5bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:56.847466 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378ab35-384a-4388-96e9-51a3516c5bfe None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d378ab35-384a-4388-96e9-51a3516c5bfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:15:56.861515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:56.863291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:56.864254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:15:56.864254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:15:56.864254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:56.864254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:56.864254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 625/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:56.868844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37e2c1-e026-49a7-9456-c33e047e4e3a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:56.964644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37e2c1-e026-49a7-9456-c33e047e4e3a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:56.996853 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bc837-b5c8-4bfc-8762-f4742097fe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:56.997441 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bc837-b5c8-4bfc-8762-f4742097fe1a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:56.997717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bc837-b5c8-4bfc-8762-f4742097fe1a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:56.997984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bc837-b5c8-4bfc-8762-f4742097fe1a None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:56.998676 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bc837-b5c8-4bfc-8762-f4742097fe1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:56.998975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bc837-b5c8-4bfc-8762-f4742097fe1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:57.000321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bc837-b5c8-4bfc-8762-f4742097fe1a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:57.011675 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 654/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:57.017240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ab35-384a-4388-96e9-51a3516c5bfe None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:57.047343 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:57.117669 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ab35-384a-4388-96e9-51a3516c5bfe None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:57.155658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e99c99-2c7c-46a5-8a4b-fad3cef2aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:57.156285 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99c99-2c7c-46a5-8a4b-fad3cef2aac8 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:57.156564 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99c99-2c7c-46a5-8a4b-fad3cef2aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:57.156834 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e99c99-2c7c-46a5-8a4b-fad3cef2aac8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:57.164727 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e99c99-2c7c-46a5-8a4b-fad3cef2aac8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:57.166146 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e99c99-2c7c-46a5-8a4b-fad3cef2aac8 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-d7e99c99-2c7c-46a5-8a4b-fad3cef2aac8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 04 22:15:57.176955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:57.178044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:57.179450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:57.179450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:57.179450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 04 22:15:57.179450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 04 22:15:57.179450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 04 22:15:57.179450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 04 22:15:57.179450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 04 22:15:57.179450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 04 22:15:57.179450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 04 22:15:57.179450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:15:57.179450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 626/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:57.183830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bc837-b5c8-4bfc-8762-f4742097fe1a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:57.187491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:57.287397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bc837-b5c8-4bfc-8762-f4742097fe1a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:57.323795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd603ef-8a80-4afa-94d7-e940e4ddf196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:57.324406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd603ef-8a80-4afa-94d7-e940e4ddf196 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:57.324686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd603ef-8a80-4afa-94d7-e940e4ddf196 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:57.325122 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd603ef-8a80-4afa-94d7-e940e4ddf196 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:57.325747 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd603ef-8a80-4afa-94d7-e940e4ddf196 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:57.326053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd603ef-8a80-4afa-94d7-e940e4ddf196 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:57.327512 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd603ef-8a80-4afa-94d7-e940e4ddf196 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:57.344759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 655/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Thu Aug 4 22:15:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:57.351135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e99c99-2c7c-46a5-8a4b-fad3cef2aac8 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:57.450464 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:57.461015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e99c99-2c7c-46a5-8a4b-fad3cef2aac8 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:57.493200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa904b-a448-4c65-9111-0eb79182184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:57.493812 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa904b-a448-4c65-9111-0eb79182184e None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:57.494090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa904b-a448-4c65-9111-0eb79182184e None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:57.494363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa904b-a448-4c65-9111-0eb79182184e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:57.568145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa904b-a448-4c65-9111-0eb79182184e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:57.569580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa904b-a448-4c65-9111-0eb79182184e None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:57.658302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:57.668991 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 627/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Thu Aug 4 22:15:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 04 22:15:57.674859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd603ef-8a80-4afa-94d7-e940e4ddf196 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:57.735090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:57.772971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd603ef-8a80-4afa-94d7-e940e4ddf196 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:57.805319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50053773-facb-46de-bce2-931ab4c05249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:57.805944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053773-facb-46de-bce2-931ab4c05249 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:57.806223 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053773-facb-46de-bce2-931ab4c05249 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:57.806524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053773-facb-46de-bce2-931ab4c05249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:57.816780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50053773-facb-46de-bce2-931ab4c05249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:57.818220 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50053773-facb-46de-bce2-931ab4c05249 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-50053773-facb-46de-bce2-931ab4c05249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 04 22:15:57.832590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:57.833649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:57.834982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 04 22:15:57.834982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 04 22:15:57.834982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 04 22:15:57.834982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:57.834982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 656/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:57.839354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa904b-a448-4c65-9111-0eb79182184e None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:57.935302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa904b-a448-4c65-9111-0eb79182184e None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:57.968198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ab1a0-e73e-45b0-9ee3-3d7e88e905c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:57.968798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ab1a0-e73e-45b0-9ee3-3d7e88e905c9 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:57.969083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ab1a0-e73e-45b0-9ee3-3d7e88e905c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:57.969359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ab1a0-e73e-45b0-9ee3-3d7e88e905c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:57.970039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ab1a0-e73e-45b0-9ee3-3d7e88e905c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:57.970347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ab1a0-e73e-45b0-9ee3-3d7e88e905c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:57.972353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ab1a0-e73e-45b0-9ee3-3d7e88e905c9 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:57.983581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 628/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Thu Aug 4 22:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:15:57.989224 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50053773-facb-46de-bce2-931ab4c05249 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:58.092403 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50053773-facb-46de-bce2-931ab4c05249 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:58.107012 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:58.129673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5359f0-fa8f-42af-9ac1-ae72e892035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:58.130348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5359f0-fa8f-42af-9ac1-ae72e892035b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:58.130641 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5359f0-fa8f-42af-9ac1-ae72e892035b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:58.130911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5359f0-fa8f-42af-9ac1-ae72e892035b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:58.137428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5359f0-fa8f-42af-9ac1-ae72e892035b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:58.138917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5359f0-fa8f-42af-9ac1-ae72e892035b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-bd5359f0-fa8f-42af-9ac1-ae72e892035b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 04 22:15:58.150378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:15:58.151475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:15:58.152817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 04 22:15:58.152817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 04 22:15:58.152817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 04 22:15:58.152817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 04 22:15:58.152817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 04 22:15:58.152817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 04 22:15:58.152817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 04 22:15:58.152817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 04 22:15:58.152817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 657/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Thu Aug 4 22:15:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:15:58.157429 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ab1a0-e73e-45b0-9ee3-3d7e88e905c9 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:58.205592 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:15:58.254968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ab1a0-e73e-45b0-9ee3-3d7e88e905c9 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:58.286923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6d785-7e2e-43bc-9c25-2ae9a24bbb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:58.287527 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6d785-7e2e-43bc-9c25-2ae9a24bbb9c None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:58.287806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6d785-7e2e-43bc-9c25-2ae9a24bbb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:58.288080 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6d785-7e2e-43bc-9c25-2ae9a24bbb9c None admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:58.288822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6d785-7e2e-43bc-9c25-2ae9a24bbb9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:58.289133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6d785-7e2e-43bc-9c25-2ae9a24bbb9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:58.290580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6d785-7e2e-43bc-9c25-2ae9a24bbb9c None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:58.302261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 629/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Thu Aug 4 22:15:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:15:58.308336 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5359f0-fa8f-42af-9ac1-ae72e892035b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:15:58.405164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5359f0-fa8f-42af-9ac1-ae72e892035b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:15:58.437762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb616ab-01b0-40b0-99bd-56e76a1eea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:15:58.438365 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb616ab-01b0-40b0-99bd-56e76a1eea12 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:15:58.438672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb616ab-01b0-40b0-99bd-56e76a1eea12 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:15:58.438944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb616ab-01b0-40b0-99bd-56e76a1eea12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:15:58.439715 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb616ab-01b0-40b0-99bd-56e76a1eea12 None admin] RBAC: Adding query filter params (role.id=0053c24ce06147938dbb61657a531c94, scope.project.id=ebe696ab97a143959fa7e33cda768cfc, user.id=94b2448489cc4ad1a6fd3096ebd3f746) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:15:58.440023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb616ab-01b0-40b0-99bd-56e76a1eea12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:15:58.441485 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb616ab-01b0-40b0-99bd-56e76a1eea12 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:15:58.447246 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 658/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Thu Aug 4 22:15:58 2022] GET /identity/v3/role_assignments?user.id=94b2448489cc4ad1a6fd3096ebd3f746&scope.project.id=ebe696ab97a143959fa7e33cda768cfc&role.id=0053c24ce06147938dbb61657a531c94 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:16:00.457571 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b1d5b-220f-4cee-8744-2a8f56541f36 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:00.458124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b1d5b-220f-4cee-8744-2a8f56541f36 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:00.458124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b1d5b-220f-4cee-8744-2a8f56541f36 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:00.459513 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 630/1288] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:16:00.464556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb113b02-6e35-44df-9ea9-6da222e72784 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:00.464940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb113b02-6e35-44df-9ea9-6da222e72784 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:00.465120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb113b02-6e35-44df-9ea9-6da222e72784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:00.483055 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-eb113b02-6e35-44df-9ea9-6da222e72784 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:16:00.484222 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-eb113b02-6e35-44df-9ea9-6da222e72784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:16:00.513648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:16:00.551143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 659/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:16:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:16:00.573664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b1d5b-220f-4cee-8744-2a8f56541f36 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:16:00.671766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b1d5b-220f-4cee-8744-2a8f56541f36 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:16:00.682006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:16:00.705421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbf12a-3b1b-4a88-a46e-8457e75ac47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:16:00.706093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf12a-3b1b-4a88-a46e-8457e75ac47b None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:00.706375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf12a-3b1b-4a88-a46e-8457e75ac47b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:00.706680 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf12a-3b1b-4a88-a46e-8457e75ac47b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:00.707297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbf12a-3b1b-4a88-a46e-8457e75ac47b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:16:00.708698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbf12a-3b1b-4a88-a46e-8457e75ac47b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-7cdbf12a-3b1b-4a88-a46e-8457e75ac47b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:16:00.717286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:16:00.718528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:16:00.719395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 631/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 4 22:16:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:16:00.724335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb113b02-6e35-44df-9ea9-6da222e72784 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:16:00.819872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb113b02-6e35-44df-9ea9-6da222e72784 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:16:00.852349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7494a-1dee-4445-83c1-bc4bb7510d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:16:00.852954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7494a-1dee-4445-83c1-bc4bb7510d04 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:00.853237 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7494a-1dee-4445-83c1-bc4bb7510d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:00.853509 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7494a-1dee-4445-83c1-bc4bb7510d04 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:00.854176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7494a-1dee-4445-83c1-bc4bb7510d04 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:16:00.854518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7494a-1dee-4445-83c1-bc4bb7510d04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:16:00.855887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7494a-1dee-4445-83c1-bc4bb7510d04 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:16:00.860597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 660/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Aug 4 22:16:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:16:00.866751 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbf12a-3b1b-4a88-a46e-8457e75ac47b None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:16:00.963775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbf12a-3b1b-4a88-a46e-8457e75ac47b None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:16:00.997624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f8539-9651-42dd-a3a0-10edf72a7ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:16:00.998220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f8539-9651-42dd-a3a0-10edf72a7ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:00.998528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f8539-9651-42dd-a3a0-10edf72a7ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:00.998800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f8539-9651-42dd-a3a0-10edf72a7ec4 None admin] PATH_INFO: `/v3/services` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:00.999460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f8539-9651-42dd-a3a0-10edf72a7ec4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:16:00.999763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f8539-9651-42dd-a3a0-10edf72a7ec4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:16:01.001105 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f8539-9651-42dd-a3a0-10edf72a7ec4 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:16:01.006181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 632/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Aug 4 22:16:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:16:02.961962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefff68-566e-4023-b224-1d3cc8aaf581 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:02.962562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefff68-566e-4023-b224-1d3cc8aaf581 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:02.962562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefff68-566e-4023-b224-1d3cc8aaf581 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:02.963896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 661/1293] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:16:02.968957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7255c8-fabd-4fca-983a-fbd42a0b0c65 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:02.969329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7255c8-fabd-4fca-983a-fbd42a0b0c65 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:02.969509 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7255c8-fabd-4fca-983a-fbd42a0b0c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:02.987721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5a7255c8-fabd-4fca-983a-fbd42a0b0c65 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:16:02.988883 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5a7255c8-fabd-4fca-983a-fbd42a0b0c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:16:03.019542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:16:03.055222 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 633/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:16:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:16:03.077479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefff68-566e-4023-b224-1d3cc8aaf581 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:16:03.111408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:16:03.195640 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefff68-566e-4023-b224-1d3cc8aaf581 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:16:03.228504 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbd0b5-7da4-4b3d-8403-e9ca622b46db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:16:03.229049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbd0b5-7da4-4b3d-8403-e9ca622b46db None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:03.229334 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbd0b5-7da4-4b3d-8403-e9ca622b46db None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:03.229607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbd0b5-7da4-4b3d-8403-e9ca622b46db None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:03.230303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbd0b5-7da4-4b3d-8403-e9ca622b46db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:16:03.231699 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbd0b5-7da4-4b3d-8403-e9ca622b46db None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:16:03.246253 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 662/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Thu Aug 4 22:16:03 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:16:05.243814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e70a0-0314-41fb-924b-19fa9626a599 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:05.244405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e70a0-0314-41fb-924b-19fa9626a599 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:05.244405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e70a0-0314-41fb-924b-19fa9626a599 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:05.245758 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 634/1296] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:16:05.250917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312bb87-cffb-4f1a-a4fa-f2c5b8944987 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:05.251346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312bb87-cffb-4f1a-a4fa-f2c5b8944987 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:05.251495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312bb87-cffb-4f1a-a4fa-f2c5b8944987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:05.269705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e312bb87-cffb-4f1a-a4fa-f2c5b8944987 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:16:05.270914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e312bb87-cffb-4f1a-a4fa-f2c5b8944987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:16:05.341350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 663/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:16:05 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:16:05.364398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e70a0-0314-41fb-924b-19fa9626a599 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:16:05.461501 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e70a0-0314-41fb-924b-19fa9626a599 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:16:05.494437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed3af8-fba1-41a2-b457-33ae7a525952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:16:05.495000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed3af8-fba1-41a2-b457-33ae7a525952 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:05.495274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed3af8-fba1-41a2-b457-33ae7a525952 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:05.495543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed3af8-fba1-41a2-b457-33ae7a525952 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:05.496158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed3af8-fba1-41a2-b457-33ae7a525952 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:16:05.497495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed3af8-fba1-41a2-b457-33ae7a525952 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-77ed3af8-fba1-41a2-b457-33ae7a525952 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:16:05.506573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:16:05.507846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:16:05.508986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 635/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 4 22:16:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:16:05.513718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312bb87-cffb-4f1a-a4fa-f2c5b8944987 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:16:05.531443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:16:05.609972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312bb87-cffb-4f1a-a4fa-f2c5b8944987 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:16:05.645400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf3250-26b1-45a6-a761-2ba86294a7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:16:05.646013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf3250-26b1-45a6-a761-2ba86294a7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:05.646294 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf3250-26b1-45a6-a761-2ba86294a7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:05.646596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf3250-26b1-45a6-a761-2ba86294a7b4 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:05.647271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf3250-26b1-45a6-a761-2ba86294a7b4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:16:05.647572 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf3250-26b1-45a6-a761-2ba86294a7b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:16:05.648940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf3250-26b1-45a6-a761-2ba86294a7b4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:16:05.653949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 664/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Aug 4 22:16:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:16:05.660554 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed3af8-fba1-41a2-b457-33ae7a525952 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:16:05.691676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:16:05.758767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed3af8-fba1-41a2-b457-33ae7a525952 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:16:05.791911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f8d6c-59c5-492b-8530-4808277443f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:16:05.792515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f8d6c-59c5-492b-8530-4808277443f7 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:05.792848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f8d6c-59c5-492b-8530-4808277443f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:05.793104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f8d6c-59c5-492b-8530-4808277443f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:05.793852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f8d6c-59c5-492b-8530-4808277443f7 None admin] RBAC: Adding query filter params (interface=public, service_id=2b431d45a48343d393ace1d64392b5f3, region_id=RegionOne) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:16:05.794165 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f8d6c-59c5-492b-8530-4808277443f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:16:05.795563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f8d6c-59c5-492b-8530-4808277443f7 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:16:05.801028 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 636/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Thu Aug 4 22:16:05 2022] GET /identity/v3/endpoints?service_id=2b431d45a48343d393ace1d64392b5f3&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:16:05.806621 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf3250-26b1-45a6-a761-2ba86294a7b4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:16:05.886045 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:16:05.904173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf3250-26b1-45a6-a761-2ba86294a7b4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:16:05.936736 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985b3ef-256d-40ad-9b09-eb0ae5304277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:16:05.937333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b3ef-256d-40ad-9b09-eb0ae5304277 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:05.937611 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b3ef-256d-40ad-9b09-eb0ae5304277 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:05.937880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b3ef-256d-40ad-9b09-eb0ae5304277 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:05.938543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985b3ef-256d-40ad-9b09-eb0ae5304277 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:16:05.939900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985b3ef-256d-40ad-9b09-eb0ae5304277 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:16:05.947102 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 665/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Thu Aug 4 22:16:05 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:16:07.969325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a5b99-5004-4be6-9e02-0f32904b7868 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:07.969873 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a5b99-5004-4be6-9e02-0f32904b7868 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:07.969873 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a5b99-5004-4be6-9e02-0f32904b7868 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:07.971262 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 637/1302] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:16:07.976509 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbab70-dd87-4cb7-b5d9-c32a7bf496d7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:07.976933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbab70-dd87-4cb7-b5d9-c32a7bf496d7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:07.977059 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbab70-dd87-4cb7-b5d9-c32a7bf496d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:07.994717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-33fbab70-dd87-4cb7-b5d9-c32a7bf496d7 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:16:07.995910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-33fbab70-dd87-4cb7-b5d9-c32a7bf496d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:16:08.061350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 666/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:16:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 04 22:16:08.085595 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a5b99-5004-4be6-9e02-0f32904b7868 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:16:08.189641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:16:08.196908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a5b99-5004-4be6-9e02-0f32904b7868 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:16:08.229573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aeff9-171b-41a5-ae20-cce85238da66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:16:08.230148 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aeff9-171b-41a5-ae20-cce85238da66 None admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:08.230453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aeff9-171b-41a5-ae20-cce85238da66 None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:08.230730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aeff9-171b-41a5-ae20-cce85238da66 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:08.231344 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99aeff9-171b-41a5-ae20-cce85238da66 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:16:08.232693 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99aeff9-171b-41a5-ae20-cce85238da66 None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application [None req-e99aeff9-171b-41a5-ae20-cce85238da66 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 04 22:16:08.241763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 04 22:16:08.242913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.get_or_create( Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application with Lock( Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self._enter() Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application return self.creator() Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application created_value = creator( Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: ERROR keystone.server.flask.application Aug 04 22:16:08.243790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 638/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Thu Aug 4 22:16:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 04 22:16:08.249052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbab70-dd87-4cb7-b5d9-c32a7bf496d7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:16:08.322121 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:16:08.344122 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbab70-dd87-4cb7-b5d9-c32a7bf496d7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:16:08.376731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73aca9-3aee-46dc-9d7b-fee5465e4d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:16:08.377346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73aca9-3aee-46dc-9d7b-fee5465e4d5f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:08.377713 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73aca9-3aee-46dc-9d7b-fee5465e4d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:08.378555 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73aca9-3aee-46dc-9d7b-fee5465e4d5f None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:08.379284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73aca9-3aee-46dc-9d7b-fee5465e4d5f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:16:08.379595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73aca9-3aee-46dc-9d7b-fee5465e4d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:16:08.380977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73aca9-3aee-46dc-9d7b-fee5465e4d5f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:16:08.386203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 667/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Thu Aug 4 22:16:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:16:08.391968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aeff9-171b-41a5-ae20-cce85238da66 None admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:16:08.489802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aeff9-171b-41a5-ae20-cce85238da66 None admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:16:08.522087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f1d4a-8d11-40b8-a22c-f392c3ee909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:16:08.522731 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f1d4a-8d11-40b8-a22c-f392c3ee909b None admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:16:08.523016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f1d4a-8d11-40b8-a22c-f392c3ee909b None admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:16:08.523290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f1d4a-8d11-40b8-a22c-f392c3ee909b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:16:08.524004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f1d4a-8d11-40b8-a22c-f392c3ee909b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:16:08.525355 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f1d4a-8d11-40b8-a22c-f392c3ee909b None admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:16:08.543853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 639/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:16:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:16:18.383165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=30 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:16:18.539655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:11.357222 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef66575-9e2f-48b2-b1b0-63b40a1b63d6 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:11.357669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef66575-9e2f-48b2-b1b0-63b40a1b63d6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:11.357669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef66575-9e2f-48b2-b1b0-63b40a1b63d6 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:11.359598 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 668/1307] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:11.365446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76399b24-7d6f-4dde-90b3-2d9589718fb4 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:11.366458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76399b24-7d6f-4dde-90b3-2d9589718fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:11.368654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76399b24-7d6f-4dde-90b3-2d9589718fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:11.524165 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-76399b24-7d6f-4dde-90b3-2d9589718fb4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:11.525665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-76399b24-7d6f-4dde-90b3-2d9589718fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:11.690901 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 640/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:17:11.740399 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99edb4-064f-4724-8c5d-9659f2af6bb1 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:11.741045 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99edb4-064f-4724-8c5d-9659f2af6bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:11.741567 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99edb4-064f-4724-8c5d-9659f2af6bb1 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:11.743514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 669/1309] 10.222.0.27 () {54 vars in 965 bytes} [Thu Aug 4 22:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:11.749238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbc79f-713a-408a-91e5-9252adb0c208 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:11.749534 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbc79f-713a-408a-91e5-9252adb0c208 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:11.749816 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbc79f-713a-408a-91e5-9252adb0c208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:11.843223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-32fbc79f-713a-408a-91e5-9252adb0c208 None None] MFA Rules not processed for user `9ee0de72ba804ba491342a8ae82a44f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:11.844781 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-32fbc79f-713a-408a-91e5-9252adb0c208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:11.866698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:11.930588 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 641/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Thu Aug 4 22:17:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:17:11.938770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99edb4-064f-4724-8c5d-9659f2af6bb1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:17:11.940877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3f99edb4-064f-4724-8c5d-9659f2af6bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:12.062649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99edb4-064f-4724-8c5d-9659f2af6bb1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:17:12.166467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd98ff-e60f-4af3-ab83-6f2bc99caf58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:17:12.167105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd98ff-e60f-4af3-ab83-6f2bc99caf58 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:12.167380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd98ff-e60f-4af3-ab83-6f2bc99caf58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:12.167648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd98ff-e60f-4af3-ab83-6f2bc99caf58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:12.169584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6dfd98ff-e60f-4af3-ab83-6f2bc99caf58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:12.240620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:12.321821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd98ff-e60f-4af3-ab83-6f2bc99caf58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:17:12.324775 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd98ff-e60f-4af3-ab83-6f2bc99caf58 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:17:12.349970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 670/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:17:14.816059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667db4c-ea31-4ee5-a3be-8c9de107b6ac None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:14.816587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667db4c-ea31-4ee5-a3be-8c9de107b6ac None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:14.816587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667db4c-ea31-4ee5-a3be-8c9de107b6ac None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:14.817944 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 642/1312] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:14.823215 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f36a4-f2bb-4e61-ad55-96dfbde448ed None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:14.823674 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f36a4-f2bb-4e61-ad55-96dfbde448ed None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:14.823918 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f36a4-f2bb-4e61-ad55-96dfbde448ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:14.900975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-432f36a4-f2bb-4e61-ad55-96dfbde448ed None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:14.902212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-432f36a4-f2bb-4e61-ad55-96dfbde448ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:15.003669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 671/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:17:15.056904 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c61dc-33df-4454-9cbb-f1c6af2594a1 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:15.057214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c61dc-33df-4454-9cbb-f1c6af2594a1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:15.057493 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c61dc-33df-4454-9cbb-f1c6af2594a1 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:15.058980 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 643/1314] 10.222.0.27 () {54 vars in 965 bytes} [Thu Aug 4 22:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:15.065311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108a475-2bcf-425e-b21d-96b68c07fa99 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:15.065599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108a475-2bcf-425e-b21d-96b68c07fa99 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:15.065875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108a475-2bcf-425e-b21d-96b68c07fa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:15.077451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:15.147291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f108a475-2bcf-425e-b21d-96b68c07fa99 None None] MFA Rules not processed for user `9ee0de72ba804ba491342a8ae82a44f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:15.148497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f108a475-2bcf-425e-b21d-96b68c07fa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:15.221870 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 672/1315] 10.222.0.27 () {58 vars in 1062 bytes} [Thu Aug 4 22:17:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:17:15.230927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c61dc-33df-4454-9cbb-f1c6af2594a1 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:17:15.232500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2e3c61dc-33df-4454-9cbb-f1c6af2594a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:15.334092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c61dc-33df-4454-9cbb-f1c6af2594a1 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:17:15.406634 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:15.410073 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb447ed-86bf-44b9-aa86-7318db8c21af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:17:15.410755 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb447ed-86bf-44b9-aa86-7318db8c21af service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:15.411253 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb447ed-86bf-44b9-aa86-7318db8c21af service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:15.411715 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb447ed-86bf-44b9-aa86-7318db8c21af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:15.413402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6bb447ed-86bf-44b9-aa86-7318db8c21af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:15.527421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb447ed-86bf-44b9-aa86-7318db8c21af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:17:15.528956 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb447ed-86bf-44b9-aa86-7318db8c21af service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:17:15.546450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 644/1316] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:17:18.032573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2730c9f-fd42-4a27-b78c-f417678bc54f None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:18.033112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2730c9f-fd42-4a27-b78c-f417678bc54f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:18.033112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2730c9f-fd42-4a27-b78c-f417678bc54f None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:18.034522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 673/1317] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:18.039728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe24f1-4a0b-417e-af39-dea077655443 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:18.040119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe24f1-4a0b-417e-af39-dea077655443 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:18.040312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe24f1-4a0b-417e-af39-dea077655443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:18.104807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-7abe24f1-4a0b-417e-af39-dea077655443 None None] MFA Rules not processed for user `cc4961f214f64c8f9d7137d2763ee3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:18.106006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7abe24f1-4a0b-417e-af39-dea077655443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:18.159164 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:18.203760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 645/1318] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:17:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:17:18.243686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2730c9f-fd42-4a27-b78c-f417678bc54f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:17:18.245292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a2730c9f-fd42-4a27-b78c-f417678bc54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:18.347181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2730c9f-fd42-4a27-b78c-f417678bc54f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:17:18.349936 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:18.425779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804f824-bb7d-475b-a312-7ece39450f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:17:18.426393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804f824-bb7d-475b-a312-7ece39450f90 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:18.426710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804f824-bb7d-475b-a312-7ece39450f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:18.426984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804f824-bb7d-475b-a312-7ece39450f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:18.428628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b804f824-bb7d-475b-a312-7ece39450f90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:18.537074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804f824-bb7d-475b-a312-7ece39450f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:17:18.538546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804f824-bb7d-475b-a312-7ece39450f90 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:17:18.556700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 674/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:17:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:17:21.101090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c45d0-d705-4202-9991-cf855c755cca None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:21.101599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c45d0-d705-4202-9991-cf855c755cca None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:21.101726 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c45d0-d705-4202-9991-cf855c755cca None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:21.103018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 646/1320] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:21.108057 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bf83c-9d67-41fa-a6b0-49ce235f75b8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:21.108464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bf83c-9d67-41fa-a6b0-49ce235f75b8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:21.108615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bf83c-9d67-41fa-a6b0-49ce235f75b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:21.148582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:21.173714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ea4bf83c-9d67-41fa-a6b0-49ce235f75b8 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:21.174983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ea4bf83c-9d67-41fa-a6b0-49ce235f75b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:21.268558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 675/1321] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:17:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:17:21.307523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c45d0-d705-4202-9991-cf855c755cca None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:17:21.309065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-297c45d0-d705-4202-9991-cf855c755cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:21.411236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c45d0-d705-4202-9991-cf855c755cca None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:17:21.483608 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a43d1-ce0f-434b-b2e6-0d0a96243946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:17:21.484216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a43d1-ce0f-434b-b2e6-0d0a96243946 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:21.484491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a43d1-ce0f-434b-b2e6-0d0a96243946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:21.484758 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a43d1-ce0f-434b-b2e6-0d0a96243946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:21.486353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4b0a43d1-ce0f-434b-b2e6-0d0a96243946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:21.493640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:21.594016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a43d1-ce0f-434b-b2e6-0d0a96243946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:17:21.595524 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a43d1-ce0f-434b-b2e6-0d0a96243946 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:17:21.613105 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 647/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:17:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:17:24.554863 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db10d59-6e5f-4a41-9929-2e9f06135c67 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:24.555428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db10d59-6e5f-4a41-9929-2e9f06135c67 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:24.555428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db10d59-6e5f-4a41-9929-2e9f06135c67 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:24.556707 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 676/1323] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:24.563334 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fe557-e6a0-40d7-8b25-f083da32cfc7 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:24.563807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fe557-e6a0-40d7-8b25-f083da32cfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:24.563900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fe557-e6a0-40d7-8b25-f083da32cfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:24.637428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c23fe557-e6a0-40d7-8b25-f083da32cfc7 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:24.640012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c23fe557-e6a0-40d7-8b25-f083da32cfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:24.704594 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:24.752265 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 648/1324] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:17:24.792939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db10d59-6e5f-4a41-9929-2e9f06135c67 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:17:24.794627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6db10d59-6e5f-4a41-9929-2e9f06135c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:24.910853 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db10d59-6e5f-4a41-9929-2e9f06135c67 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:17:24.924226 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:24.991693 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e48d94-e36a-4f4e-b034-e5a4dcdde07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:17:24.992317 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e48d94-e36a-4f4e-b034-e5a4dcdde07e service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:24.992600 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e48d94-e36a-4f4e-b034-e5a4dcdde07e service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:24.992872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e48d94-e36a-4f4e-b034-e5a4dcdde07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:24.994555 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d0e48d94-e36a-4f4e-b034-e5a4dcdde07e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:25.107758 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e48d94-e36a-4f4e-b034-e5a4dcdde07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:17:25.109371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e48d94-e36a-4f4e-b034-e5a4dcdde07e service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:17:25.130880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 677/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:17:27.206519 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75699d55-18ad-43fc-b0c0-25290cf6754a None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:27.207048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75699d55-18ad-43fc-b0c0-25290cf6754a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:27.207048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75699d55-18ad-43fc-b0c0-25290cf6754a None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:27.208370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 649/1326] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:27.213525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666985b8-f5e2-4842-87b2-a04c4273f7f7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:27.213962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666985b8-f5e2-4842-87b2-a04c4273f7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:27.214109 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666985b8-f5e2-4842-87b2-a04c4273f7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:27.267507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:27.287255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-666985b8-f5e2-4842-87b2-a04c4273f7f7 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:27.288464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-666985b8-f5e2-4842-87b2-a04c4273f7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:27.385005 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 678/1327] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:17:27.421198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75699d55-18ad-43fc-b0c0-25290cf6754a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:17:27.422772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-75699d55-18ad-43fc-b0c0-25290cf6754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:27.530718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75699d55-18ad-43fc-b0c0-25290cf6754a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:17:27.608892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8429e-e2c0-4aca-8352-1344c8a3d2c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:17:27.609523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8429e-e2c0-4aca-8352-1344c8a3d2c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:27.609806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8429e-e2c0-4aca-8352-1344c8a3d2c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:27.610082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8429e-e2c0-4aca-8352-1344c8a3d2c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:27.611844 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4ba8429e-e2c0-4aca-8352-1344c8a3d2c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:27.632541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:27.726656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8429e-e2c0-4aca-8352-1344c8a3d2c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:17:27.728012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8429e-e2c0-4aca-8352-1344c8a3d2c9 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:17:27.746213 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 650/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:17:29.829285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b00328-4446-47df-b2ad-021ecfae82e6 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:29.829812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b00328-4446-47df-b2ad-021ecfae82e6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:29.829910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b00328-4446-47df-b2ad-021ecfae82e6 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:29.831535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 679/1329] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:29.836736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3fca-9489-4bfc-bc52-34a2e188d294 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:29.837207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3fca-9489-4bfc-bc52-34a2e188d294 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:29.837443 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f3fca-9489-4bfc-bc52-34a2e188d294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:29.903491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-af0f3fca-9489-4bfc-bc52-34a2e188d294 None None] MFA Rules not processed for user `cc4961f214f64c8f9d7137d2763ee3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:29.904715 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-af0f3fca-9489-4bfc-bc52-34a2e188d294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:29.972267 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:30.007185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 651/1330] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:17:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:17:30.056731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b00328-4446-47df-b2ad-021ecfae82e6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:17:30.058359 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f2b00328-4446-47df-b2ad-021ecfae82e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:30.163696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b00328-4446-47df-b2ad-021ecfae82e6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:17:30.183385 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:30.238597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f88baa-d1dc-4c7e-9ddd-20b22738c0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:17:30.239221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f88baa-d1dc-4c7e-9ddd-20b22738c0fe service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:30.239500 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f88baa-d1dc-4c7e-9ddd-20b22738c0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:30.239775 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f88baa-d1dc-4c7e-9ddd-20b22738c0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:30.241514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a6f88baa-d1dc-4c7e-9ddd-20b22738c0fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:30.354589 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f88baa-d1dc-4c7e-9ddd-20b22738c0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:17:30.356033 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f88baa-d1dc-4c7e-9ddd-20b22738c0fe service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:17:30.375843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 680/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:17:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:17:32.637116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a84b63-9486-4df1-8942-28c082fee44a None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:32.637644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a84b63-9486-4df1-8942-28c082fee44a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:32.637644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a84b63-9486-4df1-8942-28c082fee44a None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:32.639098 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 652/1332] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:32.644875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35331721-a175-4eed-8be9-84f937b61e3e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:32.645255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35331721-a175-4eed-8be9-84f937b61e3e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:32.645425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35331721-a175-4eed-8be9-84f937b61e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:32.707346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:32.709912 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-35331721-a175-4eed-8be9-84f937b61e3e None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:32.711747 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-35331721-a175-4eed-8be9-84f937b61e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:32.806762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 681/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:17:32.843226 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a84b63-9486-4df1-8942-28c082fee44a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:17:32.844746 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-79a84b63-9486-4df1-8942-28c082fee44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:32.947430 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a84b63-9486-4df1-8942-28c082fee44a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:17:33.022561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27be73-d7ee-4d04-ba21-3693ab8c68b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:17:33.023189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27be73-d7ee-4d04-ba21-3693ab8c68b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:33.023467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27be73-d7ee-4d04-ba21-3693ab8c68b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:33.023737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27be73-d7ee-4d04-ba21-3693ab8c68b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:33.025379 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5d27be73-d7ee-4d04-ba21-3693ab8c68b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:33.052380 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:33.137071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27be73-d7ee-4d04-ba21-3693ab8c68b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:17:33.138523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27be73-d7ee-4d04-ba21-3693ab8c68b5 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:17:33.157352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 653/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:17:35.200724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75afc80-be84-4a11-ae98-8abf0cc559bd None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:35.201288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75afc80-be84-4a11-ae98-8abf0cc559bd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:35.201288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75afc80-be84-4a11-ae98-8abf0cc559bd None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:35.202574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 682/1335] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:35.208510 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15182f4-6e2c-4909-918d-b930bf3a9125 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:35.208946 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15182f4-6e2c-4909-918d-b930bf3a9125 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:35.209096 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15182f4-6e2c-4909-918d-b930bf3a9125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:35.273198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c15182f4-6e2c-4909-918d-b930bf3a9125 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:35.274464 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c15182f4-6e2c-4909-918d-b930bf3a9125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:35.348506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:35.372476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 654/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:17:35.412849 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75afc80-be84-4a11-ae98-8abf0cc559bd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:17:35.414396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b75afc80-be84-4a11-ae98-8abf0cc559bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:35.523514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75afc80-be84-4a11-ae98-8abf0cc559bd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:17:35.551474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:35.596795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55a4c3-a901-40c7-a255-fd91c8549bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:17:35.597405 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a4c3-a901-40c7-a255-fd91c8549bde service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:35.597685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a4c3-a901-40c7-a255-fd91c8549bde service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:35.597962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a4c3-a901-40c7-a255-fd91c8549bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:35.599608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ee55a4c3-a901-40c7-a255-fd91c8549bde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:35.706332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55a4c3-a901-40c7-a255-fd91c8549bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:17:35.707790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55a4c3-a901-40c7-a255-fd91c8549bde service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:17:35.726019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 683/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:17:38.163001 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999cc61-8abd-4ed4-9c5f-8e9b679c4212 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:38.163565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999cc61-8abd-4ed4-9c5f-8e9b679c4212 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:38.163565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999cc61-8abd-4ed4-9c5f-8e9b679c4212 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:38.164984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 655/1338] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:38.170185 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2a84-d753-4983-8ec1-38c6b74d3f8b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:38.170727 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2a84-d753-4983-8ec1-38c6b74d3f8b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:38.170837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2a84-d753-4983-8ec1-38c6b74d3f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:38.238227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-593a2a84-d753-4983-8ec1-38c6b74d3f8b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:38.239455 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-593a2a84-d753-4983-8ec1-38c6b74d3f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:38.247643 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:38.334982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 684/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:17:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:17:38.372062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999cc61-8abd-4ed4-9c5f-8e9b679c4212 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:17:38.373631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a999cc61-8abd-4ed4-9c5f-8e9b679c4212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:38.475157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999cc61-8abd-4ed4-9c5f-8e9b679c4212 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:17:38.546274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27587463-9d70-49a2-9872-f00c04673b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:17:38.546918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27587463-9d70-49a2-9872-f00c04673b25 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:38.547198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27587463-9d70-49a2-9872-f00c04673b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:38.547476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27587463-9d70-49a2-9872-f00c04673b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:38.549125 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-27587463-9d70-49a2-9872-f00c04673b25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:38.585511 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:38.668096 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27587463-9d70-49a2-9872-f00c04673b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:17:38.669460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27587463-9d70-49a2-9872-f00c04673b25 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:17:38.688489 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 656/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:17:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:17:42.620024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f800-a305-4100-82ad-b64181e94b53 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:42.620576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f800-a305-4100-82ad-b64181e94b53 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:42.620576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2f800-a305-4100-82ad-b64181e94b53 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:42.622080 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 685/1341] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:42.627777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560fddb-1120-4500-ac17-29356a658f8e None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:42.628433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560fddb-1120-4500-ac17-29356a658f8e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:42.628433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560fddb-1120-4500-ac17-29356a658f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:42.698328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-1560fddb-1120-4500-ac17-29356a658f8e None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:42.699507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1560fddb-1120-4500-ac17-29356a658f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:42.785875 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:42.797838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 657/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:17:42.837442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f800-a305-4100-82ad-b64181e94b53 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:17:42.839118 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b4d2f800-a305-4100-82ad-b64181e94b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:42.944498 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2f800-a305-4100-82ad-b64181e94b53 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:17:42.982618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:43.019231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8d8be-0235-43d8-adb2-8508d7699761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:17:43.019848 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d8be-0235-43d8-adb2-8508d7699761 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:43.020127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d8be-0235-43d8-adb2-8508d7699761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:43.020396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d8be-0235-43d8-adb2-8508d7699761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:43.022015 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-06b8d8be-0235-43d8-adb2-8508d7699761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:43.141126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8d8be-0235-43d8-adb2-8508d7699761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:17:43.142601 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8d8be-0235-43d8-adb2-8508d7699761 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:17:43.161152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 686/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:17:45.783434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b485d82-54f0-45de-8d10-8926e82dfb65 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:45.783956 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b485d82-54f0-45de-8d10-8926e82dfb65 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:45.783956 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b485d82-54f0-45de-8d10-8926e82dfb65 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:45.785329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 658/1344] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:45.791091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f70bc4-772a-4615-abd7-0b29764772d1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:45.791607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f70bc4-772a-4615-abd7-0b29764772d1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:45.791701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f70bc4-772a-4615-abd7-0b29764772d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:45.861243 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-17f70bc4-772a-4615-abd7-0b29764772d1 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:45.862508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-17f70bc4-772a-4615-abd7-0b29764772d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:45.881487 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:45.965167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 687/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:17:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:17:46.002421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b485d82-54f0-45de-8d10-8926e82dfb65 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:17:46.003970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0b485d82-54f0-45de-8d10-8926e82dfb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:46.111251 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b485d82-54f0-45de-8d10-8926e82dfb65 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:17:46.194890 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93476d-cc34-4e32-9851-d2e22a7fb785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:17:46.195506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93476d-cc34-4e32-9851-d2e22a7fb785 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:46.195786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93476d-cc34-4e32-9851-d2e22a7fb785 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:46.196137 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93476d-cc34-4e32-9851-d2e22a7fb785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:46.197793 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8a93476d-cc34-4e32-9851-d2e22a7fb785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:46.240813 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:46.308522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93476d-cc34-4e32-9851-d2e22a7fb785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:17:46.309968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93476d-cc34-4e32-9851-d2e22a7fb785 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:17:46.328305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 659/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:17:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:17:50.350376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3de2f-20e0-4c0c-9ad0-3634844728e4 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:50.350933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3de2f-20e0-4c0c-9ad0-3634844728e4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:50.351049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3de2f-20e0-4c0c-9ad0-3634844728e4 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:50.352335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 688/1347] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:50.357578 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2594d7-acf1-417d-820d-8f9b1992fa73 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:50.357998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2594d7-acf1-417d-820d-8f9b1992fa73 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:50.358291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2594d7-acf1-417d-820d-8f9b1992fa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:50.425258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5e2594d7-acf1-417d-820d-8f9b1992fa73 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:50.426518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5e2594d7-acf1-417d-820d-8f9b1992fa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:50.531062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:50.538259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 660/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:17:50.574198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3de2f-20e0-4c0c-9ad0-3634844728e4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:17:50.575772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-94c3de2f-20e0-4c0c-9ad0-3634844728e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:50.694379 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3de2f-20e0-4c0c-9ad0-3634844728e4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:17:50.752062 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:50.780053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de59d7b-5976-4a90-a99d-261629f8c95a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:17:50.780679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59d7b-5976-4a90-a99d-261629f8c95a service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:50.780962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59d7b-5976-4a90-a99d-261629f8c95a service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:50.781238 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59d7b-5976-4a90-a99d-261629f8c95a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:50.783549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5de59d7b-5976-4a90-a99d-261629f8c95a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:50.897383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de59d7b-5976-4a90-a99d-261629f8c95a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:17:50.899579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de59d7b-5976-4a90-a99d-261629f8c95a service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:17:50.921675 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 689/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:17:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:17:55.838196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b755d3d-fe5d-48a9-b56d-021a4eaf5e40 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:55.838708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b755d3d-fe5d-48a9-b56d-021a4eaf5e40 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:55.838936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b755d3d-fe5d-48a9-b56d-021a4eaf5e40 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:55.840662 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 661/1350] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 4 22:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:17:55.863155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb81c1-689a-4b05-9825-bdb2eff8a301 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:17:55.863648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb81c1-689a-4b05-9825-bdb2eff8a301 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:17:55.863744 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb81c1-689a-4b05-9825-bdb2eff8a301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:17:55.991107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9feb81c1-689a-4b05-9825-bdb2eff8a301 None None] MFA Rules not processed for user `94b2448489cc4ad1a6fd3096ebd3f746`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:17:55.992443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9feb81c1-689a-4b05-9825-bdb2eff8a301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:17:56.012863 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:17:56.109192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 690/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 4 22:17:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:00.159982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bf2a1-68f1-4e34-ae0c-3a522971284c None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:00.160560 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bf2a1-68f1-4e34-ae0c-3a522971284c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:00.160560 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bf2a1-68f1-4e34-ae0c-3a522971284c None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:00.162022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 662/1352] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 4 22:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:00.166903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d4ef-3a47-4a52-a13f-697f82171929 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:00.167348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d4ef-3a47-4a52-a13f-697f82171929 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:00.167701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d4ef-3a47-4a52-a13f-697f82171929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:00.254498 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-26c1d4ef-3a47-4a52-a13f-697f82171929 None None] MFA Rules not processed for user `94b2448489cc4ad1a6fd3096ebd3f746`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:00.256072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-26c1d4ef-3a47-4a52-a13f-697f82171929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:00.338865 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:00.380711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 691/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 4 22:18:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:01.716624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac686-eff3-471f-800e-ddc72b4923bd None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:01.717149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac686-eff3-471f-800e-ddc72b4923bd None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:01.717149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac686-eff3-471f-800e-ddc72b4923bd None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:01.718453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 663/1354] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 4 22:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:01.723445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2fcdf-cc88-4e42-8699-254dbadfcf70 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:01.723872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2fcdf-cc88-4e42-8699-254dbadfcf70 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:01.724144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2fcdf-cc88-4e42-8699-254dbadfcf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:01.801928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1fb2fcdf-cc88-4e42-8699-254dbadfcf70 None None] MFA Rules not processed for user `94b2448489cc4ad1a6fd3096ebd3f746`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:01.803175 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1fb2fcdf-cc88-4e42-8699-254dbadfcf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:01.912022 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 692/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 4 22:18:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:05.360796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89149536-7ee5-402e-accb-5448ba5b3fa9 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:05.362693 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89149536-7ee5-402e-accb-5448ba5b3fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:05.363240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89149536-7ee5-402e-accb-5448ba5b3fa9 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:05.364849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 664/1356] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:18:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:05.378534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92a3c8-b71a-44ef-935f-86fc4990d026 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:05.379052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92a3c8-b71a-44ef-935f-86fc4990d026 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:05.379352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92a3c8-b71a-44ef-935f-86fc4990d026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:05.417477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:05.453005 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cf92a3c8-b71a-44ef-935f-86fc4990d026 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:05.454539 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cf92a3c8-b71a-44ef-935f-86fc4990d026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:05.561052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 693/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:05.617878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5746608-0e69-4bfe-a268-9679be73d061 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:05.618549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5746608-0e69-4bfe-a268-9679be73d061 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:05.619009 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5746608-0e69-4bfe-a268-9679be73d061 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:05.620581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 665/1358] 10.222.0.27 () {54 vars in 962 bytes} [Thu Aug 4 22:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:05.629006 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966a8d5-50a3-43e2-a0bc-d4aebad21995 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:05.629255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966a8d5-50a3-43e2-a0bc-d4aebad21995 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:05.629516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966a8d5-50a3-43e2-a0bc-d4aebad21995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:05.716065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0966a8d5-50a3-43e2-a0bc-d4aebad21995 None None] MFA Rules not processed for user `04899781f67746e193a05bdc004804cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:05.717252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0966a8d5-50a3-43e2-a0bc-d4aebad21995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:05.766434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:05.837292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 694/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Thu Aug 4 22:18:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:05.845054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5746608-0e69-4bfe-a268-9679be73d061 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:05.846654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e5746608-0e69-4bfe-a268-9679be73d061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:06.002006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5746608-0e69-4bfe-a268-9679be73d061 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:06.077879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:06.122101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25cdd0-d413-4d78-adf4-3d46e87530fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:06.122684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25cdd0-d413-4d78-adf4-3d46e87530fe service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:06.122965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25cdd0-d413-4d78-adf4-3d46e87530fe service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:06.123239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25cdd0-d413-4d78-adf4-3d46e87530fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:06.124869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1d25cdd0-d413-4d78-adf4-3d46e87530fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:06.225959 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25cdd0-d413-4d78-adf4-3d46e87530fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:06.227571 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25cdd0-d413-4d78-adf4-3d46e87530fe service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:06.246929 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 666/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:08.486344 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc3e1e-dc55-4700-ae77-1a53aa375e8b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:08.486978 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc3e1e-dc55-4700-ae77-1a53aa375e8b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:08.486978 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc3e1e-dc55-4700-ae77-1a53aa375e8b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:08.488508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 695/1361] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:08.493976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3231132-9516-4425-885c-247b90c4ef4c None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:08.494542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3231132-9516-4425-885c-247b90c4ef4c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:08.494639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3231132-9516-4425-885c-247b90c4ef4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:08.569050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c3231132-9516-4425-885c-247b90c4ef4c None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:08.570261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c3231132-9516-4425-885c-247b90c4ef4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:08.609765 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:08.675666 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 667/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:08.720887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc3e1e-dc55-4700-ae77-1a53aa375e8b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:08.722471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d1dc3e1e-dc55-4700-ae77-1a53aa375e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:08.895020 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc3e1e-dc55-4700-ae77-1a53aa375e8b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:08.905037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:09.019448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4f34d-b168-4947-9ff5-2d2ec3a0bfcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:09.020074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4f34d-b168-4947-9ff5-2d2ec3a0bfcb service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:09.020361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4f34d-b168-4947-9ff5-2d2ec3a0bfcb service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:09.020640 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4f34d-b168-4947-9ff5-2d2ec3a0bfcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:09.022376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-56a4f34d-b168-4947-9ff5-2d2ec3a0bfcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:09.126484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4f34d-b168-4947-9ff5-2d2ec3a0bfcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:09.128553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4f34d-b168-4947-9ff5-2d2ec3a0bfcb service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:09.148292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 696/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:11.515577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06a68a-0d83-43b3-9a49-b6832ea7bf3d None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:11.516121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06a68a-0d83-43b3-9a49-b6832ea7bf3d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:11.516121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06a68a-0d83-43b3-9a49-b6832ea7bf3d None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:11.518157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 668/1364] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:11.523696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadb620-e432-4cc2-b3fc-fb9d07088bbc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:11.524127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadb620-e432-4cc2-b3fc-fb9d07088bbc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:11.524252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadb620-e432-4cc2-b3fc-fb9d07088bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:11.540161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:11.606970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-daadb620-e432-4cc2-b3fc-fb9d07088bbc None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:11.608257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-daadb620-e432-4cc2-b3fc-fb9d07088bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:11.729501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 697/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:11.777203 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2729a-ff2d-4929-adcf-8d7989a315cb None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:11.777773 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2729a-ff2d-4929-adcf-8d7989a315cb None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:11.778175 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2729a-ff2d-4929-adcf-8d7989a315cb None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:11.779981 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 669/1366] 10.222.0.27 () {54 vars in 962 bytes} [Thu Aug 4 22:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:11.785477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1fe22-1a1d-40f3-b7cd-2ac691cb94cb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:11.785771 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1fe22-1a1d-40f3-b7cd-2ac691cb94cb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:11.786048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1fe22-1a1d-40f3-b7cd-2ac691cb94cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:11.866220 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d7b1fe22-1a1d-40f3-b7cd-2ac691cb94cb None None] MFA Rules not processed for user `04899781f67746e193a05bdc004804cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:11.867463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d7b1fe22-1a1d-40f3-b7cd-2ac691cb94cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:11.904298 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:11.993299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 698/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Thu Aug 4 22:18:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:18:12.002202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2729a-ff2d-4929-adcf-8d7989a315cb None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:12.003869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-52a2729a-ff2d-4929-adcf-8d7989a315cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:12.156251 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2729a-ff2d-4929-adcf-8d7989a315cb None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:12.176591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:12.277932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3aa144-e523-49fe-a6a4-73f919f8ee2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:12.279094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3aa144-e523-49fe-a6a4-73f919f8ee2e service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:12.279596 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3aa144-e523-49fe-a6a4-73f919f8ee2e service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:12.280054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3aa144-e523-49fe-a6a4-73f919f8ee2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:12.281870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-db3aa144-e523-49fe-a6a4-73f919f8ee2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:12.381718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3aa144-e523-49fe-a6a4-73f919f8ee2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:12.383970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3aa144-e523-49fe-a6a4-73f919f8ee2e service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:12.404514 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 670/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:13.479971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a72bb-20db-4bb2-aed2-97e00b3b789b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:13.480475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a72bb-20db-4bb2-aed2-97e00b3b789b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:13.480583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a72bb-20db-4bb2-aed2-97e00b3b789b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:13.482058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 699/1369] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:13.487277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da02be-0433-44a9-84ef-c34c7e1db754 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:13.487741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da02be-0433-44a9-84ef-c34c7e1db754 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:13.487831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da02be-0433-44a9-84ef-c34c7e1db754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:13.522215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:13.560732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-30da02be-0433-44a9-84ef-c34c7e1db754 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:13.561944 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-30da02be-0433-44a9-84ef-c34c7e1db754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:13.669303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 671/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:14.014438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756ae12-e287-455b-8dd4-d51b2a426986 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:14.014438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756ae12-e287-455b-8dd4-d51b2a426986 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:14.015116 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756ae12-e287-455b-8dd4-d51b2a426986 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:14.016497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 700/1371] 10.222.0.27 () {54 vars in 964 bytes} [Thu Aug 4 22:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:14.021947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06637184-ef58-484d-b108-75e30d559920 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:14.022241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06637184-ef58-484d-b108-75e30d559920 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:14.022553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06637184-ef58-484d-b108-75e30d559920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:14.104213 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-06637184-ef58-484d-b108-75e30d559920 None None] MFA Rules not processed for user `d3b29a204dff42c399f0d143b3d0189f`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:14.105496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-06637184-ef58-484d-b108-75e30d559920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:14.160822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:14.194854 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 672/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Thu Aug 4 22:18:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:14.202367 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756ae12-e287-455b-8dd4-d51b2a426986 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:14.204099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d756ae12-e287-455b-8dd4-d51b2a426986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:14.318127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756ae12-e287-455b-8dd4-d51b2a426986 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:14.362393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:14.398802 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebe9c1-ce71-4141-aeb7-52b13caadb74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:14.399573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebe9c1-ce71-4141-aeb7-52b13caadb74 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:14.399951 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebe9c1-ce71-4141-aeb7-52b13caadb74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:14.400317 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebe9c1-ce71-4141-aeb7-52b13caadb74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:14.402092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b2ebe9c1-ce71-4141-aeb7-52b13caadb74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:14.530117 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebe9c1-ce71-4141-aeb7-52b13caadb74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:14.531294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacbe41-0e80-4f86-8021-76bad5d437c9 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:14.531684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacbe41-0e80-4f86-8021-76bad5d437c9 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:14.531790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebe9c1-ce71-4141-aeb7-52b13caadb74 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:14.531872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacbe41-0e80-4f86-8021-76bad5d437c9 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:14.534997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 673/1373] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:18:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:14.538794 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526625d-7bfd-48ed-8c83-0b76e1522179 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:14.539205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526625d-7bfd-48ed-8c83-0b76e1522179 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:14.539601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526625d-7bfd-48ed-8c83-0b76e1522179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:14.558684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 701/1374] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:14.631709 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5526625d-7bfd-48ed-8c83-0b76e1522179 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:14.633413 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5526625d-7bfd-48ed-8c83-0b76e1522179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:14.758040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 674/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:18:14.803167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebe9c1-ce71-4141-aeb7-52b13caadb74 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:14.804998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b2ebe9c1-ce71-4141-aeb7-52b13caadb74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:14.896220 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:14.948622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebe9c1-ce71-4141-aeb7-52b13caadb74 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:15.068700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b50731-49d2-460f-9d6d-9b2a65a5e69e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:15.069313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b50731-49d2-460f-9d6d-9b2a65a5e69e service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:15.069590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b50731-49d2-460f-9d6d-9b2a65a5e69e service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:15.069861 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b50731-49d2-460f-9d6d-9b2a65a5e69e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:15.071517 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-06b50731-49d2-460f-9d6d-9b2a65a5e69e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:15.156799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:15.168826 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b50731-49d2-460f-9d6d-9b2a65a5e69e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:15.170507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b50731-49d2-460f-9d6d-9b2a65a5e69e service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:15.188421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 702/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:17.241086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65018277-c202-430e-9b07-bcc27b760af0 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:17.241592 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65018277-c202-430e-9b07-bcc27b760af0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:17.241592 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65018277-c202-430e-9b07-bcc27b760af0 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:17.243175 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 675/1377] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:17.248423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244bdd1-e893-44f6-8b83-adac075091f5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:17.248890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244bdd1-e893-44f6-8b83-adac075091f5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:17.249111 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244bdd1-e893-44f6-8b83-adac075091f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:17.318473 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a244bdd1-e893-44f6-8b83-adac075091f5 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:17.319696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a244bdd1-e893-44f6-8b83-adac075091f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:17.420672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 703/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:17.473427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65018277-c202-430e-9b07-bcc27b760af0 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:17.475121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-65018277-c202-430e-9b07-bcc27b760af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:17.564339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:17.657059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65018277-c202-430e-9b07-bcc27b760af0 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:17.768226 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50b586-c07e-4cf5-8ff9-862cebbe5fff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:17.768883 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50b586-c07e-4cf5-8ff9-862cebbe5fff service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:17.769170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50b586-c07e-4cf5-8ff9-862cebbe5fff service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:17.769451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50b586-c07e-4cf5-8ff9-862cebbe5fff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:17.771133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6a50b586-c07e-4cf5-8ff9-862cebbe5fff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:17.783890 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:17.864177 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50b586-c07e-4cf5-8ff9-862cebbe5fff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:17.865747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50b586-c07e-4cf5-8ff9-862cebbe5fff service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:17.886120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 676/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:19.985962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c27473-65d3-44ce-9426-36079460b897 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:19.986573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c27473-65d3-44ce-9426-36079460b897 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:19.986852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c27473-65d3-44ce-9426-36079460b897 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:19.988378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 704/1380] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:19.993494 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7c1e6-ab5c-4209-9f9f-25a350970b37 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:19.993953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7c1e6-ab5c-4209-9f9f-25a350970b37 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:19.994069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7c1e6-ab5c-4209-9f9f-25a350970b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:20.073499 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-eca7c1e6-ab5c-4209-9f9f-25a350970b37 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:20.074732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-eca7c1e6-ab5c-4209-9f9f-25a350970b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:20.165019 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:20.178467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 677/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:20.223662 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c27473-65d3-44ce-9426-36079460b897 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:20.225373 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e2c27473-65d3-44ce-9426-36079460b897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:20.293052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:20.389223 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c27473-65d3-44ce-9426-36079460b897 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:20.522236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ace56c-b596-4721-9344-666eb78bf5d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:20.523258 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace56c-b596-4721-9344-666eb78bf5d6 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:20.523892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace56c-b596-4721-9344-666eb78bf5d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:20.524268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace56c-b596-4721-9344-666eb78bf5d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:20.525996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-83ace56c-b596-4721-9344-666eb78bf5d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:20.550479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:20.627293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ace56c-b596-4721-9344-666eb78bf5d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:20.628915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ace56c-b596-4721-9344-666eb78bf5d6 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:20.648438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 705/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:22.911326 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703164b-a773-414d-8e23-4c896360d507 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:22.911886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703164b-a773-414d-8e23-4c896360d507 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:22.911886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703164b-a773-414d-8e23-4c896360d507 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:22.913259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 678/1383] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:22.919789 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39bd45-a173-401f-b5ba-55ba508cbc77 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:22.920240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39bd45-a173-401f-b5ba-55ba508cbc77 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:22.920577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39bd45-a173-401f-b5ba-55ba508cbc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:23.002039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7c39bd45-a173-401f-b5ba-55ba508cbc77 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:23.003344 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7c39bd45-a173-401f-b5ba-55ba508cbc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:23.102270 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:23.106724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 706/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:23.151578 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703164b-a773-414d-8e23-4c896360d507 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:23.153569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c703164b-a773-414d-8e23-4c896360d507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:23.320772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703164b-a773-414d-8e23-4c896360d507 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:23.384801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:23.436017 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c85355-ed19-4244-8dd6-5c907917bcfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:23.436636 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c85355-ed19-4244-8dd6-5c907917bcfb service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:23.436920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c85355-ed19-4244-8dd6-5c907917bcfb service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:23.437197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c85355-ed19-4244-8dd6-5c907917bcfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:23.439400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-23c85355-ed19-4244-8dd6-5c907917bcfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:23.532246 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c85355-ed19-4244-8dd6-5c907917bcfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:23.533786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c85355-ed19-4244-8dd6-5c907917bcfb service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:23.552106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 679/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:26.138208 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceaa0f-a939-4ce6-bbd2-5b625fbcc4d5 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:26.138856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceaa0f-a939-4ce6-bbd2-5b625fbcc4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:26.139072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceaa0f-a939-4ce6-bbd2-5b625fbcc4d5 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:26.141109 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 707/1386] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:18:26.148013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22487e32-dc00-4b41-806b-96b99e403a54 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:26.148519 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22487e32-dc00-4b41-806b-96b99e403a54 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:26.148628 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22487e32-dc00-4b41-806b-96b99e403a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:26.222880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-22487e32-dc00-4b41-806b-96b99e403a54 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:26.224110 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-22487e32-dc00-4b41-806b-96b99e403a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:26.253281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:26.348488 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 680/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:26.403319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecceaa0f-a939-4ce6-bbd2-5b625fbcc4d5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:26.404853 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ecceaa0f-a939-4ce6-bbd2-5b625fbcc4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:26.553721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecceaa0f-a939-4ce6-bbd2-5b625fbcc4d5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:26.627719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:26.679547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716039b-68c1-4347-988c-6dc45e95f7ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:26.680380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716039b-68c1-4347-988c-6dc45e95f7ec service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:26.680728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716039b-68c1-4347-988c-6dc45e95f7ec service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:26.681078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716039b-68c1-4347-988c-6dc45e95f7ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:26.683353 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e716039b-68c1-4347-988c-6dc45e95f7ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:26.778514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716039b-68c1-4347-988c-6dc45e95f7ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:26.780114 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716039b-68c1-4347-988c-6dc45e95f7ec service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:26.799247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 708/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:28.830185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b8b57-3df8-4433-a6bc-238c03fe40b6 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:28.830714 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b8b57-3df8-4433-a6bc-238c03fe40b6 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:28.830859 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b8b57-3df8-4433-a6bc-238c03fe40b6 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:28.832261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 681/1389] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:28.837654 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae74768-5197-49a3-96cc-7aef29f4364c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:28.838101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae74768-5197-49a3-96cc-7aef29f4364c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:28.838217 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae74768-5197-49a3-96cc-7aef29f4364c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:28.902557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9ae74768-5197-49a3-96cc-7aef29f4364c None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:28.903731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9ae74768-5197-49a3-96cc-7aef29f4364c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:28.938538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:29.001652 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 709/1390] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:29.046827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b8b57-3df8-4433-a6bc-238c03fe40b6 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:29.048458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b30b8b57-3df8-4433-a6bc-238c03fe40b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:29.200491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b8b57-3df8-4433-a6bc-238c03fe40b6 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:29.211824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:29.317547 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f114676-3a7c-4ad5-a85b-c1e29dbbb76d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:29.318167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f114676-3a7c-4ad5-a85b-c1e29dbbb76d service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:29.318483 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f114676-3a7c-4ad5-a85b-c1e29dbbb76d service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:29.318757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f114676-3a7c-4ad5-a85b-c1e29dbbb76d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:29.320537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6f114676-3a7c-4ad5-a85b-c1e29dbbb76d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:29.410368 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f114676-3a7c-4ad5-a85b-c1e29dbbb76d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:29.411987 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f114676-3a7c-4ad5-a85b-c1e29dbbb76d service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:29.429967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 682/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:29.633528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2259c-50ef-4e6b-96c0-dda0ebdcba05 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:29.633843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2259c-50ef-4e6b-96c0-dda0ebdcba05 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:29.634159 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2259c-50ef-4e6b-96c0-dda0ebdcba05 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:29.635608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 710/1392] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:29.641416 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fced75-c261-4285-8d85-0439cf5ae539 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:29.641713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fced75-c261-4285-8d85-0439cf5ae539 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:29.641997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fced75-c261-4285-8d85-0439cf5ae539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:29.658259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:29.710766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-53fced75-c261-4285-8d85-0439cf5ae539 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:29.711957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-53fced75-c261-4285-8d85-0439cf5ae539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:29.810074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 683/1393] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:29.865930 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e206520-5e78-4c55-9a65-57638fb0d1f3 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:29.866472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e206520-5e78-4c55-9a65-57638fb0d1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:29.866601 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e206520-5e78-4c55-9a65-57638fb0d1f3 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:29.868468 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 711/1394] 10.222.0.27 () {54 vars in 966 bytes} [Thu Aug 4 22:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:29.873687 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895185a-ee2f-4e27-a335-d205882bb27d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:29.874144 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895185a-ee2f-4e27-a335-d205882bb27d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:29.874346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895185a-ee2f-4e27-a335-d205882bb27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:29.950325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6895185a-ee2f-4e27-a335-d205882bb27d None None] MFA Rules not processed for user `fce7db16c4904fb1b75ac7910f4470f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:29.951545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6895185a-ee2f-4e27-a335-d205882bb27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:29.987224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:30.029398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 684/1395] 10.222.0.27 () {58 vars in 1063 bytes} [Thu Aug 4 22:18:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:30.036858 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e206520-5e78-4c55-9a65-57638fb0d1f3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:30.038364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4e206520-5e78-4c55-9a65-57638fb0d1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:30.143101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e206520-5e78-4c55-9a65-57638fb0d1f3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:30.203958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:30.217890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d4ee7-5540-412c-b2af-96871be67dcf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce7db16c4904fb1b75ac7910f4470f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:30.218688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4ee7-5540-412c-b2af-96871be67dcf service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:30.218978 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4ee7-5540-412c-b2af-96871be67dcf service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:30.219258 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d4ee7-5540-412c-b2af-96871be67dcf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:30.220899 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7e2d4ee7-5540-412c-b2af-96871be67dcf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:30.331728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d4ee7-5540-412c-b2af-96871be67dcf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:30.333173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d4ee7-5540-412c-b2af-96871be67dcf service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:30.351674 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 712/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:31.083825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60370ad7-3b4f-4790-9146-d8843df14d25 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:31.084322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60370ad7-3b4f-4790-9146-d8843df14d25 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:31.084522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60370ad7-3b4f-4790-9146-d8843df14d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:31.155427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-60370ad7-3b4f-4790-9146-d8843df14d25 None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:31.156634 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-60370ad7-3b4f-4790-9146-d8843df14d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:31.249191 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 685/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:18:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:31.295683 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a7cfd-28e4-4fd7-8d49-eef260848f5f None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:31.296168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a7cfd-28e4-4fd7-8d49-eef260848f5f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:31.296276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a7cfd-28e4-4fd7-8d49-eef260848f5f None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:31.297649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 713/1398] 10.222.0.27 () {54 vars in 943 bytes} [Thu Aug 4 22:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:31.303995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5103d-a7e5-402e-8d1c-080f602a4750 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:31.304351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5103d-a7e5-402e-8d1c-080f602a4750 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:31.304635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5103d-a7e5-402e-8d1c-080f602a4750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:31.363365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:31.382428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-ddb5103d-a7e5-402e-8d1c-080f602a4750 None None] MFA Rules not processed for user `aa5bf773ed3a4f1e916671a22c65f031`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:31.383683 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ddb5103d-a7e5-402e-8d1c-080f602a4750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:31.488855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fb11f-c7c1-4efa-8bb6-0e25e1a9186a None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:31.489146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fb11f-c7c1-4efa-8bb6-0e25e1a9186a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:31.489425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fb11f-c7c1-4efa-8bb6-0e25e1a9186a None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:31.490948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 714/1399] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 04 22:18:31.493162 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 686/1400] 10.222.0.27 () {58 vars in 1040 bytes} [Thu Aug 4 22:18:31 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:31.495529 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a48bfa-0c9c-4060-aa8a-62528f3c5fc9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:31.495835 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a48bfa-0c9c-4060-aa8a-62528f3c5fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:31.496087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a48bfa-0c9c-4060-aa8a-62528f3c5fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:31.509486 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5103d-a7e5-402e-8d1c-080f602a4750 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:31.519708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5103d-a7e5-402e-8d1c-080f602a4750 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:31.561989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-24a48bfa-0c9c-4060-aa8a-62528f3c5fc9 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:31.563755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-24a48bfa-0c9c-4060-aa8a-62528f3c5fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:31.606806 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:31.617692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:31.624632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f1a04-891c-4ec1-ae07-01723b9c38d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:31.626107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f1a04-891c-4ec1-ae07-01723b9c38d5 service swift] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:31.626482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f1a04-891c-4ec1-ae07-01723b9c38d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:31.626761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f1a04-891c-4ec1-ae07-01723b9c38d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:31.628541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a95f1a04-891c-4ec1-ae07-01723b9c38d5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:31.670462 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 715/1401] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:31.715788 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f1a04-891c-4ec1-ae07-01723b9c38d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:31.717401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f1a04-891c-4ec1-ae07-01723b9c38d5 service swift] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:31.718024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a48bfa-0c9c-4060-aa8a-62528f3c5fc9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:31.719350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-24a48bfa-0c9c-4060-aa8a-62528f3c5fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:31.725515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 687/1402] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:18:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 22:18:31.868169 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a48bfa-0c9c-4060-aa8a-62528f3c5fc9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:31.937830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:32.005915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e330589-de10-4bd1-bdf1-3ce622d2bb75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:32.006691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e330589-de10-4bd1-bdf1-3ce622d2bb75 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:32.007073 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e330589-de10-4bd1-bdf1-3ce622d2bb75 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:32.007419 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e330589-de10-4bd1-bdf1-3ce622d2bb75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:32.009168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6e330589-de10-4bd1-bdf1-3ce622d2bb75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:32.114622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e330589-de10-4bd1-bdf1-3ce622d2bb75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:32.116224 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e330589-de10-4bd1-bdf1-3ce622d2bb75 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:32.157335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 716/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:18:34.259045 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b2801-0561-42b1-aabf-276219c9caff None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:34.259631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b2801-0561-42b1-aabf-276219c9caff None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:34.259631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b2801-0561-42b1-aabf-276219c9caff None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:34.260949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 688/1404] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:34.266770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95aa40-74c5-43ea-8182-26c3a5f7165f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:34.267244 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95aa40-74c5-43ea-8182-26c3a5f7165f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:34.267353 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95aa40-74c5-43ea-8182-26c3a5f7165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:34.345059 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3e95aa40-74c5-43ea-8182-26c3a5f7165f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:34.346554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3e95aa40-74c5-43ea-8182-26c3a5f7165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:34.364160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:34.454688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 717/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:34.498926 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b2801-0561-42b1-aabf-276219c9caff None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:34.501185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1b5b2801-0561-42b1-aabf-276219c9caff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:34.657684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:34.669839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b2801-0561-42b1-aabf-276219c9caff None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:34.795554 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0ef4d-7ee5-472b-b06e-b4a8b18ce0a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:34.796216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0ef4d-7ee5-472b-b06e-b4a8b18ce0a0 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:34.796498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0ef4d-7ee5-472b-b06e-b4a8b18ce0a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:34.796893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0ef4d-7ee5-472b-b06e-b4a8b18ce0a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:34.799132 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-12c0ef4d-7ee5-472b-b06e-b4a8b18ce0a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:34.908070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0ef4d-7ee5-472b-b06e-b4a8b18ce0a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:34.909642 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0ef4d-7ee5-472b-b06e-b4a8b18ce0a0 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:34.926315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:34.961604 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 689/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:37.054875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efeba1-1074-4239-a979-5f1a0a82486f None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:37.055443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efeba1-1074-4239-a979-5f1a0a82486f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:37.055833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efeba1-1074-4239-a979-5f1a0a82486f None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:37.057279 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 718/1407] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:37.062762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428912-9778-4009-8717-5bb7beb07d97 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:37.063695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428912-9778-4009-8717-5bb7beb07d97 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:37.063887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428912-9778-4009-8717-5bb7beb07d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:37.136026 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-f8428912-9778-4009-8717-5bb7beb07d97 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:37.137241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f8428912-9778-4009-8717-5bb7beb07d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:37.251390 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 690/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:37.303856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efeba1-1074-4239-a979-5f1a0a82486f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:37.305372 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-08efeba1-1074-4239-a979-5f1a0a82486f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:37.474865 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:37.476979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efeba1-1074-4239-a979-5f1a0a82486f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:37.604582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3760a56-d373-4229-8770-b6889e6af203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:37.605209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3760a56-d373-4229-8770-b6889e6af203 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:37.605494 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3760a56-d373-4229-8770-b6889e6af203 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:37.605829 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3760a56-d373-4229-8770-b6889e6af203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:37.607493 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f3760a56-d373-4229-8770-b6889e6af203 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:37.706973 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3760a56-d373-4229-8770-b6889e6af203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:37.708614 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3760a56-d373-4229-8770-b6889e6af203 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:37.727536 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 719/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:47.248736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=67 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:47.725768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:53.716222 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69050706-205a-44b9-8ed7-92f583bca1f0 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:53.716805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69050706-205a-44b9-8ed7-92f583bca1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:53.716805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69050706-205a-44b9-8ed7-92f583bca1f0 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:53.718154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 691/1410] 10.222.0.27 () {54 vars in 918 bytes} [Thu Aug 4 22:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:53.723980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbb5fa-2300-4785-b9c6-57ad8dcf65d8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:53.724404 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbb5fa-2300-4785-b9c6-57ad8dcf65d8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:53.724515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbb5fa-2300-4785-b9c6-57ad8dcf65d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:53.798394 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f7fbb5fa-2300-4785-b9c6-57ad8dcf65d8 None None] MFA Rules not processed for user `94b2448489cc4ad1a6fd3096ebd3f746`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:53.799625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f7fbb5fa-2300-4785-b9c6-57ad8dcf65d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:53.907149 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 720/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Aug 4 22:18:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:53.921179 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c9c1c-b925-42e5-b37b-c5f87b096523 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:53.921465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c9c1c-b925-42e5-b37b-c5f87b096523 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:53.921775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c9c1c-b925-42e5-b37b-c5f87b096523 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:53.923221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 692/1412] 10.222.0.27 () {54 vars in 918 bytes} [Thu Aug 4 22:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:53.927953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3fdff-ae4c-4109-839a-b1663bbc4df5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:53.928242 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3fdff-ae4c-4109-839a-b1663bbc4df5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:53.928521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3fdff-ae4c-4109-839a-b1663bbc4df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:54.002058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:54.005353 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-dbf3fdff-ae4c-4109-839a-b1663bbc4df5 None None] MFA Rules not processed for user `04899781f67746e193a05bdc004804cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:54.006662 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dbf3fdff-ae4c-4109-839a-b1663bbc4df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:54.125580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 721/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Thu Aug 4 22:18:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:18:56.576975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a583ce-10b4-4a84-839f-c59fae496b93 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:56.577511 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a583ce-10b4-4a84-839f-c59fae496b93 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:56.577511 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a583ce-10b4-4a84-839f-c59fae496b93 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:56.579450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 693/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:56.584997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860a0a-80e4-45db-a2bb-0f79d5cfc684 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:56.585411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860a0a-80e4-45db-a2bb-0f79d5cfc684 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:56.585532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d860a0a-80e4-45db-a2bb-0f79d5cfc684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:56.650012 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2d860a0a-80e4-45db-a2bb-0f79d5cfc684 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:56.651220 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2d860a0a-80e4-45db-a2bb-0f79d5cfc684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:56.706310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:56.747950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 722/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:56.791384 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a583ce-10b4-4a84-839f-c59fae496b93 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:56.792927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a1a583ce-10b4-4a84-839f-c59fae496b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:56.935069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a583ce-10b4-4a84-839f-c59fae496b93 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:57.007527 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:57.048065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b30f08-b7b8-4c25-ad12-e86a4a9fb646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:57.048897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b30f08-b7b8-4c25-ad12-e86a4a9fb646 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:57.049254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b30f08-b7b8-4c25-ad12-e86a4a9fb646 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:57.049531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b30f08-b7b8-4c25-ad12-e86a4a9fb646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:57.051492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e1b30f08-b7b8-4c25-ad12-e86a4a9fb646 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:57.139287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b30f08-b7b8-4c25-ad12-e86a4a9fb646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:57.141483 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b30f08-b7b8-4c25-ad12-e86a4a9fb646 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:57.160365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 694/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:58.061989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d20fb-8156-4141-ba3e-37a14a424b30 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:58.062592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d20fb-8156-4141-ba3e-37a14a424b30 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:58.062592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d20fb-8156-4141-ba3e-37a14a424b30 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:58.063976 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 723/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 22:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:58.068850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f17df-2c04-4970-bb18-0c2191f6ee5d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:58.069276 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f17df-2c04-4970-bb18-0c2191f6ee5d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:58.069411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f17df-2c04-4970-bb18-0c2191f6ee5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:58.145436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c21f17df-2c04-4970-bb18-0c2191f6ee5d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:58.146664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c21f17df-2c04-4970-bb18-0c2191f6ee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:58.173865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:58.245708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 695/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 22:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:18:58.396898 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d20fb-8156-4141-ba3e-37a14a424b30 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:18:58.398287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-be0d20fb-8156-4141-ba3e-37a14a424b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:58.542145 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d20fb-8156-4141-ba3e-37a14a424b30 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:18:58.581632 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:58.655408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45effc1-097e-48d1-939a-e73626beeaef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:18:58.655945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45effc1-097e-48d1-939a-e73626beeaef service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:58.656221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45effc1-097e-48d1-939a-e73626beeaef service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:58.656490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45effc1-097e-48d1-939a-e73626beeaef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:58.658110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e45effc1-097e-48d1-939a-e73626beeaef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:58.871153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45effc1-097e-48d1-939a-e73626beeaef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:18:58.872791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45effc1-097e-48d1-939a-e73626beeaef service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:18:58.891106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 724/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:18:59.777278 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d5017-5bcd-4dd0-a2ed-3b51d08de522 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:59.777784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d5017-5bcd-4dd0-a2ed-3b51d08de522 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:59.777784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d5017-5bcd-4dd0-a2ed-3b51d08de522 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:59.779175 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 696/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 22:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:18:59.784095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34402d90-1e4f-44a0-9164-d0851c641681 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:18:59.784529 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34402d90-1e4f-44a0-9164-d0851c641681 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:18:59.784626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34402d90-1e4f-44a0-9164-d0851c641681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:18:59.838538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:18:59.860045 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-34402d90-1e4f-44a0-9164-d0851c641681 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:18:59.861261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-34402d90-1e4f-44a0-9164-d0851c641681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:18:59.955186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 725/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 22:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:00.106737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d5017-5bcd-4dd0-a2ed-3b51d08de522 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:00.108296 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a35d5017-5bcd-4dd0-a2ed-3b51d08de522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:00.264892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d5017-5bcd-4dd0-a2ed-3b51d08de522 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:00.277354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:00.378064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84e42e-85e4-44d7-be6a-23c4548a1bcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:00.378688 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84e42e-85e4-44d7-be6a-23c4548a1bcf service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:00.378975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84e42e-85e4-44d7-be6a-23c4548a1bcf service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:00.379250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84e42e-85e4-44d7-be6a-23c4548a1bcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:00.380882 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-bc84e42e-85e4-44d7-be6a-23c4548a1bcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:00.468280 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84e42e-85e4-44d7-be6a-23c4548a1bcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:00.469892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84e42e-85e4-44d7-be6a-23c4548a1bcf service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:00.488181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 697/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:01.372177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713ea72-6bcc-4453-8242-6e2d44ad6e17 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:01.372739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713ea72-6bcc-4453-8242-6e2d44ad6e17 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:01.372739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713ea72-6bcc-4453-8242-6e2d44ad6e17 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:01.374079 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 726/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 22:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:01.379053 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8269fd-6121-435b-8c3c-b09c72c0caa9 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:01.379506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8269fd-6121-435b-8c3c-b09c72c0caa9 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:01.379611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8269fd-6121-435b-8c3c-b09c72c0caa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:01.399438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:01.456616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-bb8269fd-6121-435b-8c3c-b09c72c0caa9 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:01.457824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-bb8269fd-6121-435b-8c3c-b09c72c0caa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:01.565107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 698/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 22:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:01.716550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713ea72-6bcc-4453-8242-6e2d44ad6e17 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:01.718093 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1713ea72-6bcc-4453-8242-6e2d44ad6e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:01.826666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:01.863717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713ea72-6bcc-4453-8242-6e2d44ad6e17 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:01.975428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec3a7a-ef3a-4a03-8d84-fef652b94026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:01.975936 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec3a7a-ef3a-4a03-8d84-fef652b94026 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:01.976220 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec3a7a-ef3a-4a03-8d84-fef652b94026 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:01.976491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec3a7a-ef3a-4a03-8d84-fef652b94026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:01.978107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-79ec3a7a-ef3a-4a03-8d84-fef652b94026 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:02.052316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:02.066461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec3a7a-ef3a-4a03-8d84-fef652b94026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:02.068045 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec3a7a-ef3a-4a03-8d84-fef652b94026 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:02.085592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 727/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:02.947795 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0cbee-4e0f-4e0f-b794-afb408c76c04 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:02.948376 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0cbee-4e0f-4e0f-b794-afb408c76c04 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:02.948376 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0cbee-4e0f-4e0f-b794-afb408c76c04 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:02.949691 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 699/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 22:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:02.955308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be3815-146c-44a2-bcb7-4036143f6010 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:02.955746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be3815-146c-44a2-bcb7-4036143f6010 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:02.955845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be3815-146c-44a2-bcb7-4036143f6010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:03.030803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-20be3815-146c-44a2-bcb7-4036143f6010 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:03.031988 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-20be3815-146c-44a2-bcb7-4036143f6010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:03.127270 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 728/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 22:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:03.281208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0cbee-4e0f-4e0f-b794-afb408c76c04 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:03.282705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-adb0cbee-4e0f-4e0f-b794-afb408c76c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:03.365467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:03.425540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0cbee-4e0f-4e0f-b794-afb408c76c04 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:03.548085 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f01da-ea34-4452-8ac9-b4e597fdfc88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:03.548610 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f01da-ea34-4452-8ac9-b4e597fdfc88 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:03.548888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f01da-ea34-4452-8ac9-b4e597fdfc88 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:03.549155 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f01da-ea34-4452-8ac9-b4e597fdfc88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:03.550821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-260f01da-ea34-4452-8ac9-b4e597fdfc88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:03.598291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:03.640477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f01da-ea34-4452-8ac9-b4e597fdfc88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:03.642051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f01da-ea34-4452-8ac9-b4e597fdfc88 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:03.659703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 700/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:04.472523 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092718b-040d-473e-826f-209dd51bf810 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:04.472995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092718b-040d-473e-826f-209dd51bf810 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:04.473107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092718b-040d-473e-826f-209dd51bf810 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:04.474512 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 729/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 22:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:04.479298 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46980d74-5422-43fe-87c4-907e9ccdd0a7 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:04.479740 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46980d74-5422-43fe-87c4-907e9ccdd0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:04.479881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46980d74-5422-43fe-87c4-907e9ccdd0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:04.554897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-46980d74-5422-43fe-87c4-907e9ccdd0a7 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:04.556094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-46980d74-5422-43fe-87c4-907e9ccdd0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:04.652923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 701/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 22:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:04.805493 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092718b-040d-473e-826f-209dd51bf810 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:04.806942 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8092718b-040d-473e-826f-209dd51bf810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:04.855038 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:04.950274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092718b-040d-473e-826f-209dd51bf810 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:05.063002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3f63-a8d1-4c2c-807b-d32eb2214fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:05.063617 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3f63-a8d1-4c2c-807b-d32eb2214fab service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:05.063899 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3f63-a8d1-4c2c-807b-d32eb2214fab service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:05.064190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3f63-a8d1-4c2c-807b-d32eb2214fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:05.065798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-93bc3f63-a8d1-4c2c-807b-d32eb2214fab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:05.072562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:05.154086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc3f63-a8d1-4c2c-807b-d32eb2214fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:05.156166 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc3f63-a8d1-4c2c-807b-d32eb2214fab service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:05.174070 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 730/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:05.982335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81952cee-85f6-468c-847b-56701d9fffff None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:05.983003 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81952cee-85f6-468c-847b-56701d9fffff None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:05.983003 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81952cee-85f6-468c-847b-56701d9fffff None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:05.984337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 702/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 22:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:05.989544 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323daf0-e44f-4fcd-a23d-59622ef278b0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:05.990001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323daf0-e44f-4fcd-a23d-59622ef278b0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:05.990129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323daf0-e44f-4fcd-a23d-59622ef278b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:06.065471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d323daf0-e44f-4fcd-a23d-59622ef278b0 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:06.066706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d323daf0-e44f-4fcd-a23d-59622ef278b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:06.133527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:06.162568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 731/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 22:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:06.314976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81952cee-85f6-468c-847b-56701d9fffff None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:06.316573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-81952cee-85f6-468c-847b-56701d9fffff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:06.334690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:06.460688 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81952cee-85f6-468c-847b-56701d9fffff None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:06.547142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:06.573024 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cdf5b-8de7-4acb-acc9-dfc702dca071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:06.573603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cdf5b-8de7-4acb-acc9-dfc702dca071 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:06.573885 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cdf5b-8de7-4acb-acc9-dfc702dca071 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:06.574161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cdf5b-8de7-4acb-acc9-dfc702dca071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:06.575846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f27cdf5b-8de7-4acb-acc9-dfc702dca071 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:06.664644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cdf5b-8de7-4acb-acc9-dfc702dca071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:06.666257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cdf5b-8de7-4acb-acc9-dfc702dca071 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:06.684033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 703/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:07.486203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39369c-9733-4e85-9ab0-7775c019f9f2 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:07.486677 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39369c-9733-4e85-9ab0-7775c019f9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:07.486768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39369c-9733-4e85-9ab0-7775c019f9f2 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:07.488119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 732/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 22:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:07.493262 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92598f-957a-4580-aea3-e1514ebee060 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:07.493712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92598f-957a-4580-aea3-e1514ebee060 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:07.493927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92598f-957a-4580-aea3-e1514ebee060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:07.569414 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-7f92598f-957a-4580-aea3-e1514ebee060 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:07.570690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7f92598f-957a-4580-aea3-e1514ebee060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:07.615045 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:07.672024 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 704/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 22:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:07.824393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39369c-9733-4e85-9ab0-7775c019f9f2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:07.825841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2c39369c-9733-4e85-9ab0-7775c019f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:07.968009 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39369c-9733-4e85-9ab0-7775c019f9f2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:08.022241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:08.079763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698aaf2-532d-4f29-800b-d53ea91c3f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:08.080556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698aaf2-532d-4f29-800b-d53ea91c3f18 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:08.080832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698aaf2-532d-4f29-800b-d53ea91c3f18 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:08.081102 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698aaf2-532d-4f29-800b-d53ea91c3f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:08.082734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8698aaf2-532d-4f29-800b-d53ea91c3f18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:08.174989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698aaf2-532d-4f29-800b-d53ea91c3f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:08.176597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698aaf2-532d-4f29-800b-d53ea91c3f18 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:08.194250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 733/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:08.990979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea92ea2-b25c-4a95-9b91-d2aedf92b639 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:08.991547 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea92ea2-b25c-4a95-9b91-d2aedf92b639 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:08.991547 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea92ea2-b25c-4a95-9b91-d2aedf92b639 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:08.992942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 705/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 22:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:08.998160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3a805-29c3-4013-817d-d5a4b0c2ef5a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:08.998596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3a805-29c3-4013-817d-d5a4b0c2ef5a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:08.998751 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3a805-29c3-4013-817d-d5a4b0c2ef5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:09.073300 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7ac3a805-29c3-4013-817d-d5a4b0c2ef5a None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:09.074539 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7ac3a805-29c3-4013-817d-d5a4b0c2ef5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:09.076536 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:09.170339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 734/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 22:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:09.322952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea92ea2-b25c-4a95-9b91-d2aedf92b639 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:09.324565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9ea92ea2-b25c-4a95-9b91-d2aedf92b639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:09.591745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea92ea2-b25c-4a95-9b91-d2aedf92b639 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:09.619669 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:09.706395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd9dcd-76ac-4f44-89b8-364119c80e2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:09.707037 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd9dcd-76ac-4f44-89b8-364119c80e2b service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:09.707316 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd9dcd-76ac-4f44-89b8-364119c80e2b service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:09.707588 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd9dcd-76ac-4f44-89b8-364119c80e2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:09.709282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-fbbd9dcd-76ac-4f44-89b8-364119c80e2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:09.795725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd9dcd-76ac-4f44-89b8-364119c80e2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:09.797907 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd9dcd-76ac-4f44-89b8-364119c80e2b service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:09.815419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 706/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:11.744261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97407051-0779-4907-b1ab-e52d59886c6d None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:11.744772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97407051-0779-4907-b1ab-e52d59886c6d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:11.744772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97407051-0779-4907-b1ab-e52d59886c6d None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:11.746075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 735/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:11.751933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a7088-b0e8-4395-85b6-6c2731254ec9 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:11.752383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a7088-b0e8-4395-85b6-6c2731254ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:11.752580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a7088-b0e8-4395-85b6-6c2731254ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:11.792775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:11.818669 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-0c3a7088-b0e8-4395-85b6-6c2731254ec9 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:11.819867 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0c3a7088-b0e8-4395-85b6-6c2731254ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:11.914085 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 707/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:11.953682 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97407051-0779-4907-b1ab-e52d59886c6d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:11.955515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-97407051-0779-4907-b1ab-e52d59886c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:12.058963 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97407051-0779-4907-b1ab-e52d59886c6d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:12.090449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:12.132399 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a68f9-759d-4f81-81a5-547030006f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:12.133010 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a68f9-759d-4f81-81a5-547030006f58 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:12.133292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a68f9-759d-4f81-81a5-547030006f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:12.133565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a68f9-759d-4f81-81a5-547030006f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:12.135228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f74a68f9-759d-4f81-81a5-547030006f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:12.243261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a68f9-759d-4f81-81a5-547030006f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:12.244703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a68f9-759d-4f81-81a5-547030006f58 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:12.262201 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 736/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:14.411640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd923a-425b-456a-af4f-1245bbd0ab9c None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:14.412224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd923a-425b-456a-af4f-1245bbd0ab9c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:14.412224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd923a-425b-456a-af4f-1245bbd0ab9c None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:14.413545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 708/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:14.418780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6e16-6527-401f-a30f-eac39ac30009 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:14.419229 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6e16-6527-401f-a30f-eac39ac30009 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:14.419347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6e16-6527-401f-a30f-eac39ac30009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:14.486532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-821b6e16-6527-401f-a30f-eac39ac30009 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:14.487749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-821b6e16-6527-401f-a30f-eac39ac30009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:14.500542 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:14.587086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 737/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:14.625652 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd923a-425b-456a-af4f-1245bbd0ab9c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:14.627218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7acd923a-425b-456a-af4f-1245bbd0ab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:14.730624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd923a-425b-456a-af4f-1245bbd0ab9c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:14.742478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:14.803449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ea72c-54aa-4572-bad1-65177eee955a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:14.804059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ea72c-54aa-4572-bad1-65177eee955a service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:14.804341 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ea72c-54aa-4572-bad1-65177eee955a service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:14.804614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ea72c-54aa-4572-bad1-65177eee955a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:14.806227 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9f0ea72c-54aa-4572-bad1-65177eee955a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:14.917429 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ea72c-54aa-4572-bad1-65177eee955a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:14.918895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ea72c-54aa-4572-bad1-65177eee955a service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:14.936579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 709/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:19:17.239667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848d11d-14dd-48a5-b5cc-e60b28d11b17 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:17.240233 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848d11d-14dd-48a5-b5cc-e60b28d11b17 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:17.240233 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848d11d-14dd-48a5-b5cc-e60b28d11b17 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:17.241555 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 738/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:17.246953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba935c-c363-4d21-80c5-b00a752b7b5f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:17.247356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba935c-c363-4d21-80c5-b00a752b7b5f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:17.247462 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba935c-c363-4d21-80c5-b00a752b7b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:17.303094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:17.323101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-34ba935c-c363-4d21-80c5-b00a752b7b5f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:17.324298 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-34ba935c-c363-4d21-80c5-b00a752b7b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:17.419718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 710/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:17.459613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848d11d-14dd-48a5-b5cc-e60b28d11b17 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:17.461176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c848d11d-14dd-48a5-b5cc-e60b28d11b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:17.562799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848d11d-14dd-48a5-b5cc-e60b28d11b17 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:17.602136 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:17.636371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71662d5e-686f-4b3a-9190-1ecb73cc8f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:17.636984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71662d5e-686f-4b3a-9190-1ecb73cc8f9e service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:17.637264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71662d5e-686f-4b3a-9190-1ecb73cc8f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:17.637543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71662d5e-686f-4b3a-9190-1ecb73cc8f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:17.639219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-71662d5e-686f-4b3a-9190-1ecb73cc8f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:17.750599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71662d5e-686f-4b3a-9190-1ecb73cc8f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:17.752030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71662d5e-686f-4b3a-9190-1ecb73cc8f9e service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:17.769491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 739/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:19.920751 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1208a-0791-48ab-ad96-69f6c6cb63a5 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:19.921827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1208a-0791-48ab-ad96-69f6c6cb63a5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:19.921942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1208a-0791-48ab-ad96-69f6c6cb63a5 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:19.923281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 711/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:19.928657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d9809-3c7e-461e-82e5-f8e8c9b8ee8f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:19.929095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d9809-3c7e-461e-82e5-f8e8c9b8ee8f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:19.929203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d9809-3c7e-461e-82e5-f8e8c9b8ee8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:19.993906 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2d4d9809-3c7e-461e-82e5-f8e8c9b8ee8f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:19.995119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2d4d9809-3c7e-461e-82e5-f8e8c9b8ee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:20.016041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:20.090544 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 740/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:20.129234 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1208a-0791-48ab-ad96-69f6c6cb63a5 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:20.130806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0bc1208a-0791-48ab-ad96-69f6c6cb63a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:20.234513 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1208a-0791-48ab-ad96-69f6c6cb63a5 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:20.254422 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:20.308514 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fb78d-630a-416d-b8d5-0a5bd7276445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:20.309129 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb78d-630a-416d-b8d5-0a5bd7276445 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:20.309412 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb78d-630a-416d-b8d5-0a5bd7276445 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:20.309684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb78d-630a-416d-b8d5-0a5bd7276445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:20.311362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-523fb78d-630a-416d-b8d5-0a5bd7276445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:20.418761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fb78d-630a-416d-b8d5-0a5bd7276445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:20.420322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fb78d-630a-416d-b8d5-0a5bd7276445 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:20.438500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 712/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:22.499533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658877d1-c43d-4737-8a28-643389d72794 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:22.500006 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658877d1-c43d-4737-8a28-643389d72794 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:22.500126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658877d1-c43d-4737-8a28-643389d72794 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:22.501451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 741/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:22.506865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4d6ce-ccdd-4915-86a0-7d6f540b32a6 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:22.507324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4d6ce-ccdd-4915-86a0-7d6f540b32a6 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:22.507433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4d6ce-ccdd-4915-86a0-7d6f540b32a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:22.569932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:22.573014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-39b4d6ce-ccdd-4915-86a0-7d6f540b32a6 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:22.574897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-39b4d6ce-ccdd-4915-86a0-7d6f540b32a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:22.671127 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 713/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:22.710071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658877d1-c43d-4737-8a28-643389d72794 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:22.711641 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-658877d1-c43d-4737-8a28-643389d72794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:22.813203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658877d1-c43d-4737-8a28-643389d72794 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:22.861795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:22.886059 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f74fb-a5db-402b-b1df-df402c4e50e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:22.886715 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f74fb-a5db-402b-b1df-df402c4e50e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:22.887000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f74fb-a5db-402b-b1df-df402c4e50e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:22.887278 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f74fb-a5db-402b-b1df-df402c4e50e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:22.888903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c00f74fb-a5db-402b-b1df-df402c4e50e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:22.995996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f74fb-a5db-402b-b1df-df402c4e50e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:22.997435 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f74fb-a5db-402b-b1df-df402c4e50e3 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:23.015456 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 742/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:25.075486 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8ecdc-deff-49ea-8741-9d1bea91641b None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:25.076013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8ecdc-deff-49ea-8741-9d1bea91641b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:25.076013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8ecdc-deff-49ea-8741-9d1bea91641b None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:25.077401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 714/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:25.083715 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0cedb-3605-490a-8382-af4b65f73c05 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:25.084141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0cedb-3605-490a-8382-af4b65f73c05 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:25.084276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0cedb-3605-490a-8382-af4b65f73c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:25.151190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8ab0cedb-3605-490a-8382-af4b65f73c05 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:25.152406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8ab0cedb-3605-490a-8382-af4b65f73c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:25.181358 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:25.249194 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 743/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:25.288309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8ecdc-deff-49ea-8741-9d1bea91641b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:25.289837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d2c8ecdc-deff-49ea-8741-9d1bea91641b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:25.398503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8ecdc-deff-49ea-8741-9d1bea91641b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:25.426761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:25.473567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd8bb0-dfcc-422a-a1c9-b9af7afd9d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:25.474196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8bb0-dfcc-422a-a1c9-b9af7afd9d4c service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:25.474505 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8bb0-dfcc-422a-a1c9-b9af7afd9d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:25.474783 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd8bb0-dfcc-422a-a1c9-b9af7afd9d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:25.476404 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c7cd8bb0-dfcc-422a-a1c9-b9af7afd9d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:25.584437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd8bb0-dfcc-422a-a1c9-b9af7afd9d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:25.585861 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd8bb0-dfcc-422a-a1c9-b9af7afd9d4c service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:25.603459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 715/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:27.770540 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beb88c-4db3-41f4-820a-72212f585a55 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:27.771103 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beb88c-4db3-41f4-820a-72212f585a55 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:27.771103 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5beb88c-4db3-41f4-820a-72212f585a55 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:27.772422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 744/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:27.777540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614f66-e68e-4d44-b67c-be173afe6173 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:27.777951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614f66-e68e-4d44-b67c-be173afe6173 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:27.778092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614f66-e68e-4d44-b67c-be173afe6173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:27.853670 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-52614f66-e68e-4d44-b67c-be173afe6173 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:27.854905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-52614f66-e68e-4d44-b67c-be173afe6173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:27.863123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:27.950195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 716/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:27.988493 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5beb88c-4db3-41f4-820a-72212f585a55 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:27.990112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c5beb88c-4db3-41f4-820a-72212f585a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:28.092441 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5beb88c-4db3-41f4-820a-72212f585a55 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:28.149959 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:28.168342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bb9ef-6e58-494f-b2dc-cd6462417a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:28.168969 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bb9ef-6e58-494f-b2dc-cd6462417a47 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:28.169253 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bb9ef-6e58-494f-b2dc-cd6462417a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:28.169527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bb9ef-6e58-494f-b2dc-cd6462417a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:28.171174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-494bb9ef-6e58-494f-b2dc-cd6462417a47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:28.277965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bb9ef-6e58-494f-b2dc-cd6462417a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:28.279430 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bb9ef-6e58-494f-b2dc-cd6462417a47 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:28.297686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 745/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:30.350271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3e9c3-b72a-419c-bb9c-48954316bd8e None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:30.350838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3e9c3-b72a-419c-bb9c-48954316bd8e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:30.350838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3e9c3-b72a-419c-bb9c-48954316bd8e None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:30.352219 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 717/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:30.357562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e267a63-106b-41ec-ac8f-b6b179350cd3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:30.357974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e267a63-106b-41ec-ac8f-b6b179350cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:30.358155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e267a63-106b-41ec-ac8f-b6b179350cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:30.429189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7e267a63-106b-41ec-ac8f-b6b179350cd3 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:30.430429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7e267a63-106b-41ec-ac8f-b6b179350cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:30.469280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:30.527639 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 746/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:30.565969 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3e9c3-b72a-419c-bb9c-48954316bd8e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:30.567569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-47f3e9c3-b72a-419c-bb9c-48954316bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:30.670380 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3e9c3-b72a-419c-bb9c-48954316bd8e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:30.708577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:30.744119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66132356-aa5b-47fd-afab-e19a9f15f7f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:30.744731 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66132356-aa5b-47fd-afab-e19a9f15f7f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:30.745010 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66132356-aa5b-47fd-afab-e19a9f15f7f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:30.745281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66132356-aa5b-47fd-afab-e19a9f15f7f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:30.746940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-66132356-aa5b-47fd-afab-e19a9f15f7f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:30.853684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66132356-aa5b-47fd-afab-e19a9f15f7f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:30.855151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66132356-aa5b-47fd-afab-e19a9f15f7f8 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:30.872770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 718/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:32.919944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8382e7-1b6e-45a7-b295-d0966dfc1678 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:32.920490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8382e7-1b6e-45a7-b295-d0966dfc1678 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:32.920490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8382e7-1b6e-45a7-b295-d0966dfc1678 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:32.921841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 747/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:32.927153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c4996-f1ba-4288-ae6d-1c0a9ee38d6a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:32.927561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c4996-f1ba-4288-ae6d-1c0a9ee38d6a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:32.927676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c4996-f1ba-4288-ae6d-1c0a9ee38d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:32.994644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-707c4996-f1ba-4288-ae6d-1c0a9ee38d6a None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:32.995850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-707c4996-f1ba-4288-ae6d-1c0a9ee38d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:33.014107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:33.095261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 719/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:33.131718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8382e7-1b6e-45a7-b295-d0966dfc1678 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:33.133280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ed8382e7-1b6e-45a7-b295-d0966dfc1678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:33.235535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8382e7-1b6e-45a7-b295-d0966dfc1678 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:33.300748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:33.312941 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103fdd1-a38c-4867-ac43-bc75533c0699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:33.313587 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103fdd1-a38c-4867-ac43-bc75533c0699 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:33.313863 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103fdd1-a38c-4867-ac43-bc75533c0699 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:33.314132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103fdd1-a38c-4867-ac43-bc75533c0699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:33.315798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1103fdd1-a38c-4867-ac43-bc75533c0699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:33.423110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103fdd1-a38c-4867-ac43-bc75533c0699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:33.424548 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103fdd1-a38c-4867-ac43-bc75533c0699 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:33.442750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 748/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:35.490055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501eaab-6dba-41c3-b62e-5211b7cab952 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:35.490636 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501eaab-6dba-41c3-b62e-5211b7cab952 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:35.490636 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501eaab-6dba-41c3-b62e-5211b7cab952 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:35.491979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 720/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:35.497275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e6179-b4cf-481f-a23b-91ec136a552b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:35.497691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e6179-b4cf-481f-a23b-91ec136a552b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:35.497830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e6179-b4cf-481f-a23b-91ec136a552b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:35.562264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-513e6179-b4cf-481f-a23b-91ec136a552b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:35.563567 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-513e6179-b4cf-481f-a23b-91ec136a552b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:35.611920 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:35.660969 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 749/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:35.697020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501eaab-6dba-41c3-b62e-5211b7cab952 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:35.698619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4501eaab-6dba-41c3-b62e-5211b7cab952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:35.800066 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501eaab-6dba-41c3-b62e-5211b7cab952 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:35.847253 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:35.872973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b359f-b193-41d5-9343-9dab7eb87adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:35.873586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b359f-b193-41d5-9343-9dab7eb87adc service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:35.873866 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b359f-b193-41d5-9343-9dab7eb87adc service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:35.874137 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b359f-b193-41d5-9343-9dab7eb87adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:35.875794 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-fc6b359f-b193-41d5-9343-9dab7eb87adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:35.994365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b359f-b193-41d5-9343-9dab7eb87adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:35.995823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b359f-b193-41d5-9343-9dab7eb87adc service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:36.013378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 721/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:45.659137 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=22 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:46.011162 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=66 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:55.450994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e59feb-c026-4e80-9389-db026a17df33 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:55.451558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e59feb-c026-4e80-9389-db026a17df33 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:55.451558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e59feb-c026-4e80-9389-db026a17df33 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:55.453595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 750/1471] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:55.459238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea72b87-7851-4aae-aaad-29652e31f9ac None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:55.459673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea72b87-7851-4aae-aaad-29652e31f9ac None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:55.459789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea72b87-7851-4aae-aaad-29652e31f9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:55.524141 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-7ea72b87-7851-4aae-aaad-29652e31f9ac None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:55.525337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7ea72b87-7851-4aae-aaad-29652e31f9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:55.621215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 722/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:19:55.704599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465563c-84b9-4a4a-8509-7b4363b5b987 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:55.704830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465563c-84b9-4a4a-8509-7b4363b5b987 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:55.705368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465563c-84b9-4a4a-8509-7b4363b5b987 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:55.706774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 751/1473] 10.222.0.27 () {54 vars in 966 bytes} [Thu Aug 4 22:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:55.711563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9706d-6e16-4ed4-a740-dd8b72d2825c None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:55.711858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9706d-6e16-4ed4-a740-dd8b72d2825c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:55.712139 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9706d-6e16-4ed4-a740-dd8b72d2825c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:55.787452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-1cb9706d-6e16-4ed4-a740-dd8b72d2825c None None] MFA Rules not processed for user `fce7db16c4904fb1b75ac7910f4470f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:55.788654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1cb9706d-6e16-4ed4-a740-dd8b72d2825c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:55.809096 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:55.864574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 723/1474] 10.222.0.27 () {58 vars in 1063 bytes} [Thu Aug 4 22:19:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:55.872217 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465563c-84b9-4a4a-8509-7b4363b5b987 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:55.873722 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9465563c-84b9-4a4a-8509-7b4363b5b987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:55.977616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465563c-84b9-4a4a-8509-7b4363b5b987 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:56.049474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458944ca-c52c-4ce9-b284-1772ebda430c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce7db16c4904fb1b75ac7910f4470f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:56.050088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458944ca-c52c-4ce9-b284-1772ebda430c service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:56.050369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458944ca-c52c-4ce9-b284-1772ebda430c service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:56.050673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458944ca-c52c-4ce9-b284-1772ebda430c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:56.052295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-458944ca-c52c-4ce9-b284-1772ebda430c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:56.106128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:56.166172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458944ca-c52c-4ce9-b284-1772ebda430c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:56.167637 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458944ca-c52c-4ce9-b284-1772ebda430c service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:56.185849 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 752/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:19:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:19:58.287812 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31028aa6-6f6e-4dd2-9a45-17b710866eba None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:58.288385 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31028aa6-6f6e-4dd2-9a45-17b710866eba None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:58.288488 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31028aa6-6f6e-4dd2-9a45-17b710866eba None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:58.289841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 724/1476] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:19:58.295393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a97464-d365-449c-b948-fd8830fc8870 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:58.295861 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a97464-d365-449c-b948-fd8830fc8870 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:58.295965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a97464-d365-449c-b948-fd8830fc8870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:58.364430 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e2a97464-d365-449c-b948-fd8830fc8870 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:19:58.365558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e2a97464-d365-449c-b948-fd8830fc8870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:58.461539 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 753/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:19:58.485062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31028aa6-6f6e-4dd2-9a45-17b710866eba None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:19:58.486646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-31028aa6-6f6e-4dd2-9a45-17b710866eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:19:58.607904 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31028aa6-6f6e-4dd2-9a45-17b710866eba None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:19:58.655539 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:19:58.699585 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc908d00-2a6a-4eb5-99f1-77922fee32ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:19:58.700201 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908d00-2a6a-4eb5-99f1-77922fee32ae admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:19:58.700481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908d00-2a6a-4eb5-99f1-77922fee32ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:19:58.700752 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908d00-2a6a-4eb5-99f1-77922fee32ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:19:58.701441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc908d00-2a6a-4eb5-99f1-77922fee32ae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:19:58.703217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: WARNING py.warnings [None req-dc908d00-2a6a-4eb5-99f1-77922fee32ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:19:58.703217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: warnings.warn(msg) Aug 04 22:19:58.703217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: Aug 04 22:19:58.704354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc908d00-2a6a-4eb5-99f1-77922fee32ae admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:19:58.723325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 725/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Thu Aug 4 22:19:58 2022] GET /identity/v3/projects => generated 2553 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:20:00.738635 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66919c0-3417-45f1-950f-045669188c9c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:00.739164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66919c0-3417-45f1-950f-045669188c9c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:00.739164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66919c0-3417-45f1-950f-045669188c9c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:00.740495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 754/1479] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:20:00.745896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de5779-7208-4ef0-88f0-93297ddc82f1 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:00.746318 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de5779-7208-4ef0-88f0-93297ddc82f1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:00.746476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de5779-7208-4ef0-88f0-93297ddc82f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:00.813089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-28de5779-7208-4ef0-88f0-93297ddc82f1 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:20:00.814304 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-28de5779-7208-4ef0-88f0-93297ddc82f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:00.911425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 726/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:20:00.955679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66919c0-3417-45f1-950f-045669188c9c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:20:00.957259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e66919c0-3417-45f1-950f-045669188c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:00.967020 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:01.104393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66919c0-3417-45f1-950f-045669188c9c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:20:01.182620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:01.217356 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d242a-00fd-450e-9566-6cb0eb325ebc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:20:01.217965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d242a-00fd-450e-9566-6cb0eb325ebc service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:01.218241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d242a-00fd-450e-9566-6cb0eb325ebc service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:01.219145 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d242a-00fd-450e-9566-6cb0eb325ebc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:01.220747 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f32d242a-00fd-450e-9566-6cb0eb325ebc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:01.307225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d242a-00fd-450e-9566-6cb0eb325ebc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:20:01.308738 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d242a-00fd-450e-9566-6cb0eb325ebc service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:20:01.326304 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 755/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:20:03.525319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b73872-c8b6-4142-8e82-3949d9bb6092 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:03.525841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b73872-c8b6-4142-8e82-3949d9bb6092 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:03.525938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b73872-c8b6-4142-8e82-3949d9bb6092 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:03.527273 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 727/1482] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:20:03.533052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48879e3-4293-4be2-97b6-f761c753b191 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:03.533506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48879e3-4293-4be2-97b6-f761c753b191 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:03.533612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48879e3-4293-4be2-97b6-f761c753b191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:03.599063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b48879e3-4293-4be2-97b6-f761c753b191 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:20:03.600273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b48879e3-4293-4be2-97b6-f761c753b191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:03.646688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:03.698472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 756/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:20:03.736107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b73872-c8b6-4142-8e82-3949d9bb6092 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:20:03.737659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-49b73872-c8b6-4142-8e82-3949d9bb6092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:03.761144 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:03.841296 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b73872-c8b6-4142-8e82-3949d9bb6092 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:20:03.914016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466adf0d-4d7e-45ca-aef0-1caa0f10312a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:20:03.914664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466adf0d-4d7e-45ca-aef0-1caa0f10312a service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:03.914949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466adf0d-4d7e-45ca-aef0-1caa0f10312a service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:03.915225 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466adf0d-4d7e-45ca-aef0-1caa0f10312a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:03.916880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-466adf0d-4d7e-45ca-aef0-1caa0f10312a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:03.990582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:04.027214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466adf0d-4d7e-45ca-aef0-1caa0f10312a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:20:04.028700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466adf0d-4d7e-45ca-aef0-1caa0f10312a service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:20:04.048746 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 728/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:20:06.121420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd7769-3399-496c-be8d-9298207be75a None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:06.121988 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd7769-3399-496c-be8d-9298207be75a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:06.121988 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd7769-3399-496c-be8d-9298207be75a None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:06.123367 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 757/1485] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:20:06.128696 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7674d55-6c90-49f3-bb00-d0ce0460eaec None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:06.129087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7674d55-6c90-49f3-bb00-d0ce0460eaec None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:06.129354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7674d55-6c90-49f3-bb00-d0ce0460eaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:06.194870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a7674d55-6c90-49f3-bb00-d0ce0460eaec None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:20:06.196073 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a7674d55-6c90-49f3-bb00-d0ce0460eaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:06.298322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 729/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:20:06.337080 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd7769-3399-496c-be8d-9298207be75a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:20:06.338652 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-79fd7769-3399-496c-be8d-9298207be75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:06.439808 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd7769-3399-496c-be8d-9298207be75a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:20:06.511599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:06.513383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebe824-9a10-4b89-8be9-36fba0224718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:20:06.514050 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebe824-9a10-4b89-8be9-36fba0224718 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:06.514557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebe824-9a10-4b89-8be9-36fba0224718 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:06.514997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebe824-9a10-4b89-8be9-36fba0224718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:06.517331 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-43ebe824-9a10-4b89-8be9-36fba0224718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:06.624290 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebe824-9a10-4b89-8be9-36fba0224718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:20:06.625753 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebe824-9a10-4b89-8be9-36fba0224718 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:20:06.643917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 758/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:20:08.791898 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3f90e-8cf5-46f9-b0e9-8be0aca20df3 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:08.792461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3f90e-8cf5-46f9-b0e9-8be0aca20df3 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:08.792461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3f90e-8cf5-46f9-b0e9-8be0aca20df3 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:08.793726 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 730/1488] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:20:08.798927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37894f46-31a8-477f-bb9f-a578a31f2218 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:08.799366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37894f46-31a8-477f-bb9f-a578a31f2218 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:08.799494 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37894f46-31a8-477f-bb9f-a578a31f2218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:08.864647 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-37894f46-31a8-477f-bb9f-a578a31f2218 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:20:08.865857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-37894f46-31a8-477f-bb9f-a578a31f2218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:08.918615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:08.963390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 759/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:20:09.004358 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3f90e-8cf5-46f9-b0e9-8be0aca20df3 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:20:09.005879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-cec3f90e-8cf5-46f9-b0e9-8be0aca20df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:09.041262 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:09.109401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3f90e-8cf5-46f9-b0e9-8be0aca20df3 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:20:09.181724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968f8c8-0200-4975-8f95-0bb74240fc9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:20:09.182337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968f8c8-0200-4975-8f95-0bb74240fc9a service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:09.182645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968f8c8-0200-4975-8f95-0bb74240fc9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:09.182920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968f8c8-0200-4975-8f95-0bb74240fc9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:09.184537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5968f8c8-0200-4975-8f95-0bb74240fc9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:09.267712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:09.297117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968f8c8-0200-4975-8f95-0bb74240fc9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:20:09.298575 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968f8c8-0200-4975-8f95-0bb74240fc9a service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:20:09.316258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 731/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:20:11.507020 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b9508-098f-4f88-8abf-ee4064f704b7 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:11.507501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b9508-098f-4f88-8abf-ee4064f704b7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:11.507607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b9508-098f-4f88-8abf-ee4064f704b7 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:11.508966 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 760/1491] 10.222.0.27 () {54 vars in 927 bytes} [Thu Aug 4 22:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:20:11.513978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9199b-57a3-4529-a89d-fdf483b85b6b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:11.514397 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9199b-57a3-4529-a89d-fdf483b85b6b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:11.514554 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9199b-57a3-4529-a89d-fdf483b85b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:11.579774 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-10d9199b-57a3-4529-a89d-fdf483b85b6b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:20:11.581230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-10d9199b-57a3-4529-a89d-fdf483b85b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:11.680196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 732/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Thu Aug 4 22:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:20:11.719616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b9508-098f-4f88-8abf-ee4064f704b7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:20:11.721114 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-965b9508-098f-4f88-8abf-ee4064f704b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:11.822597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b9508-098f-4f88-8abf-ee4064f704b7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:20:11.894168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03dd9e-01c5-4dec-8f1c-25e339587c09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:20:11.894882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03dd9e-01c5-4dec-8f1c-25e339587c09 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:20:11.895167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03dd9e-01c5-4dec-8f1c-25e339587c09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:20:11.895442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03dd9e-01c5-4dec-8f1c-25e339587c09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:20:11.897057 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4d03dd9e-01c5-4dec-8f1c-25e339587c09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:20:11.905896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:12.005987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03dd9e-01c5-4dec-8f1c-25e339587c09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:20:12.007375 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03dd9e-01c5-4dec-8f1c-25e339587c09 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:20:12.024887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 761/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:20:21.678357 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=82 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:20:22.022646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=50 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:22.089783 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1e72f-6a6f-401c-a691-122530a2ad6b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:22.090392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1e72f-6a6f-401c-a691-122530a2ad6b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:22.090392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1e72f-6a6f-401c-a691-122530a2ad6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:22.166897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-32a1e72f-6a6f-401c-a691-122530a2ad6b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:21:22.168115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-32a1e72f-6a6f-401c-a691-122530a2ad6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:22.262923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 733/1494] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:21:22.271691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a75d5d-b409-4c8c-b8dc-dbb308c6a7e1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:22.272199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a75d5d-b409-4c8c-b8dc-dbb308c6a7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:22.272306 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a75d5d-b409-4c8c-b8dc-dbb308c6a7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:22.349801 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-37a75d5d-b409-4c8c-b8dc-dbb308c6a7e1 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:21:22.350963 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-37a75d5d-b409-4c8c-b8dc-dbb308c6a7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:22.446303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 762/1495] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:21:22.451683 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1e72f-6a6f-401c-a691-122530a2ad6b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:21:22.452991 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-32a1e72f-6a6f-401c-a691-122530a2ad6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:22.464676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1e72f-6a6f-401c-a691-122530a2ad6b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:21:22.524645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:22.557289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7a8d0-3f2e-4900-b38b-f1c0f3e9e3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:21:22.557903 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7a8d0-3f2e-4900-b38b-f1c0f3e9e3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:22.558180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7a8d0-3f2e-4900-b38b-f1c0f3e9e3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:22.558478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7a8d0-3f2e-4900-b38b-f1c0f3e9e3d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:22.559165 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7a8d0-3f2e-4900-b38b-f1c0f3e9e3d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:21:22.559470 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7a8d0-3f2e-4900-b38b-f1c0f3e9e3d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:21:22.564766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: WARNING py.warnings [None req-cfd7a8d0-3f2e-4900-b38b-f1c0f3e9e3d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:21:22.564766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: warnings.warn(msg) Aug 04 22:21:22.564766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: Aug 04 22:21:22.565676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7a8d0-3f2e-4900-b38b-f1c0f3e9e3d4 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:21:22.579720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 734/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:21:22.588953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a75d5d-b409-4c8c-b8dc-dbb308c6a7e1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:21:22.598577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a75d5d-b409-4c8c-b8dc-dbb308c6a7e1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:21:22.659079 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:22.693368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622373ad-631a-4147-bdd8-3c6654a6c7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:21:22.693988 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622373ad-631a-4147-bdd8-3c6654a6c7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:22.694271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622373ad-631a-4147-bdd8-3c6654a6c7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:22.694583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622373ad-631a-4147-bdd8-3c6654a6c7f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:22.695246 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622373ad-631a-4147-bdd8-3c6654a6c7f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:21:22.696975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-622373ad-631a-4147-bdd8-3c6654a6c7f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:21:22.696975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 04 22:21:22.696975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: Aug 04 22:21:22.698180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622373ad-631a-4147-bdd8-3c6654a6c7f1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:21:22.754555 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 763/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:21:22 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:21:22.758950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7a8d0-3f2e-4900-b38b-f1c0f3e9e3d4 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:21:22.760494 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-cfd7a8d0-3f2e-4900-b38b-f1c0f3e9e3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:22.793143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7a8d0-3f2e-4900-b38b-f1c0f3e9e3d4 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:21:22.884648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1dd4c-f186-4c96-98ee-6b21c1b4d7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:21:22.885270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1dd4c-f186-4c96-98ee-6b21c1b4d7cb admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:22.885585 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1dd4c-f186-4c96-98ee-6b21c1b4d7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:22.885862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1dd4c-f186-4c96-98ee-6b21c1b4d7cb admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:22.886575 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1dd4c-f186-4c96-98ee-6b21c1b4d7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:21:22.887611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: WARNING py.warnings [None req-0dc1dd4c-f186-4c96-98ee-6b21c1b4d7cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:21:22.887611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: warnings.warn(msg) Aug 04 22:21:22.887611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: Aug 04 22:21:22.888885 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1dd4c-f186-4c96-98ee-6b21c1b4d7cb admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:21:22.936533 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 735/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:21:22 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:21:22.940628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622373ad-631a-4147-bdd8-3c6654a6c7f1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:21:22.942252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-622373ad-631a-4147-bdd8-3c6654a6c7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:23.003538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622373ad-631a-4147-bdd8-3c6654a6c7f1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:21:23.096516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:23.109648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77316c9-45b3-4b17-a1fe-f8bbe58feaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:21:23.110271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77316c9-45b3-4b17-a1fe-f8bbe58feaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:23.110593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77316c9-45b3-4b17-a1fe-f8bbe58feaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:23.110867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77316c9-45b3-4b17-a1fe-f8bbe58feaf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:23.111587 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77316c9-45b3-4b17-a1fe-f8bbe58feaf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:21:23.112610 dv-cinder-852211-1-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-f77316c9-45b3-4b17-a1fe-f8bbe58feaf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:21:23.112610 dv-cinder-852211-1-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 04 22:21:23.112610 dv-cinder-852211-1-smb devstack@keystone.service[80285]: Aug 04 22:21:23.113497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77316c9-45b3-4b17-a1fe-f8bbe58feaf8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:21:23.126432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 764/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:21:23.130461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1dd4c-f186-4c96-98ee-6b21c1b4d7cb admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:21:23.132004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0dc1dd4c-f186-4c96-98ee-6b21c1b4d7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:23.143460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1dd4c-f186-4c96-98ee-6b21c1b4d7cb admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:21:23.168807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:23.239918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfda9e6-ebff-4124-a93d-e8551c26686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:21:23.240485 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfda9e6-ebff-4124-a93d-e8551c26686c admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:23.240767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfda9e6-ebff-4124-a93d-e8551c26686c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:23.241042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfda9e6-ebff-4124-a93d-e8551c26686c admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:23.241743 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfda9e6-ebff-4124-a93d-e8551c26686c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:21:23.242777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: WARNING py.warnings [None req-ebfda9e6-ebff-4124-a93d-e8551c26686c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:21:23.242777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: warnings.warn(msg) Aug 04 22:21:23.242777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: Aug 04 22:21:23.243671 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfda9e6-ebff-4124-a93d-e8551c26686c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:21:23.257685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 736/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:21:23.260823 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77316c9-45b3-4b17-a1fe-f8bbe58feaf8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:21:23.262664 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f77316c9-45b3-4b17-a1fe-f8bbe58feaf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:23.296402 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77316c9-45b3-4b17-a1fe-f8bbe58feaf8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:21:23.389232 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcf810-6663-487e-9d59-93905078be64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:21:23.389886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcf810-6663-487e-9d59-93905078be64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:23.390162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcf810-6663-487e-9d59-93905078be64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:23.390449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcf810-6663-487e-9d59-93905078be64 admin admin] PATH_INFO: `/v3/projects/faeee0b413494a68ab5985e3dfbb2f48/users/7451a23e7304435d92e8b57d43f7fc94/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:23.412482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcf810-6663-487e-9d59-93905078be64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faeee0b413494a68ab5985e3dfbb2f48, user_id=7451a23e7304435d92e8b57d43f7fc94, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:21:23.413503 dv-cinder-852211-1-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-1cfcf810-6663-487e-9d59-93905078be64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:21:23.413503 dv-cinder-852211-1-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 04 22:21:23.413503 dv-cinder-852211-1-smb devstack@keystone.service[80285]: Aug 04 22:21:23.415455 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcf810-6663-487e-9d59-93905078be64 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:21:23.439525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 765/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:21:23 2022] PUT /identity/v3/projects/faeee0b413494a68ab5985e3dfbb2f48/users/7451a23e7304435d92e8b57d43f7fc94/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:21:23.451543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d9ee7-369f-480a-8f95-da7a28695dd0 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:23.451836 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d9ee7-369f-480a-8f95-da7a28695dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:23.452120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d9ee7-369f-480a-8f95-da7a28695dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:23.510789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-bf3d9ee7-369f-480a-8f95-da7a28695dd0 None None] MFA Rules not processed for user `7451a23e7304435d92e8b57d43f7fc94`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:21:23.511934 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-bf3d9ee7-369f-480a-8f95-da7a28695dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:23.588996 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 737/1502] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:21:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:21:23.602911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fbca1-0c37-4777-8460-b874464243e0 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:23.603205 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fbca1-0c37-4777-8460-b874464243e0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:23.603484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fbca1-0c37-4777-8460-b874464243e0 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:23.604837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 766/1503] 10.222.0.27 () {54 vars in 964 bytes} [Thu Aug 4 22:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:21:23.609775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a2b93-841a-4779-8bd2-8d043104c8bd None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:23.610070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a2b93-841a-4779-8bd2-8d043104c8bd None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:23.610350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a2b93-841a-4779-8bd2-8d043104c8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:23.641107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:23.684692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-031a2b93-841a-4779-8bd2-8d043104c8bd None None] MFA Rules not processed for user `d3b29a204dff42c399f0d143b3d0189f`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:21:23.685937 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-031a2b93-841a-4779-8bd2-8d043104c8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:23.760577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 738/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Thu Aug 4 22:21:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:21:23.768837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fbca1-0c37-4777-8460-b874464243e0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:21:23.770365 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ab9fbca1-0c37-4777-8460-b874464243e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:23.819854 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:23.873796 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fbca1-0c37-4777-8460-b874464243e0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:21:23.945820 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532b127-3557-486f-b026-4e1e9484d5c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:21:23.946455 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532b127-3557-486f-b026-4e1e9484d5c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:23.946744 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532b127-3557-486f-b026-4e1e9484d5c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:23.947023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532b127-3557-486f-b026-4e1e9484d5c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:23.948650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b532b127-3557-486f-b026-4e1e9484d5c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:24.045719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532b127-3557-486f-b026-4e1e9484d5c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:21:24.047119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532b127-3557-486f-b026-4e1e9484d5c6 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:21:24.050634 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:24.065676 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 767/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:21:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:21:24.110145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d945ca-2128-45d5-beb0-91d7cc24e571 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:24.110467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d945ca-2128-45d5-beb0-91d7cc24e571 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:24.110745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d945ca-2128-45d5-beb0-91d7cc24e571 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:24.112054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 739/1506] 10.222.0.27 () {52 vars in 830 bytes} [Thu Aug 4 22:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:21:24.115599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532b127-3557-486f-b026-4e1e9484d5c6 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:21:24.116851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b532b127-3557-486f-b026-4e1e9484d5c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:24.216767 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532b127-3557-486f-b026-4e1e9484d5c6 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:21:24.309420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:21:24.310663 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:24.310839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:24.311118 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] PATH_INFO: `/v3/users/7451a23e7304435d92e8b57d43f7fc94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:24.324987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7451a23e7304435d92e8b57d43f7fc94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:21:24.326043 dv-cinder-852211-1-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:21:24.326043 dv-cinder-852211-1-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 04 22:21:24.326043 dv-cinder-852211-1-smb devstack@keystone.service[80285]: Aug 04 22:21:24.327309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:21:24.337069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:24.392963 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7451a23e7304435d92e8b57d43f7fc94'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:21:24.402489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7451a23e7304435d92e8b57d43f7fc94'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:21:24.425282 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7451a23e7304435d92e8b57d43f7fc94'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:21:24.425814 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7451a23e7304435d92e8b57d43f7fc94'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:21:24.439845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7451a23e7304435d92e8b57d43f7fc94'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:21:24.445248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 768/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:21:24 2022] DELETE /identity/v3/users/7451a23e7304435d92e8b57d43f7fc94 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:21:24.449716 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f412f5-de8b-4700-acf0-38a6b4eff9ea None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:24.450195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f412f5-de8b-4700-acf0-38a6b4eff9ea None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:24.450309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f412f5-de8b-4700-acf0-38a6b4eff9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:24.507365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-15f412f5-de8b-4700-acf0-38a6b4eff9ea None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:21:24.508580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-15f412f5-de8b-4700-acf0-38a6b4eff9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:24.582447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:24.595117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 740/1508] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:21:24.604896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:21:24.606119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:24.705006 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1850b-1b4a-4e90-961c-8b5c709ec6bb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:21:24.759739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:24.779698 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1e6bb-b654-4d02-85d5-95d92d69673e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:21:24.780307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1e6bb-b654-4d02-85d5-95d92d69673e service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:24.780584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1e6bb-b654-4d02-85d5-95d92d69673e service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:24.780855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1e6bb-b654-4d02-85d5-95d92d69673e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:24.782483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d3b1e6bb-b654-4d02-85d5-95d92d69673e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:24.890382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1e6bb-b654-4d02-85d5-95d92d69673e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:21:24.891818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1e6bb-b654-4d02-85d5-95d92d69673e service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:21:24.910329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 769/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:21:25.253897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f412f5-de8b-4700-acf0-38a6b4eff9ea None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:21:25.255161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-15f412f5-de8b-4700-acf0-38a6b4eff9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:21:25.266592 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f412f5-de8b-4700-acf0-38a6b4eff9ea None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:21:25.370818 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da787c-b8e6-4211-9025-896d78c289bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:21:25.371463 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da787c-b8e6-4211-9025-896d78c289bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:21:25.371739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da787c-b8e6-4211-9025-896d78c289bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:21:25.372007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da787c-b8e6-4211-9025-896d78c289bb admin admin] PATH_INFO: `/v3/projects/faeee0b413494a68ab5985e3dfbb2f48` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:21:25.382974 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da787c-b8e6-4211-9025-896d78c289bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=faeee0b413494a68ab5985e3dfbb2f48)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:21:25.384016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: WARNING py.warnings [None req-16da787c-b8e6-4211-9025-896d78c289bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:21:25.384016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: warnings.warn(msg) Aug 04 22:21:25.384016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: Aug 04 22:21:25.385266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da787c-b8e6-4211-9025-896d78c289bb admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:21:25.443087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-16da787c-b8e6-4211-9025-896d78c289bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faeee0b413494a68ab5985e3dfbb2f48', 'request_id': 'req-16da787c-b8e6-4211-9025-896d78c289bb'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:21:25.453108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-16da787c-b8e6-4211-9025-896d78c289bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faeee0b413494a68ab5985e3dfbb2f48', 'request_id': 'req-16da787c-b8e6-4211-9025-896d78c289bb'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:21:25.459652 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-16da787c-b8e6-4211-9025-896d78c289bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faeee0b413494a68ab5985e3dfbb2f48', 'request_id': 'req-16da787c-b8e6-4211-9025-896d78c289bb'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:21:25.494526 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-16da787c-b8e6-4211-9025-896d78c289bb admin admin] The token cache is being invalidate because project faeee0b413494a68ab5985e3dfbb2f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:21:25.494818 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-16da787c-b8e6-4211-9025-896d78c289bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:21:25.495358 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-16da787c-b8e6-4211-9025-896d78c289bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:21:25.496734 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 741/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:21:25 2022] DELETE /identity/v3/projects/faeee0b413494a68ab5985e3dfbb2f48 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:21:34.908078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=62 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:21:35.493621 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:08.977651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4757d50-0e28-447d-a622-19f41e9199fc None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:08.978274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4757d50-0e28-447d-a622-19f41e9199fc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:08.978274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4757d50-0e28-447d-a622-19f41e9199fc None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:08.979597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 770/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 22:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:23:08.984982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaeec5-7251-469c-b032-128cc24e9e88 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:08.985454 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaeec5-7251-469c-b032-128cc24e9e88 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:08.985583 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaeec5-7251-469c-b032-128cc24e9e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:09.076533 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-64eaeec5-7251-469c-b032-128cc24e9e88 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:23:09.076533 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-64eaeec5-7251-469c-b032-128cc24e9e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:09.177202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 742/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 22:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:23:09.342173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4757d50-0e28-447d-a622-19f41e9199fc None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:23:09.344397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a4757d50-0e28-447d-a622-19f41e9199fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:09.471320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4757d50-0e28-447d-a622-19f41e9199fc None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:23:09.477083 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037870d-8651-4b36-a315-7b293be9589e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:23:09.477700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037870d-8651-4b36-a315-7b293be9589e service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:09.478034 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037870d-8651-4b36-a315-7b293be9589e service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:09.478342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037870d-8651-4b36-a315-7b293be9589e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:09.487338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037870d-8651-4b36-a315-7b293be9589e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:23:09.488986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037870d-8651-4b36-a315-7b293be9589e service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:23:09.499069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 771/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:23:10.358701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f9e02-6983-42ce-9aeb-056bc558eea8 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:10.359315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f9e02-6983-42ce-9aeb-056bc558eea8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:10.359315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f9e02-6983-42ce-9aeb-056bc558eea8 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:10.360627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 743/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 22:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:23:10.366287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb59ce-ceab-4bf5-9908-30989772bec5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:10.366808 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb59ce-ceab-4bf5-9908-30989772bec5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:10.366916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb59ce-ceab-4bf5-9908-30989772bec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:10.386913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-63cb59ce-ceab-4bf5-9908-30989772bec5 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:23:10.388143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-63cb59ce-ceab-4bf5-9908-30989772bec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:10.396071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 772/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 22:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:23:10.547041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f9e02-6983-42ce-9aeb-056bc558eea8 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:23:10.561927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f9e02-6983-42ce-9aeb-056bc558eea8 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:23:10.567900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b609d-31a1-4b67-8f15-a5c299a34689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:23:10.568897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b609d-31a1-4b67-8f15-a5c299a34689 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:10.569187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b609d-31a1-4b67-8f15-a5c299a34689 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:10.569459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b609d-31a1-4b67-8f15-a5c299a34689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:10.578382 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b609d-31a1-4b67-8f15-a5c299a34689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:23:10.580030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b609d-31a1-4b67-8f15-a5c299a34689 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:23:10.590117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 744/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:23:13.529106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f664ead-0fe4-4f89-b55a-501ac33bf5a9 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:13.529721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f664ead-0fe4-4f89-b55a-501ac33bf5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:13.529721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f664ead-0fe4-4f89-b55a-501ac33bf5a9 None None] PATH_INFO: `/v3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:13.531097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 773/1517] 10.222.0.110 () {54 vars in 926 bytes} [Thu Aug 4 22:23:13 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:23:13.540279 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3cfc8-69a8-431f-b7bb-644622ba8564 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:13.540833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3cfc8-69a8-431f-b7bb-644622ba8564 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:13.540945 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3cfc8-69a8-431f-b7bb-644622ba8564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:13.604485 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5ee3cfc8-69a8-431f-b7bb-644622ba8564 None None] MFA Rules not processed for user `94b2448489cc4ad1a6fd3096ebd3f746`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:23:13.605702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5ee3cfc8-69a8-431f-b7bb-644622ba8564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:13.622373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:13.686722 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 745/1518] 10.222.0.110 () {58 vars in 1016 bytes} [Thu Aug 4 22:23:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:23:20.382018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=56 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:21.845444 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb3a06-44a0-4afa-8cbf-c2afb69c57df None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:21.846108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb3a06-44a0-4afa-8cbf-c2afb69c57df None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:21.846108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb3a06-44a0-4afa-8cbf-c2afb69c57df None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:21.847684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 774/1519] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 22:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:23:21.853004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4c43b-914e-4b1e-88ff-1d75ef1a839d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:21.853561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4c43b-914e-4b1e-88ff-1d75ef1a839d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:21.853561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4c43b-914e-4b1e-88ff-1d75ef1a839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:21.874107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-52a4c43b-914e-4b1e-88ff-1d75ef1a839d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:23:21.875753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-52a4c43b-914e-4b1e-88ff-1d75ef1a839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:21.887756 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 746/1520] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 22:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:23:22.048212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb3a06-44a0-4afa-8cbf-c2afb69c57df None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:23:22.069535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb3a06-44a0-4afa-8cbf-c2afb69c57df None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:23:22.075864 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e682f-7beb-466e-b709-3598598a7f6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:23:22.076502 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e682f-7beb-466e-b709-3598598a7f6f service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:22.076786 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e682f-7beb-466e-b709-3598598a7f6f service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:22.077064 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e682f-7beb-466e-b709-3598598a7f6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:22.087002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e682f-7beb-466e-b709-3598598a7f6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:23:22.088610 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e682f-7beb-466e-b709-3598598a7f6f service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:23:22.098986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 775/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:23:22.936663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec69db5-7d09-4fba-b5a7-84d47073593f None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:22.937232 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec69db5-7d09-4fba-b5a7-84d47073593f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:22.937232 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec69db5-7d09-4fba-b5a7-84d47073593f None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:22.938646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 747/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 22:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:23:22.944075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4eb3e-a994-4e21-ab1e-b18866ed8451 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:22.944556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4eb3e-a994-4e21-ab1e-b18866ed8451 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:22.944669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4eb3e-a994-4e21-ab1e-b18866ed8451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:22.964057 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-38d4eb3e-a994-4e21-ab1e-b18866ed8451 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:23:22.965268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-38d4eb3e-a994-4e21-ab1e-b18866ed8451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:22.973432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 776/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 22:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:23:23.124619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec69db5-7d09-4fba-b5a7-84d47073593f None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:23:23.139496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec69db5-7d09-4fba-b5a7-84d47073593f None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:23:23.144876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc62585-9005-454c-888f-80d5ea8cfa44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:23:23.145485 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc62585-9005-454c-888f-80d5ea8cfa44 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:23.145789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc62585-9005-454c-888f-80d5ea8cfa44 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:23.146101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc62585-9005-454c-888f-80d5ea8cfa44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:23.154270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc62585-9005-454c-888f-80d5ea8cfa44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:23:23.155865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc62585-9005-454c-888f-80d5ea8cfa44 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:23:23.166327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 748/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:23:25.770230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2816d85-548f-40a9-903a-87e9e6588d37 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:25.771412 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2816d85-548f-40a9-903a-87e9e6588d37 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:25.771412 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2816d85-548f-40a9-903a-87e9e6588d37 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:25.772722 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 777/1525] 10.222.0.27 () {54 vars in 961 bytes} [Thu Aug 4 22:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:23:25.777961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89608068-aa35-4339-9924-f52710679796 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:25.778436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89608068-aa35-4339-9924-f52710679796 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:25.778552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89608068-aa35-4339-9924-f52710679796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:25.797919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-89608068-aa35-4339-9924-f52710679796 None None] MFA Rules not processed for user `94b2448489cc4ad1a6fd3096ebd3f746`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:23:25.799151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-89608068-aa35-4339-9924-f52710679796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:25.807727 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 749/1526] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Aug 4 22:23:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:23:25.815296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2816d85-548f-40a9-903a-87e9e6588d37 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:23:25.829259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2816d85-548f-40a9-903a-87e9e6588d37 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:23:25.835107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d4450-9897-4976-bb27-6fdd7c264773 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2448489cc4ad1a6fd3096ebd3f746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:23:25.835714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d4450-9897-4976-bb27-6fdd7c264773 service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:25.835998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d4450-9897-4976-bb27-6fdd7c264773 service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:25.836275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d4450-9897-4976-bb27-6fdd7c264773 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:25.844833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d4450-9897-4976-bb27-6fdd7c264773 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:23:25.846457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d4450-9897-4976-bb27-6fdd7c264773 service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:23:25.856562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 778/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:23:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:23:34.380431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cd096-805e-436d-b97f-c85a888e81a4 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:34.381000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cd096-805e-436d-b97f-c85a888e81a4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:34.381000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cd096-805e-436d-b97f-c85a888e81a4 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:34.382347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 750/1528] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 22:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:23:34.387362 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7db806-301a-47ae-9417-d47816e58c46 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:34.387760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7db806-301a-47ae-9417-d47816e58c46 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:34.387916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7db806-301a-47ae-9417-d47816e58c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:34.407264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1e7db806-301a-47ae-9417-d47816e58c46 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:23:34.408472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1e7db806-301a-47ae-9417-d47816e58c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:34.416304 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 779/1529] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 22:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:23:34.570824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cd096-805e-436d-b97f-c85a888e81a4 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:23:34.585354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cd096-805e-436d-b97f-c85a888e81a4 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:23:34.590915 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a61ea-5397-4ce4-9192-26560ee4c7e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:23:34.591520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a61ea-5397-4ce4-9192-26560ee4c7e1 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:34.591824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a61ea-5397-4ce4-9192-26560ee4c7e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:34.592097 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a61ea-5397-4ce4-9192-26560ee4c7e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:34.600760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a61ea-5397-4ce4-9192-26560ee4c7e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:23:34.602315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a61ea-5397-4ce4-9192-26560ee4c7e1 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:23:34.611841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 751/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:23:35.430205 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95c37e-0616-4324-9395-063f631cc857 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:35.430763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95c37e-0616-4324-9395-063f631cc857 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:35.430763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95c37e-0616-4324-9395-063f631cc857 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:35.432116 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 780/1531] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 4 22:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:23:35.436931 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e94424-c69e-4fee-a5d7-e1cc409e45a4 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:35.437335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e94424-c69e-4fee-a5d7-e1cc409e45a4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:35.437481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e94424-c69e-4fee-a5d7-e1cc409e45a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:35.457028 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-40e94424-c69e-4fee-a5d7-e1cc409e45a4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:23:35.458212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-40e94424-c69e-4fee-a5d7-e1cc409e45a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:35.466767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 752/1532] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 4 22:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:23:35.616182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95c37e-0616-4324-9395-063f631cc857 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:23:35.630383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95c37e-0616-4324-9395-063f631cc857 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:23:35.635763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e2f42-d6a8-424a-aaaa-9ab7cfa6c367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:23:35.636363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e2f42-d6a8-424a-aaaa-9ab7cfa6c367 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:35.636643 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e2f42-d6a8-424a-aaaa-9ab7cfa6c367 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:35.636918 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e2f42-d6a8-424a-aaaa-9ab7cfa6c367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:35.644958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e2f42-d6a8-424a-aaaa-9ab7cfa6c367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:23:35.646605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e2f42-d6a8-424a-aaaa-9ab7cfa6c367 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:23:35.656202 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 781/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:23:39.439580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b75dca-4266-41ab-99c6-e89932acddb5 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:39.440107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b75dca-4266-41ab-99c6-e89932acddb5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:39.440107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b75dca-4266-41ab-99c6-e89932acddb5 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:39.441412 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 753/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:23:39.447114 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db876-dba1-483d-a5ef-f115590a9fcb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:39.447566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db876-dba1-483d-a5ef-f115590a9fcb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:39.447710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db876-dba1-483d-a5ef-f115590a9fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:39.467488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3e6db876-dba1-483d-a5ef-f115590a9fcb None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:23:39.468782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3e6db876-dba1-483d-a5ef-f115590a9fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:39.477329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 782/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:23:39.552609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b75dca-4266-41ab-99c6-e89932acddb5 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:23:39.554330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-86b75dca-4266-41ab-99c6-e89932acddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:39.632667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b75dca-4266-41ab-99c6-e89932acddb5 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:23:39.636196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c017d5-5a27-4d2a-b24b-4dcb3bb2b473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:23:39.636806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c017d5-5a27-4d2a-b24b-4dcb3bb2b473 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:39.637088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c017d5-5a27-4d2a-b24b-4dcb3bb2b473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:39.637390 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c017d5-5a27-4d2a-b24b-4dcb3bb2b473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:39.646270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c017d5-5a27-4d2a-b24b-4dcb3bb2b473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:23:39.647704 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c017d5-5a27-4d2a-b24b-4dcb3bb2b473 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:23:39.657049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 754/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:23:41.644386 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff5907-2cec-425e-bca9-ad024148dc13 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:41.644849 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff5907-2cec-425e-bca9-ad024148dc13 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:41.644954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff5907-2cec-425e-bca9-ad024148dc13 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:41.646664 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 783/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:23:41.652478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b5209-bec8-4be5-8f6b-b7ecb46c28b9 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:41.653009 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b5209-bec8-4be5-8f6b-b7ecb46c28b9 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:41.653009 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b5209-bec8-4be5-8f6b-b7ecb46c28b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:41.673613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-612b5209-bec8-4be5-8f6b-b7ecb46c28b9 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:23:41.674876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-612b5209-bec8-4be5-8f6b-b7ecb46c28b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:41.683515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 755/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:23:41.721146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff5907-2cec-425e-bca9-ad024148dc13 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:23:41.722791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-65ff5907-2cec-425e-bca9-ad024148dc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:41.736522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff5907-2cec-425e-bca9-ad024148dc13 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:23:41.740300 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632b6db-5ea4-4d0d-bf7f-6e84b314535f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:23:41.740911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632b6db-5ea4-4d0d-bf7f-6e84b314535f service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:41.741188 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632b6db-5ea4-4d0d-bf7f-6e84b314535f service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:41.741459 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632b6db-5ea4-4d0d-bf7f-6e84b314535f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:41.750484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632b6db-5ea4-4d0d-bf7f-6e84b314535f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:23:41.751905 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632b6db-5ea4-4d0d-bf7f-6e84b314535f service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:23:41.761059 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 784/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:23:45.273644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a199c8e-d018-4004-ba48-487b503af969 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:45.274252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a199c8e-d018-4004-ba48-487b503af969 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:45.274252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a199c8e-d018-4004-ba48-487b503af969 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:45.275593 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 756/1540] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:23:45.280657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002e02-9145-4862-9d17-e6c9c7b44f49 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:45.281074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002e02-9145-4862-9d17-e6c9c7b44f49 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:45.281219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002e02-9145-4862-9d17-e6c9c7b44f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:45.300508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c7002e02-9145-4862-9d17-e6c9c7b44f49 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:23:45.301749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c7002e02-9145-4862-9d17-e6c9c7b44f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:45.310018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 785/1541] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:23:45.623631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a199c8e-d018-4004-ba48-487b503af969 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:23:45.625350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3a199c8e-d018-4004-ba48-487b503af969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:45.629468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=83 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:45.703794 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a199c8e-d018-4004-ba48-487b503af969 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:23:45.707664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe93ae4-0c62-46bc-b1ac-d33baa129f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:23:45.708282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe93ae4-0c62-46bc-b1ac-d33baa129f3d service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:45.708569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe93ae4-0c62-46bc-b1ac-d33baa129f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:45.708853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe93ae4-0c62-46bc-b1ac-d33baa129f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:45.717923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe93ae4-0c62-46bc-b1ac-d33baa129f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:23:45.719320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe93ae4-0c62-46bc-b1ac-d33baa129f3d service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:23:45.728649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 757/1542] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:23:47.748591 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2444e-a796-4d74-89fd-86bdf31bca51 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:47.749133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2444e-a796-4d74-89fd-86bdf31bca51 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:47.749133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2444e-a796-4d74-89fd-86bdf31bca51 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:47.750476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 786/1543] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 4 22:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:23:47.755653 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac5105-2d0d-4a07-b853-21e534dc09d1 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:47.756078 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac5105-2d0d-4a07-b853-21e534dc09d1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:47.756213 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac5105-2d0d-4a07-b853-21e534dc09d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:47.775921 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a8ac5105-2d0d-4a07-b853-21e534dc09d1 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:23:47.777124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a8ac5105-2d0d-4a07-b853-21e534dc09d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:47.784917 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 758/1544] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 4 22:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:23:48.086396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2444e-a796-4d74-89fd-86bdf31bca51 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:23:48.088059 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a7a2444e-a796-4d74-89fd-86bdf31bca51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:23:48.100649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2444e-a796-4d74-89fd-86bdf31bca51 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:23:48.104065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be190ad8-8dcf-4ee3-af6a-35b77f171c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:23:48.104667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be190ad8-8dcf-4ee3-af6a-35b77f171c77 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:23:48.104933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be190ad8-8dcf-4ee3-af6a-35b77f171c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:23:48.105206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be190ad8-8dcf-4ee3-af6a-35b77f171c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:23:48.113921 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be190ad8-8dcf-4ee3-af6a-35b77f171c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:23:48.115372 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be190ad8-8dcf-4ee3-af6a-35b77f171c77 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:23:48.124426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 787/1545] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:23:57.771487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=37 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:23:58.120466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=42 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:32.638390 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd0928-c293-40ed-8ea2-df65cae40da8 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:32.640084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd0928-c293-40ed-8ea2-df65cae40da8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:32.640374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd0928-c293-40ed-8ea2-df65cae40da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:32.670330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-17cd0928-c293-40ed-8ea2-df65cae40da8 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:32.671587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-17cd0928-c293-40ed-8ea2-df65cae40da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:32.681451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5158f5-7659-48ba-8b3f-162e6e7508ff None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:32.682045 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5158f5-7659-48ba-8b3f-162e6e7508ff None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:32.682045 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5158f5-7659-48ba-8b3f-162e6e7508ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:32.683160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 759/1546] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:32.693096 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4c389-dcb7-4c47-95af-ae3fbf99bdd3 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:32.693446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4c389-dcb7-4c47-95af-ae3fbf99bdd3 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:32.693675 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4c389-dcb7-4c47-95af-ae3fbf99bdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:32.730311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ef5158f5-7659-48ba-8b3f-162e6e7508ff None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:32.731474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ef5158f5-7659-48ba-8b3f-162e6e7508ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:32.731977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-d0b4c389-dcb7-4c47-95af-ae3fbf99bdd3 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:32.733268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d0b4c389-dcb7-4c47-95af-ae3fbf99bdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:32.752411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 788/1547] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:25:32.753749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9df3f0-543a-4919-91a4-96f799482f19 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:32.754037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9df3f0-543a-4919-91a4-96f799482f19 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:32.754310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9df3f0-543a-4919-91a4-96f799482f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:32.765435 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 760/1548] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:25:32.766777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175084d-18ab-4ffc-a3fa-312b80f18c51 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:32.767069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175084d-18ab-4ffc-a3fa-312b80f18c51 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:32.767338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175084d-18ab-4ffc-a3fa-312b80f18c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:32.798475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6175084d-18ab-4ffc-a3fa-312b80f18c51 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:32.799787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6175084d-18ab-4ffc-a3fa-312b80f18c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:32.802483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7e9df3f0-543a-4919-91a4-96f799482f19 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:32.804107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7e9df3f0-543a-4919-91a4-96f799482f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:32.809515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 761/1549] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:32.814431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b482b-35d3-4c8a-8abf-db01694073d0 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:32.814431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b482b-35d3-4c8a-8abf-db01694073d0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:32.814431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b482b-35d3-4c8a-8abf-db01694073d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:32.826178 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 789/1550] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:32.828013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2bf4-0a3f-4f38-9f46-7b374fe0bf35 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:32.828754 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2bf4-0a3f-4f38-9f46-7b374fe0bf35 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:32.829410 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2bf4-0a3f-4f38-9f46-7b374fe0bf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:32.831939 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a84b482b-35d3-4c8a-8abf-db01694073d0 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:32.833415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a84b482b-35d3-4c8a-8abf-db01694073d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:32.842183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 762/1551] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:32.842919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b482b-35d3-4c8a-8abf-db01694073d0 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:32.855032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b482b-35d3-4c8a-8abf-db01694073d0 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:32.856503 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ca5c2bf4-0a3f-4f38-9f46-7b374fe0bf35 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:32.858337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ca5c2bf4-0a3f-4f38-9f46-7b374fe0bf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:32.859642 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f34ba7-5d17-465f-a1e6-c6557f5e45f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:32.860338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f34ba7-5d17-465f-a1e6-c6557f5e45f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:32.860626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f34ba7-5d17-465f-a1e6-c6557f5e45f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:32.860902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f34ba7-5d17-465f-a1e6-c6557f5e45f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:32.861618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f34ba7-5d17-465f-a1e6-c6557f5e45f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:25:32.861922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f34ba7-5d17-465f-a1e6-c6557f5e45f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:32.864100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f34ba7-5d17-465f-a1e6-c6557f5e45f8 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:32.876481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 790/1552] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:32.880779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab594ba3-af0d-4ec4-94de-56a56ecd22e5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:32.880779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab594ba3-af0d-4ec4-94de-56a56ecd22e5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:32.881017 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab594ba3-af0d-4ec4-94de-56a56ecd22e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:32.885967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 763/1553] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:25:32.887144 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9e111-7796-42c9-9e36-9de825736205 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:32.887437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9e111-7796-42c9-9e36-9de825736205 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:32.887719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9e111-7796-42c9-9e36-9de825736205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:32.903731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ab594ba3-af0d-4ec4-94de-56a56ecd22e5 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:32.904964 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ab594ba3-af0d-4ec4-94de-56a56ecd22e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:32.907778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-82f9e111-7796-42c9-9e36-9de825736205 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:32.908951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-82f9e111-7796-42c9-9e36-9de825736205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:32.918452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 791/1554] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:32.918452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd859f4a-d144-44dd-93aa-a62dbbb8a897 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:32.918452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd859f4a-d144-44dd-93aa-a62dbbb8a897 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:32.918452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd859f4a-d144-44dd-93aa-a62dbbb8a897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:32.921086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 764/1555] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:32.921603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88427d51-eee8-4aa8-9ef9-528bcc482f0f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:32.921938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88427d51-eee8-4aa8-9ef9-528bcc482f0f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:32.922163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88427d51-eee8-4aa8-9ef9-528bcc482f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:32.942844 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-88427d51-eee8-4aa8-9ef9-528bcc482f0f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:32.944306 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cd859f4a-d144-44dd-93aa-a62dbbb8a897 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:32.944929 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-88427d51-eee8-4aa8-9ef9-528bcc482f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:32.945489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cd859f4a-d144-44dd-93aa-a62dbbb8a897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:32.953828 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 792/1556] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:32.955783 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 765/1557] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:32.959616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f3af5-54d4-4efc-910d-5dafd729c0b2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:32.959850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88427d51-eee8-4aa8-9ef9-528bcc482f0f None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:32.959982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f3af5-54d4-4efc-910d-5dafd729c0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:32.960170 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f3af5-54d4-4efc-910d-5dafd729c0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:32.977449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88427d51-eee8-4aa8-9ef9-528bcc482f0f None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:32.980877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d81f3af5-54d4-4efc-910d-5dafd729c0b2 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:32.982061 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d81f3af5-54d4-4efc-910d-5dafd729c0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:32.983194 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee868d89-d949-47d7-a710-b780418265ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:32.983832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee868d89-d949-47d7-a710-b780418265ae admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:32.984114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee868d89-d949-47d7-a710-b780418265ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:32.984421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee868d89-d949-47d7-a710-b780418265ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:32.985128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee868d89-d949-47d7-a710-b780418265ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:25:32.985437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee868d89-d949-47d7-a710-b780418265ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:32.987291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee868d89-d949-47d7-a710-b780418265ae admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:32.990883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 793/1558] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:32.991684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f3af5-54d4-4efc-910d-5dafd729c0b2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.001489 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 766/1559] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:25:33.001701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f3af5-54d4-4efc-910d-5dafd729c0b2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.002310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee868d89-d949-47d7-a710-b780418265ae admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.006391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa1458-5b44-4049-9ddb-d05e7ee0b9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.007039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa1458-5b44-4049-9ddb-d05e7ee0b9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.007330 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa1458-5b44-4049-9ddb-d05e7ee0b9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.007610 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa1458-5b44-4049-9ddb-d05e7ee0b9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.008283 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa1458-5b44-4049-9ddb-d05e7ee0b9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.010387 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa1458-5b44-4049-9ddb-d05e7ee0b9e8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.015263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee868d89-d949-47d7-a710-b780418265ae admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.020111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f41bc-f718-4eae-8852-e4f2f0f8c1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.020779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f41bc-f718-4eae-8852-e4f2f0f8c1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.021062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f41bc-f718-4eae-8852-e4f2f0f8c1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.021336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f41bc-f718-4eae-8852-e4f2f0f8c1a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.022025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f41bc-f718-4eae-8852-e4f2f0f8c1a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:25:33.022333 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f41bc-f718-4eae-8852-e4f2f0f8c1a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.023968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f41bc-f718-4eae-8852-e4f2f0f8c1a4 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.037225 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 767/1560] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:25:33.038788 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b324012-cff5-49fd-a9d2-b8bcf8726bbf None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.039186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b324012-cff5-49fd-a9d2-b8bcf8726bbf None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.039458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b324012-cff5-49fd-a9d2-b8bcf8726bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.051532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 794/1561] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:32 2022] POST /identity/v3/projects => generated 403 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:33.056119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa1458-5b44-4049-9ddb-d05e7ee0b9e8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.060213 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-7b324012-cff5-49fd-a9d2-b8bcf8726bbf None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:33.061428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7b324012-cff5-49fd-a9d2-b8bcf8726bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:33.123085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa1458-5b44-4049-9ddb-d05e7ee0b9e8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.127760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd5114-b893-4d09-a108-d469bc85ba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.128423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5114-b893-4d09-a108-d469bc85ba09 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.128726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5114-b893-4d09-a108-d469bc85ba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.129003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd5114-b893-4d09-a108-d469bc85ba09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.129704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd5114-b893-4d09-a108-d469bc85ba09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:25:33.130014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd5114-b893-4d09-a108-d469bc85ba09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.132250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-72fd5114-b893-4d09-a108-d469bc85ba09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:25:33.132250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 04 22:25:33.132250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: Aug 04 22:25:33.132250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd5114-b893-4d09-a108-d469bc85ba09 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.132764 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 768/1562] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:33.133864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b324012-cff5-49fd-a9d2-b8bcf8726bbf None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.144436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b324012-cff5-49fd-a9d2-b8bcf8726bbf None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.144791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 795/1563] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:25:33.145927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd83e34-3b7e-4983-b195-76241d453fba None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.146239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd83e34-3b7e-4983-b195-76241d453fba None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.146592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd83e34-3b7e-4983-b195-76241d453fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.149180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49da06-3289-48e1-bcf0-004cd9d33c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.149798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49da06-3289-48e1-bcf0-004cd9d33c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.150081 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49da06-3289-48e1-bcf0-004cd9d33c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.150355 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49da06-3289-48e1-bcf0-004cd9d33c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.151228 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49da06-3289-48e1-bcf0-004cd9d33c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:25:33.151578 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49da06-3289-48e1-bcf0-004cd9d33c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.154873 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49da06-3289-48e1-bcf0-004cd9d33c40 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.174908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 769/1564] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:25:33.174908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6f8f4-a5a2-4420-b44a-978eeb0f1651 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.174908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6f8f4-a5a2-4420-b44a-978eeb0f1651 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.174908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6f8f4-a5a2-4420-b44a-978eeb0f1651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.175371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-dfd83e34-3b7e-4983-b195-76241d453fba None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:33.175371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dfd83e34-3b7e-4983-b195-76241d453fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:33.179237 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 796/1565] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:33.180048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd83e34-3b7e-4983-b195-76241d453fba None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.190593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd83e34-3b7e-4983-b195-76241d453fba None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.192218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c5f6f8f4-a5a2-4420-b44a-978eeb0f1651 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:33.193532 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c5f6f8f4-a5a2-4420-b44a-978eeb0f1651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:33.195313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cdcc8-c5ea-4abc-b776-54a0ca0b9a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.195933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cdcc8-c5ea-4abc-b776-54a0ca0b9a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.196212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cdcc8-c5ea-4abc-b776-54a0ca0b9a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.196484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cdcc8-c5ea-4abc-b776-54a0ca0b9a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.197147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cdcc8-c5ea-4abc-b776-54a0ca0b9a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.199107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cdcc8-c5ea-4abc-b776-54a0ca0b9a4a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.201697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 770/1566] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:33.202559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6f8f4-a5a2-4420-b44a-978eeb0f1651 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.212789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6f8f4-a5a2-4420-b44a-978eeb0f1651 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.217351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588693d-1414-4220-8bda-d2a1056b5148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.217965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588693d-1414-4220-8bda-d2a1056b5148 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.218243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588693d-1414-4220-8bda-d2a1056b5148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.218713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588693d-1414-4220-8bda-d2a1056b5148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.219389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588693d-1414-4220-8bda-d2a1056b5148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.220394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: WARNING py.warnings [None req-d588693d-1414-4220-8bda-d2a1056b5148 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:25:33.220394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: warnings.warn(msg) Aug 04 22:25:33.220394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: Aug 04 22:25:33.221579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588693d-1414-4220-8bda-d2a1056b5148 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.243965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 797/1567] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:33.243965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cdcc8-c5ea-4abc-b776-54a0ca0b9a4a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.261985 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 771/1568] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:33.261985 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588693d-1414-4220-8bda-d2a1056b5148 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.306105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:33.309373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:33.311638 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cdcc8-c5ea-4abc-b776-54a0ca0b9a4a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.331702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588693d-1414-4220-8bda-d2a1056b5148 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.336603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee50943-f89a-4935-b6ac-34bcb6adddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.337257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee50943-f89a-4935-b6ac-34bcb6adddfd admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.337546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee50943-f89a-4935-b6ac-34bcb6adddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.337830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee50943-f89a-4935-b6ac-34bcb6adddfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.339130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee50943-f89a-4935-b6ac-34bcb6adddfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:25:33.339446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee50943-f89a-4935-b6ac-34bcb6adddfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.341132 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee50943-f89a-4935-b6ac-34bcb6adddfd admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.353106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 772/1569] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:25:33.353898 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee50943-f89a-4935-b6ac-34bcb6adddfd admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.364030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee50943-f89a-4935-b6ac-34bcb6adddfd admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.368638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670801b-aec5-48a8-9013-65fe6cd5f43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.369233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670801b-aec5-48a8-9013-65fe6cd5f43a admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.369519 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670801b-aec5-48a8-9013-65fe6cd5f43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.369825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670801b-aec5-48a8-9013-65fe6cd5f43a admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.370527 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670801b-aec5-48a8-9013-65fe6cd5f43a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.372419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670801b-aec5-48a8-9013-65fe6cd5f43a admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.376586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2e1be-f9e8-4f55-85d0-3aea6139c454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.377208 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2e1be-f9e8-4f55-85d0-3aea6139c454 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.377494 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2e1be-f9e8-4f55-85d0-3aea6139c454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.377768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2e1be-f9e8-4f55-85d0-3aea6139c454 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.378515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2e1be-f9e8-4f55-85d0-3aea6139c454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.379526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-52b2e1be-f9e8-4f55-85d0-3aea6139c454 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:25:33.379526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 04 22:25:33.379526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: Aug 04 22:25:33.380732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2e1be-f9e8-4f55-85d0-3aea6139c454 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.400439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 773/1570] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:33.405183 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 798/1571] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/users => generated 302 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:33.405183 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2e1be-f9e8-4f55-85d0-3aea6139c454 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.405432 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16e1c2-a9d2-442d-96ff-dda04bcc8376 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.405662 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16e1c2-a9d2-442d-96ff-dda04bcc8376 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.405947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16e1c2-a9d2-442d-96ff-dda04bcc8376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.413465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2e1be-f9e8-4f55-85d0-3aea6139c454 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.425740 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6e16e1c2-a9d2-442d-96ff-dda04bcc8376 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:33.426975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6e16e1c2-a9d2-442d-96ff-dda04bcc8376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:33.478349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669d1ea-171a-48c9-9931-44f8fc596017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.479005 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669d1ea-171a-48c9-9931-44f8fc596017 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.480015 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669d1ea-171a-48c9-9931-44f8fc596017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.480374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669d1ea-171a-48c9-9931-44f8fc596017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.481101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669d1ea-171a-48c9-9931-44f8fc596017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.483161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669d1ea-171a-48c9-9931-44f8fc596017 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.489346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 774/1572] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:33.489683 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16e1c2-a9d2-442d-96ff-dda04bcc8376 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.498939 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16e1c2-a9d2-442d-96ff-dda04bcc8376 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.504091 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4ec21-1383-4943-8a7e-5d1e6305f878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.504729 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4ec21-1383-4943-8a7e-5d1e6305f878 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.505015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4ec21-1383-4943-8a7e-5d1e6305f878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.505292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4ec21-1383-4943-8a7e-5d1e6305f878 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.505992 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4ec21-1383-4943-8a7e-5d1e6305f878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:25:33.506302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4ec21-1383-4943-8a7e-5d1e6305f878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.508052 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4ec21-1383-4943-8a7e-5d1e6305f878 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.516436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 799/1573] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:33.517586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669d1ea-171a-48c9-9931-44f8fc596017 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.524014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 775/1574] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:25:33.524014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4ec21-1383-4943-8a7e-5d1e6305f878 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.535056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4ec21-1383-4943-8a7e-5d1e6305f878 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.587916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669d1ea-171a-48c9-9931-44f8fc596017 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.591808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1258e7-9bae-4475-a3d1-be180a92dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.592434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1258e7-9bae-4475-a3d1-be180a92dd56 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.592639 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322ff95-e570-4f13-bf3d-75c402cafd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.592784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1258e7-9bae-4475-a3d1-be180a92dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.592987 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1258e7-9bae-4475-a3d1-be180a92dd56 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.593259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322ff95-e570-4f13-bf3d-75c402cafd2a admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.593540 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322ff95-e570-4f13-bf3d-75c402cafd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.593662 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1258e7-9bae-4475-a3d1-be180a92dd56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.593816 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322ff95-e570-4f13-bf3d-75c402cafd2a admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.594498 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322ff95-e570-4f13-bf3d-75c402cafd2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.595582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1258e7-9bae-4475-a3d1-be180a92dd56 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.596459 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322ff95-e570-4f13-bf3d-75c402cafd2a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.616952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 776/1575] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:33.617752 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1258e7-9bae-4475-a3d1-be180a92dd56 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.618024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 800/1576] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:33.622825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322ff95-e570-4f13-bf3d-75c402cafd2a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.629155 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1258e7-9bae-4475-a3d1-be180a92dd56 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.632272 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322ff95-e570-4f13-bf3d-75c402cafd2a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.633806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62270d98-b13b-4083-b91c-2390f5943f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.634437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62270d98-b13b-4083-b91c-2390f5943f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.634735 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62270d98-b13b-4083-b91c-2390f5943f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.635020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62270d98-b13b-4083-b91c-2390f5943f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.635745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62270d98-b13b-4083-b91c-2390f5943f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.636880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7f59e-620b-4b3d-981a-e7b12ddc8d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.637481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7f59e-620b-4b3d-981a-e7b12ddc8d68 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.637611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62270d98-b13b-4083-b91c-2390f5943f4a admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.637794 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7f59e-620b-4b3d-981a-e7b12ddc8d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.638051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7f59e-620b-4b3d-981a-e7b12ddc8d68 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.638733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7f59e-620b-4b3d-981a-e7b12ddc8d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.640632 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7f59e-620b-4b3d-981a-e7b12ddc8d68 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.648379 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:33.666251 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 801/1577] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:33.666251 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7f59e-620b-4b3d-981a-e7b12ddc8d68 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.672601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 777/1578] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:33.672601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62270d98-b13b-4083-b91c-2390f5943f4a admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.677315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7f59e-620b-4b3d-981a-e7b12ddc8d68 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.679567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:33.733878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5acd9-cafd-438a-a9ff-6c02df2aabac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.734524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5acd9-cafd-438a-a9ff-6c02df2aabac admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.734701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62270d98-b13b-4083-b91c-2390f5943f4a admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.734820 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5acd9-cafd-438a-a9ff-6c02df2aabac admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.735073 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5acd9-cafd-438a-a9ff-6c02df2aabac admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.735774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5acd9-cafd-438a-a9ff-6c02df2aabac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.737384 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5acd9-cafd-438a-a9ff-6c02df2aabac admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.739402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30bb5a-daf7-4bb7-9613-50569d40fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.739963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30bb5a-daf7-4bb7-9613-50569d40fa78 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.740249 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30bb5a-daf7-4bb7-9613-50569d40fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.740525 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30bb5a-daf7-4bb7-9613-50569d40fa78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.741244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30bb5a-daf7-4bb7-9613-50569d40fa78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:25:33.741668 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30bb5a-daf7-4bb7-9613-50569d40fa78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.743283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30bb5a-daf7-4bb7-9613-50569d40fa78 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.747761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 802/1579] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:33.748554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5acd9-cafd-438a-a9ff-6c02df2aabac admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.755763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 778/1580] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:25:33.756595 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30bb5a-daf7-4bb7-9613-50569d40fa78 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.764842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5acd9-cafd-438a-a9ff-6c02df2aabac admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.767356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30bb5a-daf7-4bb7-9613-50569d40fa78 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.769628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84b652-bbde-41f7-adf4-5dbf3761ca6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.770233 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84b652-bbde-41f7-adf4-5dbf3761ca6e admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.770557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84b652-bbde-41f7-adf4-5dbf3761ca6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.770858 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84b652-bbde-41f7-adf4-5dbf3761ca6e admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.771516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84b652-bbde-41f7-adf4-5dbf3761ca6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.772023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe6ff9-3868-4668-9aec-7fbcac9fea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.772687 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe6ff9-3868-4668-9aec-7fbcac9fea44 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.772973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe6ff9-3868-4668-9aec-7fbcac9fea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.773253 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe6ff9-3868-4668-9aec-7fbcac9fea44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.773490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84b652-bbde-41f7-adf4-5dbf3761ca6e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.773915 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe6ff9-3868-4668-9aec-7fbcac9fea44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.775864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe6ff9-3868-4668-9aec-7fbcac9fea44 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.795262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 803/1581] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/users => generated 294 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:33.796085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84b652-bbde-41f7-adf4-5dbf3761ca6e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.805714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84b652-bbde-41f7-adf4-5dbf3761ca6e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.807250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 779/1582] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:33.808692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe6ff9-3868-4668-9aec-7fbcac9fea44 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.869248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a850c12-6ad1-4fe4-aac3-508ee44180c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.869937 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850c12-6ad1-4fe4-aac3-508ee44180c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.870892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850c12-6ad1-4fe4-aac3-508ee44180c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.871171 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850c12-6ad1-4fe4-aac3-508ee44180c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.871602 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe6ff9-3868-4668-9aec-7fbcac9fea44 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.871884 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a850c12-6ad1-4fe4-aac3-508ee44180c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.873483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a850c12-6ad1-4fe4-aac3-508ee44180c7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.876636 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd24610-9398-47e2-a142-177bd363a4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.877256 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd24610-9398-47e2-a142-177bd363a4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.877540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd24610-9398-47e2-a142-177bd363a4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.877821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd24610-9398-47e2-a142-177bd363a4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.878548 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd24610-9398-47e2-a142-177bd363a4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.880143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd24610-9398-47e2-a142-177bd363a4a4 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.883935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 804/1583] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:33.884747 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a850c12-6ad1-4fe4-aac3-508ee44180c7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.890440 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 780/1584] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:33.891244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd24610-9398-47e2-a142-177bd363a4a4 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.896850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a850c12-6ad1-4fe4-aac3-508ee44180c7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.900679 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd24610-9398-47e2-a142-177bd363a4a4 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.901622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01823094-c4f9-4bb3-abcd-afd1806a46af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.902230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823094-c4f9-4bb3-abcd-afd1806a46af admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.902546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823094-c4f9-4bb3-abcd-afd1806a46af admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.902826 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823094-c4f9-4bb3-abcd-afd1806a46af admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.903511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01823094-c4f9-4bb3-abcd-afd1806a46af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.905105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01823094-c4f9-4bb3-abcd-afd1806a46af admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.905833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957adc7-cfb5-4fb7-bf31-4878a9e5287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.906449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957adc7-cfb5-4fb7-bf31-4878a9e5287f admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.906737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957adc7-cfb5-4fb7-bf31-4878a9e5287f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.907015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957adc7-cfb5-4fb7-bf31-4878a9e5287f admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.907674 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957adc7-cfb5-4fb7-bf31-4878a9e5287f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.909552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957adc7-cfb5-4fb7-bf31-4878a9e5287f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.916529 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 805/1585] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:33.917635 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01823094-c4f9-4bb3-abcd-afd1806a46af admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.927912 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01823094-c4f9-4bb3-abcd-afd1806a46af admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.931304 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 781/1586] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:33.932232 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957adc7-cfb5-4fb7-bf31-4878a9e5287f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.932997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26294ed0-5132-4e68-bd9c-be6b6595d583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.933589 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294ed0-5132-4e68-bd9c-be6b6595d583 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.933847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294ed0-5132-4e68-bd9c-be6b6595d583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.934115 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26294ed0-5132-4e68-bd9c-be6b6595d583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.935130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26294ed0-5132-4e68-bd9c-be6b6595d583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.936717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26294ed0-5132-4e68-bd9c-be6b6595d583 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.943059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957adc7-cfb5-4fb7-bf31-4878a9e5287f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.950899 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 806/1587] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:33.951064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b3447-e9e2-4386-b036-de51bff84a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.951064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b3447-e9e2-4386-b036-de51bff84a55 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.951280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26294ed0-5132-4e68-bd9c-be6b6595d583 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.951370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b3447-e9e2-4386-b036-de51bff84a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.951370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b3447-e9e2-4386-b036-de51bff84a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.951370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b3447-e9e2-4386-b036-de51bff84a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.951639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b3447-e9e2-4386-b036-de51bff84a55 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.961312 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26294ed0-5132-4e68-bd9c-be6b6595d583 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:33.966213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5016e6f-aa09-4f4a-a2b7-42a94763533d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:33.966929 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5016e6f-aa09-4f4a-a2b7-42a94763533d admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:33.967261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5016e6f-aa09-4f4a-a2b7-42a94763533d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:33.967602 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5016e6f-aa09-4f4a-a2b7-42a94763533d admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:33.968303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5016e6f-aa09-4f4a-a2b7-42a94763533d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:33.970135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5016e6f-aa09-4f4a-a2b7-42a94763533d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:33.979701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 782/1588] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:33.980565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b3447-e9e2-4386-b036-de51bff84a55 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.984365 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 807/1589] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:33.985480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5016e6f-aa09-4f4a-a2b7-42a94763533d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:33.996290 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5016e6f-aa09-4f4a-a2b7-42a94763533d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.019337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:34.025002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:34.044845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b3447-e9e2-4386-b036-de51bff84a55 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.049510 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff7547-fc79-4916-a12b-a890cfc0dd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.050111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7547-fc79-4916-a12b-a890cfc0dd0b admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.050397 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7547-fc79-4916-a12b-a890cfc0dd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.050701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7547-fc79-4916-a12b-a890cfc0dd0b admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.051427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff7547-fc79-4916-a12b-a890cfc0dd0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.053274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff7547-fc79-4916-a12b-a890cfc0dd0b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.055110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1faab-a109-49f9-b59b-8ce4264664fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.055730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1faab-a109-49f9-b59b-8ce4264664fc admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.056016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1faab-a109-49f9-b59b-8ce4264664fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.056296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1faab-a109-49f9-b59b-8ce4264664fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.057016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1faab-a109-49f9-b59b-8ce4264664fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.058639 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1faab-a109-49f9-b59b-8ce4264664fc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.068524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 808/1590] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:34.069334 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1faab-a109-49f9-b59b-8ce4264664fc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.077931 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 783/1591] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:33 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:34.077931 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff7547-fc79-4916-a12b-a890cfc0dd0b admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.079009 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1faab-a109-49f9-b59b-8ce4264664fc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.083973 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e1e0d-c569-4799-a8db-c0139505fd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.084561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e1e0d-c569-4799-a8db-c0139505fd26 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.084842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e1e0d-c569-4799-a8db-c0139505fd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.085118 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e1e0d-c569-4799-a8db-c0139505fd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.085796 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e1e0d-c569-4799-a8db-c0139505fd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.086458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff7547-fc79-4916-a12b-a890cfc0dd0b admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.087463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e1e0d-c569-4799-a8db-c0139505fd26 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.091851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6594c8-94cb-40dc-808b-b3eb6db89e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.092458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6594c8-94cb-40dc-808b-b3eb6db89e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.092750 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6594c8-94cb-40dc-808b-b3eb6db89e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.093013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6594c8-94cb-40dc-808b-b3eb6db89e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.093700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6594c8-94cb-40dc-808b-b3eb6db89e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.095309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6594c8-94cb-40dc-808b-b3eb6db89e6c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.098842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 809/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:34.099657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e1e0d-c569-4799-a8db-c0139505fd26 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.106508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 784/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:34.106508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6594c8-94cb-40dc-808b-b3eb6db89e6c admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.112071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e1e0d-c569-4799-a8db-c0139505fd26 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.115891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6594c8-94cb-40dc-808b-b3eb6db89e6c admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.116687 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f151e37-b968-412d-b06f-a79bdeed3aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.117295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f151e37-b968-412d-b06f-a79bdeed3aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.117743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f151e37-b968-412d-b06f-a79bdeed3aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.118026 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f151e37-b968-412d-b06f-a79bdeed3aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.118778 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f151e37-b968-412d-b06f-a79bdeed3aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.120913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f151e37-b968-412d-b06f-a79bdeed3aa6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.121765 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841eacc-27c2-4709-a48e-4a42bb1902dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.122506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841eacc-27c2-4709-a48e-4a42bb1902dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.122798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841eacc-27c2-4709-a48e-4a42bb1902dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.123084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841eacc-27c2-4709-a48e-4a42bb1902dc admin admin] PATH_INFO: `/v3/projects/d7cf3b5d8087431f9a3771389d7bc98d/users/ea5ad425a08f4981ba11916b21bd0acf/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.131558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 810/1594] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:34.132781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f151e37-b968-412d-b06f-a79bdeed3aa6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.138995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841eacc-27c2-4709-a48e-4a42bb1902dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7cf3b5d8087431f9a3771389d7bc98d, user_id=ea5ad425a08f4981ba11916b21bd0acf, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.140060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: WARNING py.warnings [None req-5841eacc-27c2-4709-a48e-4a42bb1902dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:25:34.140060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: warnings.warn(msg) Aug 04 22:25:34.140060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: Aug 04 22:25:34.142134 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841eacc-27c2-4709-a48e-4a42bb1902dc admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.144169 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f151e37-b968-412d-b06f-a79bdeed3aa6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.149107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3ce9c-b2fe-4567-8688-dbf4554c6df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.149741 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ce9c-b2fe-4567-8688-dbf4554c6df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.150028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ce9c-b2fe-4567-8688-dbf4554c6df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.150302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ce9c-b2fe-4567-8688-dbf4554c6df3 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.151067 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3ce9c-b2fe-4567-8688-dbf4554c6df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.153485 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3ce9c-b2fe-4567-8688-dbf4554c6df3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.159772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 785/1595] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:34 2022] PUT /identity/v3/projects/d7cf3b5d8087431f9a3771389d7bc98d/users/ea5ad425a08f4981ba11916b21bd0acf/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:34.160605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841eacc-27c2-4709-a48e-4a42bb1902dc admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.180210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 811/1596] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:34 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:34.182883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3ce9c-b2fe-4567-8688-dbf4554c6df3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.197201 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3ce9c-b2fe-4567-8688-dbf4554c6df3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.244379 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841eacc-27c2-4709-a48e-4a42bb1902dc admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.249820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4010d8-31b4-4416-927e-a5af814b6df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.250371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4010d8-31b4-4416-927e-a5af814b6df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.250679 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4010d8-31b4-4416-927e-a5af814b6df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.250953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4010d8-31b4-4416-927e-a5af814b6df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.251637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4010d8-31b4-4416-927e-a5af814b6df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.253215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4010d8-31b4-4416-927e-a5af814b6df0 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.264193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 786/1597] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:34.264998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4010d8-31b4-4416-927e-a5af814b6df0 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.268012 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf9c76-7efe-439d-b99a-351dda0859aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.268696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf9c76-7efe-439d-b99a-351dda0859aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.268970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf9c76-7efe-439d-b99a-351dda0859aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.269241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf9c76-7efe-439d-b99a-351dda0859aa admin admin] PATH_INFO: `/v3/projects/a8982f0fbed84453a5266650fa95c61c/users/ad5781045de04647bd213028d7209fe1/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.276786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4010d8-31b4-4416-927e-a5af814b6df0 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.281547 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673283a-55f4-404c-958a-c79d33383faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.282305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673283a-55f4-404c-958a-c79d33383faa admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.282626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673283a-55f4-404c-958a-c79d33383faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.282900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673283a-55f4-404c-958a-c79d33383faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.283579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673283a-55f4-404c-958a-c79d33383faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.283803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf9c76-7efe-439d-b99a-351dda0859aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8982f0fbed84453a5266650fa95c61c, user_id=ad5781045de04647bd213028d7209fe1, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.285178 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673283a-55f4-404c-958a-c79d33383faa admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.286621 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf9c76-7efe-439d-b99a-351dda0859aa admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.295685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 787/1598] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:34.297099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673283a-55f4-404c-958a-c79d33383faa admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.301211 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 812/1599] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:34 2022] PUT /identity/v3/projects/a8982f0fbed84453a5266650fa95c61c/users/ad5781045de04647bd213028d7209fe1/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:34.302227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf9c76-7efe-439d-b99a-351dda0859aa admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.310459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673283a-55f4-404c-958a-c79d33383faa admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.364810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf9c76-7efe-439d-b99a-351dda0859aa admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.367918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e84bb9-a56a-49b8-a677-2c26fd8890cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.368594 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e84bb9-a56a-49b8-a677-2c26fd8890cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.368881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e84bb9-a56a-49b8-a677-2c26fd8890cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.369163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e84bb9-a56a-49b8-a677-2c26fd8890cf admin admin] PATH_INFO: `/v3/projects/f293b1aed65340138d272729f2286fff/users/ffee73e2e3d2449ba017f04ed8b511d4/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.369552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8272b-34f7-4a2e-a367-429c15e38b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.370797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8272b-34f7-4a2e-a367-429c15e38b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.371063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8272b-34f7-4a2e-a367-429c15e38b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.371340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8272b-34f7-4a2e-a367-429c15e38b70 admin admin] PATH_INFO: `/v3/projects/9e032865317040fba190f223210f8844/users/337f7ac0f93a43f3a15f57798f0b8a09/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.384014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e84bb9-a56a-49b8-a677-2c26fd8890cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f293b1aed65340138d272729f2286fff, user_id=ffee73e2e3d2449ba017f04ed8b511d4, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.385657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8272b-34f7-4a2e-a367-429c15e38b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e032865317040fba190f223210f8844, user_id=337f7ac0f93a43f3a15f57798f0b8a09, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.386756 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e84bb9-a56a-49b8-a677-2c26fd8890cf admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.388400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8272b-34f7-4a2e-a367-429c15e38b70 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.390650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:34.395808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:34.401661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 788/1600] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:34 2022] PUT /identity/v3/projects/f293b1aed65340138d272729f2286fff/users/ffee73e2e3d2449ba017f04ed8b511d4/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:34.405375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e84bb9-a56a-49b8-a677-2c26fd8890cf admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.405511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 813/1601] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:34 2022] PUT /identity/v3/projects/9e032865317040fba190f223210f8844/users/337f7ac0f93a43f3a15f57798f0b8a09/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:34.405511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c02af-4a1c-4695-9d9e-1686b6dd31ab None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.405511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c02af-4a1c-4695-9d9e-1686b6dd31ab None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.405511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c02af-4a1c-4695-9d9e-1686b6dd31ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.437795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-173c02af-4a1c-4695-9d9e-1686b6dd31ab None None] MFA Rules not processed for user `ea5ad425a08f4981ba11916b21bd0acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:34.439081 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-173c02af-4a1c-4695-9d9e-1686b6dd31ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:34.468718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e84bb9-a56a-49b8-a677-2c26fd8890cf admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.504582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 814/1602] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:34.505353 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c02af-4a1c-4695-9d9e-1686b6dd31ab None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.525058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74775736-0629-450e-9fcc-2d02f354ef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.525686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74775736-0629-450e-9fcc-2d02f354ef39 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.526000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74775736-0629-450e-9fcc-2d02f354ef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.526861 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74775736-0629-450e-9fcc-2d02f354ef39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.527615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74775736-0629-450e-9fcc-2d02f354ef39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.529257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74775736-0629-450e-9fcc-2d02f354ef39 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.538875 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 789/1603] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:34.539717 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74775736-0629-450e-9fcc-2d02f354ef39 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.549450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74775736-0629-450e-9fcc-2d02f354ef39 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.554057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7992f5-b4e9-474c-9e9c-0a08849a9f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.554731 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7992f5-b4e9-474c-9e9c-0a08849a9f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.555015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7992f5-b4e9-474c-9e9c-0a08849a9f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.555289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7992f5-b4e9-474c-9e9c-0a08849a9f46 admin admin] PATH_INFO: `/v3/projects/9633b17987854aeaafef61d7452bcc9c/users/edd38bf6e5f849ff99259f9f494203d7/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.569387 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7992f5-b4e9-474c-9e9c-0a08849a9f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9633b17987854aeaafef61d7452bcc9c, user_id=edd38bf6e5f849ff99259f9f494203d7, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.570397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c02af-4a1c-4695-9d9e-1686b6dd31ab None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.572118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7992f5-b4e9-474c-9e9c-0a08849a9f46 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.575591 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e969218-d929-41bf-9836-ef5b0cb17095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.576308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e969218-d929-41bf-9836-ef5b0cb17095 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.576658 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e969218-d929-41bf-9836-ef5b0cb17095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.577091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e969218-d929-41bf-9836-ef5b0cb17095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.578103 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e969218-d929-41bf-9836-ef5b0cb17095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.580135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e969218-d929-41bf-9836-ef5b0cb17095 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.588358 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 790/1604] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:34 2022] PUT /identity/v3/projects/9633b17987854aeaafef61d7452bcc9c/users/edd38bf6e5f849ff99259f9f494203d7/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:34.589952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7992f5-b4e9-474c-9e9c-0a08849a9f46 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.594457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 815/1605] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:34.595726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b170b2d-aff3-4e35-8ee7-ab6ecced5565 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.596020 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b170b2d-aff3-4e35-8ee7-ab6ecced5565 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.596308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b170b2d-aff3-4e35-8ee7-ab6ecced5565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.614779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9b170b2d-aff3-4e35-8ee7-ab6ecced5565 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:34.615986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9b170b2d-aff3-4e35-8ee7-ab6ecced5565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:34.660388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7992f5-b4e9-474c-9e9c-0a08849a9f46 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.665016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e120636-9307-4077-8398-54c2b2e43e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.665660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e120636-9307-4077-8398-54c2b2e43e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.665947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e120636-9307-4077-8398-54c2b2e43e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.666220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e120636-9307-4077-8398-54c2b2e43e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.667476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e120636-9307-4077-8398-54c2b2e43e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.669077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e120636-9307-4077-8398-54c2b2e43e54 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.679349 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 791/1606] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:34.680597 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6d41-a0cd-49b5-a07a-62d2673110cc None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.680854 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6d41-a0cd-49b5-a07a-62d2673110cc None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.681132 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6d41-a0cd-49b5-a07a-62d2673110cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.686494 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 816/1607] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:34.686494 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595591e-602f-476f-b980-564c5b02b66d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.686494 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595591e-602f-476f-b980-564c5b02b66d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.686494 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595591e-602f-476f-b980-564c5b02b66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.700756 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-36ca6d41-a0cd-49b5-a07a-62d2673110cc None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:34.701983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-36ca6d41-a0cd-49b5-a07a-62d2673110cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:34.709855 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 792/1608] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:34.710641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6d41-a0cd-49b5-a07a-62d2673110cc None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.716914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9595591e-602f-476f-b980-564c5b02b66d None None] MFA Rules not processed for user `337f7ac0f93a43f3a15f57798f0b8a09`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:34.718128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9595591e-602f-476f-b980-564c5b02b66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:34.719757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6d41-a0cd-49b5-a07a-62d2673110cc None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.724305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4487c-6b7c-4407-b24a-0afeead9362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.724906 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4487c-6b7c-4407-b24a-0afeead9362f admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.725185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4487c-6b7c-4407-b24a-0afeead9362f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.725457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4487c-6b7c-4407-b24a-0afeead9362f admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.726116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4487c-6b7c-4407-b24a-0afeead9362f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.726704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:34.728083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4487c-6b7c-4407-b24a-0afeead9362f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.733741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:34.758812 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 793/1609] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:34 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:34.759631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4487c-6b7c-4407-b24a-0afeead9362f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.788071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 817/1610] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:34.789333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12a535-bc33-4d56-b910-659a270e401c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.789609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12a535-bc33-4d56-b910-659a270e401c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.789891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12a535-bc33-4d56-b910-659a270e401c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.808469 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7f12a535-bc33-4d56-b910-659a270e401c None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:34.809897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7f12a535-bc33-4d56-b910-659a270e401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:34.821444 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4487c-6b7c-4407-b24a-0afeead9362f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.826229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a8a13-c14a-4e06-ae8b-7256825fa50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.826926 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a8a13-c14a-4e06-ae8b-7256825fa50d admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.827212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a8a13-c14a-4e06-ae8b-7256825fa50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.827516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a8a13-c14a-4e06-ae8b-7256825fa50d admin admin] PATH_INFO: `/v3/projects/785ed2aed2a94fa68175d2504d715329/users/87cc572f28a84ab7b8c9ef0e41eb097c/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.843234 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a8a13-c14a-4e06-ae8b-7256825fa50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=785ed2aed2a94fa68175d2504d715329, user_id=87cc572f28a84ab7b8c9ef0e41eb097c, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.845906 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a8a13-c14a-4e06-ae8b-7256825fa50d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.859798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 794/1611] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:34 2022] PUT /identity/v3/projects/785ed2aed2a94fa68175d2504d715329/users/87cc572f28a84ab7b8c9ef0e41eb097c/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:34.860615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a8a13-c14a-4e06-ae8b-7256825fa50d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.880271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 818/1612] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:34.883377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12a535-bc33-4d56-b910-659a270e401c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.895976 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12a535-bc33-4d56-b910-659a270e401c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.925109 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a8a13-c14a-4e06-ae8b-7256825fa50d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:34.931671 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67abbbb-5b1a-4716-bd70-b48d4150bb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.932321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67abbbb-5b1a-4716-bd70-b48d4150bb28 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.932604 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67abbbb-5b1a-4716-bd70-b48d4150bb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.932876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67abbbb-5b1a-4716-bd70-b48d4150bb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.933753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67abbbb-5b1a-4716-bd70-b48d4150bb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.935566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67abbbb-5b1a-4716-bd70-b48d4150bb28 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:34.946978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 795/1613] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:34.947999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67abbbb-5b1a-4716-bd70-b48d4150bb28 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:34.967625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89fc0a-f1d2-46e4-9f8d-f100da1dde9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:34.968306 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89fc0a-f1d2-46e4-9f8d-f100da1dde9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:34.968581 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89fc0a-f1d2-46e4-9f8d-f100da1dde9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:34.968850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89fc0a-f1d2-46e4-9f8d-f100da1dde9b admin admin] PATH_INFO: `/v3/projects/9408aeeede0b4f2882dbc6178c80019a/users/951b36037e3a413ba8e43487fce4f651/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:34.984132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89fc0a-f1d2-46e4-9f8d-f100da1dde9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9408aeeede0b4f2882dbc6178c80019a, user_id=951b36037e3a413ba8e43487fce4f651, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:34.987092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89fc0a-f1d2-46e4-9f8d-f100da1dde9b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:35.000591 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 819/1614] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:34 2022] PUT /identity/v3/projects/9408aeeede0b4f2882dbc6178c80019a/users/951b36037e3a413ba8e43487fce4f651/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:35.003308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67abbbb-5b1a-4716-bd70-b48d4150bb28 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:35.005195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89fc0a-f1d2-46e4-9f8d-f100da1dde9b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:35.020675 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:35.038112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:35.055805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977484b3-3445-4849-94b1-bbca8a885cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:35.056433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977484b3-3445-4849-94b1-bbca8a885cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.056709 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977484b3-3445-4849-94b1-bbca8a885cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.056982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977484b3-3445-4849-94b1-bbca8a885cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.060226 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89fc0a-f1d2-46e4-9f8d-f100da1dde9b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:35.064138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809769d1-2b8a-41e3-b8e4-50fff8a65e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:35.064749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809769d1-2b8a-41e3-b8e4-50fff8a65e6c service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.065036 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809769d1-2b8a-41e3-b8e4-50fff8a65e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.065314 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809769d1-2b8a-41e3-b8e4-50fff8a65e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.116516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977484b3-3445-4849-94b1-bbca8a885cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:35.117957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977484b3-3445-4849-94b1-bbca8a885cd7 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:35.127128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809769d1-2b8a-41e3-b8e4-50fff8a65e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:35.127674 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 796/1615] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:35.128452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977484b3-3445-4849-94b1-bbca8a885cd7 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:35.128717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809769d1-2b8a-41e3-b8e4-50fff8a65e6c service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:35.139058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977484b3-3445-4849-94b1-bbca8a885cd7 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:35.139702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 820/1616] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:35.140551 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809769d1-2b8a-41e3-b8e4-50fff8a65e6c service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:35.143717 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47161ba4-ab1f-4533-a989-ff611cb6bb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:35.144329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47161ba4-ab1f-4533-a989-ff611cb6bb64 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.144618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47161ba4-ab1f-4533-a989-ff611cb6bb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.144896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47161ba4-ab1f-4533-a989-ff611cb6bb64 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.145560 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47161ba4-ab1f-4533-a989-ff611cb6bb64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:35.147507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47161ba4-ab1f-4533-a989-ff611cb6bb64 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:35.150945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809769d1-2b8a-41e3-b8e4-50fff8a65e6c service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:35.166981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054605eb-5f56-445a-8c4c-a11c192de6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:35.167855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054605eb-5f56-445a-8c4c-a11c192de6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.168141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054605eb-5f56-445a-8c4c-a11c192de6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.168510 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054605eb-5f56-445a-8c4c-a11c192de6d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.169324 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054605eb-5f56-445a-8c4c-a11c192de6d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:35.175663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 797/1617] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:35 2022] POST /identity/v3/users => generated 309 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:35.176017 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054605eb-5f56-445a-8c4c-a11c192de6d8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:35.177032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fc689-a56c-47e5-82b8-ba520e2314be None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.177334 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fc689-a56c-47e5-82b8-ba520e2314be None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.177625 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fc689-a56c-47e5-82b8-ba520e2314be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.211976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-d50fc689-a56c-47e5-82b8-ba520e2314be None None] MFA Rules not processed for user `87cc572f28a84ab7b8c9ef0e41eb097c`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:35.213050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d50fc689-a56c-47e5-82b8-ba520e2314be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:35.218327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 821/1618] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:35 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:35.219310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054605eb-5f56-445a-8c4c-a11c192de6d8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:35.291104 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054605eb-5f56-445a-8c4c-a11c192de6d8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:35.295966 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610d2d1-1134-4839-bd34-11c0b911c513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:35.296782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d2d1-1134-4839-bd34-11c0b911c513 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.297168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d2d1-1134-4839-bd34-11c0b911c513 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.297618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d2d1-1134-4839-bd34-11c0b911c513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.313821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 798/1619] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:35.317876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fc689-a56c-47e5-82b8-ba520e2314be None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:35.332616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fc689-a56c-47e5-82b8-ba520e2314be None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:35.389880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:35.402525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610d2d1-1134-4839-bd34-11c0b911c513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:35.405770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610d2d1-1134-4839-bd34-11c0b911c513 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:35.413927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9d3f8-2ad2-4cb3-87b9-d0fb6113670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:35.413927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9d3f8-2ad2-4cb3-87b9-d0fb6113670d admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.413927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9d3f8-2ad2-4cb3-87b9-d0fb6113670d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.413927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9d3f8-2ad2-4cb3-87b9-d0fb6113670d admin admin] PATH_INFO: `/v3/projects/7197cdfed5c94b3ca9df938a6d808bff/users/cdc4f3979f1d46cca86dc6c7723bf237/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.418790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 822/1620] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:35.423021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da8f4e-7712-4bc2-a62f-90f606ee8c54 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.424181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da8f4e-7712-4bc2-a62f-90f606ee8c54 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.424181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da8f4e-7712-4bc2-a62f-90f606ee8c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.437986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9d3f8-2ad2-4cb3-87b9-d0fb6113670d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7197cdfed5c94b3ca9df938a6d808bff, user_id=cdc4f3979f1d46cca86dc6c7723bf237, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:35.441293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9d3f8-2ad2-4cb3-87b9-d0fb6113670d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:35.475712 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f7da8f4e-7712-4bc2-a62f-90f606ee8c54 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:35.475712 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f7da8f4e-7712-4bc2-a62f-90f606ee8c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:35.476588 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 799/1621] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:35 2022] PUT /identity/v3/projects/7197cdfed5c94b3ca9df938a6d808bff/users/cdc4f3979f1d46cca86dc6c7723bf237/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:35.477464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:35.478373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9d3f8-2ad2-4cb3-87b9-d0fb6113670d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:35.561203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 823/1622] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:35.562195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da8f4e-7712-4bc2-a62f-90f606ee8c54 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:35.566997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9d3f8-2ad2-4cb3-87b9-d0fb6113670d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:35.572641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c5ee8-8f4d-4b3c-8d23-40191abd356f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:35.574979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c5ee8-8f4d-4b3c-8d23-40191abd356f admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.575540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c5ee8-8f4d-4b3c-8d23-40191abd356f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.575891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c5ee8-8f4d-4b3c-8d23-40191abd356f admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.577001 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c5ee8-8f4d-4b3c-8d23-40191abd356f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:35.578951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c5ee8-8f4d-4b3c-8d23-40191abd356f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:35.591307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da8f4e-7712-4bc2-a62f-90f606ee8c54 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:35.596856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 800/1623] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:35.598441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c5ee8-8f4d-4b3c-8d23-40191abd356f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:35.600845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626d2af-a995-4b2b-8d14-62333dc406f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:35.601695 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626d2af-a995-4b2b-8d14-62333dc406f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.602141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626d2af-a995-4b2b-8d14-62333dc406f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.602615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626d2af-a995-4b2b-8d14-62333dc406f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.603441 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626d2af-a995-4b2b-8d14-62333dc406f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:35.605604 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626d2af-a995-4b2b-8d14-62333dc406f3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:35.638271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 824/1624] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:35 2022] POST /identity/v3/users => generated 294 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:35.643085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096a856-7e87-4aa5-94ad-8d25bbe25190 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.644398 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096a856-7e87-4aa5-94ad-8d25bbe25190 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.645021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096a856-7e87-4aa5-94ad-8d25bbe25190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.709862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9096a856-7e87-4aa5-94ad-8d25bbe25190 None None] MFA Rules not processed for user `cdc4f3979f1d46cca86dc6c7723bf237`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:35.711426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9096a856-7e87-4aa5-94ad-8d25bbe25190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:35.724843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c5ee8-8f4d-4b3c-8d23-40191abd356f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:35.731607 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779d650-628e-4cba-b092-d61eb3bfb154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:35.733086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779d650-628e-4cba-b092-d61eb3bfb154 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.733618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779d650-628e-4cba-b092-d61eb3bfb154 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.734444 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779d650-628e-4cba-b092-d61eb3bfb154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.785462 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 825/1625] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:35.797626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096a856-7e87-4aa5-94ad-8d25bbe25190 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:35.896187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779d650-628e-4cba-b092-d61eb3bfb154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:35.901416 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779d650-628e-4cba-b092-d61eb3bfb154 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:35.902174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096a856-7e87-4aa5-94ad-8d25bbe25190 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:35.920817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bb39b-764c-4eef-a762-6e4fa28eaaf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:35.921731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bb39b-764c-4eef-a762-6e4fa28eaaf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.922128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bb39b-764c-4eef-a762-6e4fa28eaaf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.922535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bb39b-764c-4eef-a762-6e4fa28eaaf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.936504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 801/1626] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:35.936717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bb39b-764c-4eef-a762-6e4fa28eaaf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:35.937369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779d650-628e-4cba-b092-d61eb3bfb154 service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:35.938340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bb39b-764c-4eef-a762-6e4fa28eaaf1 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:35.951395 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 826/1627] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:35.952524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bb39b-764c-4eef-a762-6e4fa28eaaf1 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:35.963169 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bb39b-764c-4eef-a762-6e4fa28eaaf1 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:35.965714 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779d650-628e-4cba-b092-d61eb3bfb154 service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:35.969197 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5614fcb-e7be-4447-aaf8-9ae8d9869daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:35.969812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5614fcb-e7be-4447-aaf8-9ae8d9869daf admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.970088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5614fcb-e7be-4447-aaf8-9ae8d9869daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.970360 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5614fcb-e7be-4447-aaf8-9ae8d9869daf admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.971088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5614fcb-e7be-4447-aaf8-9ae8d9869daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:35.972703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5614fcb-e7be-4447-aaf8-9ae8d9869daf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:35.978071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbe9a7-8650-45e5-a55f-5dd04a0ac492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:35.978925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbe9a7-8650-45e5-a55f-5dd04a0ac492 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.979320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbe9a7-8650-45e5-a55f-5dd04a0ac492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.979596 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbe9a7-8650-45e5-a55f-5dd04a0ac492 admin admin] PATH_INFO: `/v3/projects/858f874fc7f94b3f9d3ff535fb2b50e6/users/bd91c425c5ab446c92163a3a1126b42e/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:35.996301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 827/1628] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:35.997860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7828d3-3432-42b3-9bf6-8db1f2cfe40b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:35.998147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7828d3-3432-42b3-9bf6-8db1f2cfe40b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:35.998439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7828d3-3432-42b3-9bf6-8db1f2cfe40b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:36.008131 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 828/1629] 10.222.0.27 () {54 vars in 962 bytes} [Thu Aug 4 22:25:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:25:36.009983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7828d3-3432-42b3-9bf6-8db1f2cfe40b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:36.010953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:36.015249 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbe9a7-8650-45e5-a55f-5dd04a0ac492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858f874fc7f94b3f9d3ff535fb2b50e6, user_id=bd91c425c5ab446c92163a3a1126b42e, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:36.018085 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbe9a7-8650-45e5-a55f-5dd04a0ac492 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:36.034634 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7828d3-3432-42b3-9bf6-8db1f2cfe40b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:36.040386 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a2d0f-1d27-42f6-9322-1586dbe57848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:36.041056 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a2d0f-1d27-42f6-9322-1586dbe57848 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:36.041333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a2d0f-1d27-42f6-9322-1586dbe57848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:36.041776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a2d0f-1d27-42f6-9322-1586dbe57848 admin admin] PATH_INFO: `/v3/projects/8c840369521d4af6bfb2b076b782f7ce/users/3f1a3cbde5884b7c99544ca606fa1282/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:36.057365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 802/1630] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:35 2022] PUT /identity/v3/projects/858f874fc7f94b3f9d3ff535fb2b50e6/users/bd91c425c5ab446c92163a3a1126b42e/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:36.059050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247260c9-677e-496f-b992-b2de85921454 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:36.059403 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247260c9-677e-496f-b992-b2de85921454 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:36.059746 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247260c9-677e-496f-b992-b2de85921454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:36.084307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:36.091230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a2d0f-1d27-42f6-9322-1586dbe57848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c840369521d4af6bfb2b076b782f7ce, user_id=3f1a3cbde5884b7c99544ca606fa1282, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:36.094749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a2d0f-1d27-42f6-9322-1586dbe57848 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:36.131713 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 829/1631] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:36 2022] PUT /identity/v3/projects/8c840369521d4af6bfb2b076b782f7ce/users/3f1a3cbde5884b7c99544ca606fa1282/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:36.134806 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a2d0f-1d27-42f6-9322-1586dbe57848 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:36.160868 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-247260c9-677e-496f-b992-b2de85921454 None None] MFA Rules not processed for user `04899781f67746e193a05bdc004804cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:36.162122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-247260c9-677e-496f-b992-b2de85921454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:36.273672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a2d0f-1d27-42f6-9322-1586dbe57848 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:36.284078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3772db-dea4-44db-8967-a8de5454b845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:36.285616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3772db-dea4-44db-8967-a8de5454b845 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:36.286570 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3772db-dea4-44db-8967-a8de5454b845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:36.286867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3772db-dea4-44db-8967-a8de5454b845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:36.288093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 803/1632] 10.222.0.27 () {58 vars in 1059 bytes} [Thu Aug 4 22:25:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:36.288357 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3772db-dea4-44db-8967-a8de5454b845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:36.289083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247260c9-677e-496f-b992-b2de85921454 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:36.290022 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3772db-dea4-44db-8967-a8de5454b845 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:36.302948 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247260c9-677e-496f-b992-b2de85921454 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:36.310152 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74349f4e-0a44-48b0-97e5-afe060063e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:36.312881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74349f4e-0a44-48b0-97e5-afe060063e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:36.312881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74349f4e-0a44-48b0-97e5-afe060063e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:36.313095 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74349f4e-0a44-48b0-97e5-afe060063e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:36.314546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74349f4e-0a44-48b0-97e5-afe060063e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:36.315965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74349f4e-0a44-48b0-97e5-afe060063e74 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:36.330886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 830/1633] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:36.332992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3772db-dea4-44db-8967-a8de5454b845 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:36.348146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3772db-dea4-44db-8967-a8de5454b845 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:36.348459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 804/1634] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:36.350140 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74349f4e-0a44-48b0-97e5-afe060063e74 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:36.359120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c025a-1d35-4702-a09f-8c8cff05632b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:36.359779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c025a-1d35-4702-a09f-8c8cff05632b service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:36.360025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c025a-1d35-4702-a09f-8c8cff05632b service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:36.360295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c025a-1d35-4702-a09f-8c8cff05632b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:36.369353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74349f4e-0a44-48b0-97e5-afe060063e74 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:36.376321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87f14c-7887-465a-9c0f-27093a6ee072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:36.376810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87f14c-7887-465a-9c0f-27093a6ee072 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:36.377087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87f14c-7887-465a-9c0f-27093a6ee072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:36.377364 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87f14c-7887-465a-9c0f-27093a6ee072 admin admin] PATH_INFO: `/v3/projects/858f874fc7f94b3f9d3ff535fb2b50e6/users/bd91c425c5ab446c92163a3a1126b42e/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:36.379410 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87f14c-7887-465a-9c0f-27093a6ee072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858f874fc7f94b3f9d3ff535fb2b50e6, user_id=bd91c425c5ab446c92163a3a1126b42e, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:36.382878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87f14c-7887-465a-9c0f-27093a6ee072 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:36.407402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 805/1635] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:36 2022] PUT /identity/v3/projects/858f874fc7f94b3f9d3ff535fb2b50e6/users/bd91c425c5ab446c92163a3a1126b42e/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:36.408447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87f14c-7887-465a-9c0f-27093a6ee072 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:36.531646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87f14c-7887-465a-9c0f-27093a6ee072 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:36.545387 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c025a-1d35-4702-a09f-8c8cff05632b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:36.545665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c804f7c-d77b-4b31-b701-69b5a5313645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:36.546465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c804f7c-d77b-4b31-b701-69b5a5313645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:36.546817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c804f7c-d77b-4b31-b701-69b5a5313645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:36.547116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c804f7c-d77b-4b31-b701-69b5a5313645 admin admin] PATH_INFO: `/v3/projects/8c840369521d4af6bfb2b076b782f7ce/users/3f1a3cbde5884b7c99544ca606fa1282/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:36.552822 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c025a-1d35-4702-a09f-8c8cff05632b service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:36.553109 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c804f7c-d77b-4b31-b701-69b5a5313645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c840369521d4af6bfb2b076b782f7ce, user_id=3f1a3cbde5884b7c99544ca606fa1282, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:36.559155 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c804f7c-d77b-4b31-b701-69b5a5313645 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:36.579625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 831/1636] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:36.597676 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f017162-0200-4281-bd3c-b84f827e3f05 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:36.599759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f017162-0200-4281-bd3c-b84f827e3f05 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:36.600224 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f017162-0200-4281-bd3c-b84f827e3f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:36.602535 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 806/1637] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:36 2022] PUT /identity/v3/projects/8c840369521d4af6bfb2b076b782f7ce/users/3f1a3cbde5884b7c99544ca606fa1282/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:36.615949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2fe6c-6a2e-4d8d-bae1-ef7ff0a1e13a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:36.616849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2fe6c-6a2e-4d8d-bae1-ef7ff0a1e13a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:36.617547 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2fe6c-6a2e-4d8d-bae1-ef7ff0a1e13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:36.689036 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1f017162-0200-4281-bd3c-b84f827e3f05 None None] MFA Rules not processed for user `bd91c425c5ab446c92163a3a1126b42e`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:36.696106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1f017162-0200-4281-bd3c-b84f827e3f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:36.702065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-9ff2fe6c-6a2e-4d8d-bae1-ef7ff0a1e13a None None] MFA Rules not processed for user `3f1a3cbde5884b7c99544ca606fa1282`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:36.704326 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9ff2fe6c-6a2e-4d8d-bae1-ef7ff0a1e13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:36.765455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:36.866609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 832/1638] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:36 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:36.874606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 807/1639] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:36.879470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f017162-0200-4281-bd3c-b84f827e3f05 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:36.894141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:36.975496 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f017162-0200-4281-bd3c-b84f827e3f05 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:36.985699 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652432b-a94b-4465-afbf-08dc91e168ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:36.986345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652432b-a94b-4465-afbf-08dc91e168ef service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:36.986651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652432b-a94b-4465-afbf-08dc91e168ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:36.986929 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652432b-a94b-4465-afbf-08dc91e168ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:37.019774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652432b-a94b-4465-afbf-08dc91e168ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:37.021256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652432b-a94b-4465-afbf-08dc91e168ef service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:37.061681 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 833/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:36 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:37.100045 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2fe6c-6a2e-4d8d-bae1-ef7ff0a1e13a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:37.133405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2fe6c-6a2e-4d8d-bae1-ef7ff0a1e13a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:37.143135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d4bed-25c6-40fa-86f7-a16b3dad179a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:37.144136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d4bed-25c6-40fa-86f7-a16b3dad179a service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:37.144574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d4bed-25c6-40fa-86f7-a16b3dad179a service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:37.145011 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d4bed-25c6-40fa-86f7-a16b3dad179a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:37.258147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d4bed-25c6-40fa-86f7-a16b3dad179a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:37.259738 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d4bed-25c6-40fa-86f7-a16b3dad179a service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:37.284513 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 808/1641] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:37.635093 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652432b-a94b-4465-afbf-08dc91e168ef service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:37.862309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652432b-a94b-4465-afbf-08dc91e168ef service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:37.876726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c3df7-cf2a-430b-83cf-0e0debb1841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:37.878299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c3df7-cf2a-430b-83cf-0e0debb1841d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:37.879855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c3df7-cf2a-430b-83cf-0e0debb1841d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:37.881564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c3df7-cf2a-430b-83cf-0e0debb1841d admin admin] PATH_INFO: `/v3/users/ea5ad425a08f4981ba11916b21bd0acf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:37.884520 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c3df7-cf2a-430b-83cf-0e0debb1841d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5ad425a08f4981ba11916b21bd0acf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:37.886983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c3df7-cf2a-430b-83cf-0e0debb1841d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:37.915502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b501b5f-e509-43eb-923e-2a41417cabff None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:37.916109 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b501b5f-e509-43eb-923e-2a41417cabff None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:37.916590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b501b5f-e509-43eb-923e-2a41417cabff None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:37.918938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 809/1642] 10.222.0.27 () {54 vars in 962 bytes} [Thu Aug 4 22:25:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:25:37.941106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eed0e7-ce74-4b43-806d-52ab758e84a5 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:37.941644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eed0e7-ce74-4b43-806d-52ab758e84a5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:37.942029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eed0e7-ce74-4b43-806d-52ab758e84a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:37.986004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c8c3df7-cf2a-430b-83cf-0e0debb1841d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5ad425a08f4981ba11916b21bd0acf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:38.012361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c8c3df7-cf2a-430b-83cf-0e0debb1841d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5ad425a08f4981ba11916b21bd0acf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:38.017722 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-62eed0e7-ce74-4b43-806d-52ab758e84a5 None None] MFA Rules not processed for user `04899781f67746e193a05bdc004804cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:38.025486 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-62eed0e7-ce74-4b43-806d-52ab758e84a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:38.030737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c8c3df7-cf2a-430b-83cf-0e0debb1841d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5ad425a08f4981ba11916b21bd0acf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:38.032002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c8c3df7-cf2a-430b-83cf-0e0debb1841d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5ad425a08f4981ba11916b21bd0acf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:38.041607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c8c3df7-cf2a-430b-83cf-0e0debb1841d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5ad425a08f4981ba11916b21bd0acf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:38.050142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 834/1643] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:25:37 2022] DELETE /identity/v3/users/ea5ad425a08f4981ba11916b21bd0acf => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:38.054556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f2d60-dc36-4536-b4fc-f2dfbaa1b808 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:38.054836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f2d60-dc36-4536-b4fc-f2dfbaa1b808 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:38.055162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f2d60-dc36-4536-b4fc-f2dfbaa1b808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:38.095826 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b68f2d60-dc36-4536-b4fc-f2dfbaa1b808 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:38.098422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b68f2d60-dc36-4536-b4fc-f2dfbaa1b808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:38.194459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 810/1644] 10.222.0.27 () {58 vars in 1059 bytes} [Thu Aug 4 22:25:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:38.196078 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13fdaf-7007-4ece-9436-93f14bf6c3f6 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:38.196437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13fdaf-7007-4ece-9436-93f14bf6c3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:38.196790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13fdaf-7007-4ece-9436-93f14bf6c3f6 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:38.199484 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 811/1645] 10.222.0.27 () {54 vars in 912 bytes} [Thu Aug 4 22:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:25:38.205223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925d67b-72b7-415f-812c-8a3eb7915a93 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:38.205640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925d67b-72b7-415f-812c-8a3eb7915a93 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:38.206017 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925d67b-72b7-415f-812c-8a3eb7915a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:38.243431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:38.260016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b925d67b-72b7-415f-812c-8a3eb7915a93 None None] MFA Rules not processed for user `04899781f67746e193a05bdc004804cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:38.261781 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b925d67b-72b7-415f-812c-8a3eb7915a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:38.323893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 835/1646] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:25:38.361097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f2d60-dc36-4536-b4fc-f2dfbaa1b808 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:38.362531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b68f2d60-dc36-4536-b4fc-f2dfbaa1b808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:38.364018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:38.398561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 812/1647] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:25:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:38.417152 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925d67b-72b7-415f-812c-8a3eb7915a93 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:38.419565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b925d67b-72b7-415f-812c-8a3eb7915a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:38.487480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f2d60-dc36-4536-b4fc-f2dfbaa1b808 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:38.493633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b4093-9fa8-48c0-b1d7-fbe0a51aff29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:38.495755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b4093-9fa8-48c0-b1d7-fbe0a51aff29 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:38.496066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b4093-9fa8-48c0-b1d7-fbe0a51aff29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:38.496347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b4093-9fa8-48c0-b1d7-fbe0a51aff29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:38.511336 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b4093-9fa8-48c0-b1d7-fbe0a51aff29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:38.513875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b4093-9fa8-48c0-b1d7-fbe0a51aff29 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:38.530664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925d67b-72b7-415f-812c-8a3eb7915a93 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:38.537930 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f59b47-9c10-44c3-ae31-2cf1053949d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:38.538649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f59b47-9c10-44c3-ae31-2cf1053949d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:38.538940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f59b47-9c10-44c3-ae31-2cf1053949d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:38.539250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f59b47-9c10-44c3-ae31-2cf1053949d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:38.542685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 836/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:25:38.555256 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f59b47-9c10-44c3-ae31-2cf1053949d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:38.556951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f59b47-9c10-44c3-ae31-2cf1053949d5 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:38.587468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 813/1649] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:25:38.706560 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdcc24-6137-4dbe-a606-1968157412ed None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:38.706997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdcc24-6137-4dbe-a606-1968157412ed None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:38.707378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdcc24-6137-4dbe-a606-1968157412ed None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:38.709265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 837/1650] 10.222.0.27 () {54 vars in 912 bytes} [Thu Aug 4 22:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:25:38.717052 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63313604-4e01-4721-ba14-6ee080b7d786 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:38.717387 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63313604-4e01-4721-ba14-6ee080b7d786 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:38.717672 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63313604-4e01-4721-ba14-6ee080b7d786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:38.747324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-63313604-4e01-4721-ba14-6ee080b7d786 None None] MFA Rules not processed for user `04899781f67746e193a05bdc004804cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:38.749662 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-63313604-4e01-4721-ba14-6ee080b7d786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:38.775409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 814/1651] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:25:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:38.789781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdcc24-6137-4dbe-a606-1968157412ed None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:38.792841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a1fdcc24-6137-4dbe-a606-1968157412ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:38.814466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdcc24-6137-4dbe-a606-1968157412ed None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:38.827339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46ae52-23bc-4ea9-8ba9-37b28c3e65db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:38.829764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46ae52-23bc-4ea9-8ba9-37b28c3e65db service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:38.830708 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46ae52-23bc-4ea9-8ba9-37b28c3e65db service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:38.831224 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46ae52-23bc-4ea9-8ba9-37b28c3e65db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:38.865153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46ae52-23bc-4ea9-8ba9-37b28c3e65db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:38.865153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46ae52-23bc-4ea9-8ba9-37b28c3e65db service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:38.903507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 838/1652] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:39.015749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63313604-4e01-4721-ba14-6ee080b7d786 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:39.021298 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-63313604-4e01-4721-ba14-6ee080b7d786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:39.038746 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63313604-4e01-4721-ba14-6ee080b7d786 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:39.047938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:39.049394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:39.049889 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:39.050378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] PATH_INFO: `/v3/users/cdc4f3979f1d46cca86dc6c7723bf237` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:39.053276 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc4f3979f1d46cca86dc6c7723bf237)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:39.055200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: WARNING py.warnings [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:25:39.055200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: warnings.warn(msg) Aug 04 22:25:39.055200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: Aug 04 22:25:39.056848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:39.314132 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc4f3979f1d46cca86dc6c7723bf237'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:39.356291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc4f3979f1d46cca86dc6c7723bf237'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:39.383776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc4f3979f1d46cca86dc6c7723bf237'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:39.386216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc4f3979f1d46cca86dc6c7723bf237'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:39.441433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc4f3979f1d46cca86dc6c7723bf237'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:39.461779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 815/1653] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:25:39 2022] DELETE /identity/v3/users/cdc4f3979f1d46cca86dc6c7723bf237 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:39.468858 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0b387-c392-4c19-a177-f1f59926ad84 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:39.468858 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0b387-c392-4c19-a177-f1f59926ad84 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:39.474032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0b387-c392-4c19-a177-f1f59926ad84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:39.534284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-96b0b387-c392-4c19-a177-f1f59926ad84 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:39.544410 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-96b0b387-c392-4c19-a177-f1f59926ad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:39.685694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 839/1654] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:39.737983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:39.739705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:39.944629 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70188c17-b097-4b66-8041-a28ea2ee40dd admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:39.953014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ee814-d35a-4db6-bde9-c22f9c76f226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:39.954012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ee814-d35a-4db6-bde9-c22f9c76f226 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:39.955131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ee814-d35a-4db6-bde9-c22f9c76f226 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:39.955722 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ee814-d35a-4db6-bde9-c22f9c76f226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:39.986931 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ee814-d35a-4db6-bde9-c22f9c76f226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:39.989719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ee814-d35a-4db6-bde9-c22f9c76f226 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:40.025689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:40.033844 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 816/1655] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:40.780546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0b387-c392-4c19-a177-f1f59926ad84 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:40.782672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-96b0b387-c392-4c19-a177-f1f59926ad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:40.797185 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0b387-c392-4c19-a177-f1f59926ad84 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:40.802374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:40.803353 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:40.803792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:40.804213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] PATH_INFO: `/v3/projects/d7cf3b5d8087431f9a3771389d7bc98d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:40.805656 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7cf3b5d8087431f9a3771389d7bc98d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:40.806851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 04 22:25:40.806851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 04 22:25:40.806851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: Aug 04 22:25:40.808850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:40.928650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7cf3b5d8087431f9a3771389d7bc98d', 'request_id': 'req-fb6f1559-1e89-4069-a51b-921193b4d1e9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:40.973215 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7cf3b5d8087431f9a3771389d7bc98d', 'request_id': 'req-fb6f1559-1e89-4069-a51b-921193b4d1e9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:40.983642 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:40.999661 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7cf3b5d8087431f9a3771389d7bc98d', 'request_id': 'req-fb6f1559-1e89-4069-a51b-921193b4d1e9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:41.020555 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] The token cache is being invalidate because project d7cf3b5d8087431f9a3771389d7bc98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:25:41.024413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:41.028647 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:41.033167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 840/1656] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:25:40 2022] DELETE /identity/v3/projects/d7cf3b5d8087431f9a3771389d7bc98d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:41.038630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ee814-d35a-4db6-bde9-c22f9c76f226 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:41.054273 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ee814-d35a-4db6-bde9-c22f9c76f226 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:41.260111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582ac3a-c215-4156-992f-f965c610ea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:41.261578 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582ac3a-c215-4156-992f-f965c610ea4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:41.261864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582ac3a-c215-4156-992f-f965c610ea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:41.262314 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582ac3a-c215-4156-992f-f965c610ea4f admin admin] PATH_INFO: `/v3/users/bd91c425c5ab446c92163a3a1126b42e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:41.264481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582ac3a-c215-4156-992f-f965c610ea4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd91c425c5ab446c92163a3a1126b42e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:41.267352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582ac3a-c215-4156-992f-f965c610ea4f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:41.353338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:41.355133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:41.432121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7582ac3a-c215-4156-992f-f965c610ea4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd91c425c5ab446c92163a3a1126b42e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:41.455206 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7582ac3a-c215-4156-992f-f965c610ea4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd91c425c5ab446c92163a3a1126b42e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:41.467280 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7582ac3a-c215-4156-992f-f965c610ea4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd91c425c5ab446c92163a3a1126b42e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:41.469495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7582ac3a-c215-4156-992f-f965c610ea4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd91c425c5ab446c92163a3a1126b42e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:41.491380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f1559-1e89-4069-a51b-921193b4d1e9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:41.500594 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7582ac3a-c215-4156-992f-f965c610ea4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd91c425c5ab446c92163a3a1126b42e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:41.504211 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe81d6b-9732-445a-946e-c2d4b664f7af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:41.504866 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe81d6b-9732-445a-946e-c2d4b664f7af service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:41.505155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe81d6b-9732-445a-946e-c2d4b664f7af service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:41.505453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe81d6b-9732-445a-946e-c2d4b664f7af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:41.509252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ffe81d6b-9732-445a-946e-c2d4b664f7af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:41.515303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 817/1657] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:25:41 2022] DELETE /identity/v3/users/bd91c425c5ab446c92163a3a1126b42e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:41.697491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe81d6b-9732-445a-946e-c2d4b664f7af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:41.699965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe81d6b-9732-445a-946e-c2d4b664f7af service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:41.722721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 841/1658] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:42.191940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582ac3a-c215-4156-992f-f965c610ea4f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:42.194695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7582ac3a-c215-4156-992f-f965c610ea4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:42.356520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582ac3a-c215-4156-992f-f965c610ea4f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:42.373169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73b558-3817-4a6b-9ef6-cf03a293b957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:42.374154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73b558-3817-4a6b-9ef6-cf03a293b957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:42.374650 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73b558-3817-4a6b-9ef6-cf03a293b957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:42.375086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73b558-3817-4a6b-9ef6-cf03a293b957 admin admin] PATH_INFO: `/v3/projects/7197cdfed5c94b3ca9df938a6d808bff` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:42.377902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73b558-3817-4a6b-9ef6-cf03a293b957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7197cdfed5c94b3ca9df938a6d808bff)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:42.380266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73b558-3817-4a6b-9ef6-cf03a293b957 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:42.433799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:42.508585 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-6d73b558-3817-4a6b-9ef6-cf03a293b957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7197cdfed5c94b3ca9df938a6d808bff', 'request_id': 'req-6d73b558-3817-4a6b-9ef6-cf03a293b957'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:42.564312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-6d73b558-3817-4a6b-9ef6-cf03a293b957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7197cdfed5c94b3ca9df938a6d808bff', 'request_id': 'req-6d73b558-3817-4a6b-9ef6-cf03a293b957'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:42.578060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-6d73b558-3817-4a6b-9ef6-cf03a293b957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7197cdfed5c94b3ca9df938a6d808bff', 'request_id': 'req-6d73b558-3817-4a6b-9ef6-cf03a293b957'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:42.657375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-6d73b558-3817-4a6b-9ef6-cf03a293b957 admin admin] The token cache is being invalidate because project 7197cdfed5c94b3ca9df938a6d808bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:25:42.657799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-6d73b558-3817-4a6b-9ef6-cf03a293b957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:42.661235 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-6d73b558-3817-4a6b-9ef6-cf03a293b957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:42.665216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 818/1659] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:25:42 2022] DELETE /identity/v3/projects/7197cdfed5c94b3ca9df938a6d808bff => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:42.678339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5a3df-0b42-40bb-bfa3-10088c8a4265 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:42.678339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5a3df-0b42-40bb-bfa3-10088c8a4265 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:42.678339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5a3df-0b42-40bb-bfa3-10088c8a4265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:42.729656 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5ca5a3df-0b42-40bb-bfa3-10088c8a4265 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:42.739176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5ca5a3df-0b42-40bb-bfa3-10088c8a4265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:42.894187 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 842/1660] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:42.903135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ede59-8ad8-42ac-8287-cb70821a11d1 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:42.903426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ede59-8ad8-42ac-8287-cb70821a11d1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:42.903736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ede59-8ad8-42ac-8287-cb70821a11d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:42.952915 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b72ede59-8ad8-42ac-8287-cb70821a11d1 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:42.954166 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b72ede59-8ad8-42ac-8287-cb70821a11d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:42.997972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 819/1661] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:43.008257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5a3df-0b42-40bb-bfa3-10088c8a4265 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:43.032058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5a3df-0b42-40bb-bfa3-10088c8a4265 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:43.064805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf2108-9a10-4baf-ac4f-f4b69eb2c7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:43.066729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2108-9a10-4baf-ac4f-f4b69eb2c7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:43.067576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2108-9a10-4baf-ac4f-f4b69eb2c7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:43.068307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2108-9a10-4baf-ac4f-f4b69eb2c7a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:43.070000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf2108-9a10-4baf-ac4f-f4b69eb2c7a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:25:43.071481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf2108-9a10-4baf-ac4f-f4b69eb2c7a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:43.073351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf2108-9a10-4baf-ac4f-f4b69eb2c7a1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:43.109289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 843/1662] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:25:43.110548 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ede59-8ad8-42ac-8287-cb70821a11d1 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:43.124854 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ede59-8ad8-42ac-8287-cb70821a11d1 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:43.137440 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e8854-8a78-41bf-934f-aac83b22c7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:43.139620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e8854-8a78-41bf-934f-aac83b22c7fc admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:43.140144 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e8854-8a78-41bf-934f-aac83b22c7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:43.140575 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e8854-8a78-41bf-934f-aac83b22c7fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:43.141431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e8854-8a78-41bf-934f-aac83b22c7fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:43.147131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e8854-8a78-41bf-934f-aac83b22c7fc admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:43.223265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf2108-9a10-4baf-ac4f-f4b69eb2c7a1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:43.224240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 820/1663] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:43 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:43.241582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf2108-9a10-4baf-ac4f-f4b69eb2c7a1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:43.297480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:43.402079 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5da246-db7c-4ca2-b950-379b87459235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:43.403739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5da246-db7c-4ca2-b950-379b87459235 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:43.404214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5da246-db7c-4ca2-b950-379b87459235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:43.405176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5da246-db7c-4ca2-b950-379b87459235 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:43.406076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5da246-db7c-4ca2-b950-379b87459235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:43.408428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5da246-db7c-4ca2-b950-379b87459235 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:43.474557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 844/1664] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:43 2022] POST /identity/v3/users => generated 291 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:43.478812 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e8854-8a78-41bf-934f-aac83b22c7fc admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:43.496922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e8854-8a78-41bf-934f-aac83b22c7fc admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:43.522048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa353bc-35ab-4889-9fc2-54f73a4863a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:43.523531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa353bc-35ab-4889-9fc2-54f73a4863a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:43.523972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa353bc-35ab-4889-9fc2-54f73a4863a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:43.524253 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa353bc-35ab-4889-9fc2-54f73a4863a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:43.524986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa353bc-35ab-4889-9fc2-54f73a4863a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:43.526765 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa353bc-35ab-4889-9fc2-54f73a4863a2 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:43.568476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 821/1665] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:43.572336 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5da246-db7c-4ca2-b950-379b87459235 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:43.591856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5da246-db7c-4ca2-b950-379b87459235 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:43.616215 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27808125-8c1a-4144-a537-38d65bc9ae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:43.617847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27808125-8c1a-4144-a537-38d65bc9ae95 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:43.619426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27808125-8c1a-4144-a537-38d65bc9ae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:43.620540 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27808125-8c1a-4144-a537-38d65bc9ae95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:43.622641 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27808125-8c1a-4144-a537-38d65bc9ae95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:43.629318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27808125-8c1a-4144-a537-38d65bc9ae95 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:43.649668 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 845/1666] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:43.654793 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa353bc-35ab-4889-9fc2-54f73a4863a2 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:43.676243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa353bc-35ab-4889-9fc2-54f73a4863a2 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:43.685450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39542f-ceae-41bd-b477-29f867d46036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:43.686154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39542f-ceae-41bd-b477-29f867d46036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:43.686457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39542f-ceae-41bd-b477-29f867d46036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:43.686744 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39542f-ceae-41bd-b477-29f867d46036 admin admin] PATH_INFO: `/v3/projects/b6161a2ea89b4f82a2f5760d0cbd139d/users/06ba43a0507a4b70a04cdfaf9867f32f/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:43.728851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39542f-ceae-41bd-b477-29f867d46036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6161a2ea89b4f82a2f5760d0cbd139d, user_id=06ba43a0507a4b70a04cdfaf9867f32f, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:43.728851 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39542f-ceae-41bd-b477-29f867d46036 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:43.764803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 822/1667] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:43 2022] PUT /identity/v3/projects/b6161a2ea89b4f82a2f5760d0cbd139d/users/06ba43a0507a4b70a04cdfaf9867f32f/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:43.775407 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd134d6-f700-454e-8bad-976c8dceabb9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:43.776976 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd134d6-f700-454e-8bad-976c8dceabb9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:43.777890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd134d6-f700-454e-8bad-976c8dceabb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:43.872471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5bd134d6-f700-454e-8bad-976c8dceabb9 None None] MFA Rules not processed for user `06ba43a0507a4b70a04cdfaf9867f32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:43.873895 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5bd134d6-f700-454e-8bad-976c8dceabb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:44.021000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 846/1668] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:44.028360 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39542f-ceae-41bd-b477-29f867d46036 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:44.155121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39542f-ceae-41bd-b477-29f867d46036 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:44.162702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2a345-2e41-48b0-ab64-cb29e997ccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:44.163420 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2a345-2e41-48b0-ab64-cb29e997ccd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:44.163928 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2a345-2e41-48b0-ab64-cb29e997ccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:44.164202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2a345-2e41-48b0-ab64-cb29e997ccd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:44.165266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2a345-2e41-48b0-ab64-cb29e997ccd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:44.168310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2a345-2e41-48b0-ab64-cb29e997ccd4 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:44.209869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 823/1669] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:44 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:44.215916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd134d6-f700-454e-8bad-976c8dceabb9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:44.236535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd134d6-f700-454e-8bad-976c8dceabb9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:44.330192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb0401-1db5-41a6-9cc1-1a71c58b250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:44.331085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb0401-1db5-41a6-9cc1-1a71c58b250b admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:44.331375 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb0401-1db5-41a6-9cc1-1a71c58b250b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:44.331948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb0401-1db5-41a6-9cc1-1a71c58b250b admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:44.333071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb0401-1db5-41a6-9cc1-1a71c58b250b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:44.335352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb0401-1db5-41a6-9cc1-1a71c58b250b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:44.382535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 847/1670] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:44 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:44.386852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2a345-2e41-48b0-ab64-cb29e997ccd4 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:44.408230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2a345-2e41-48b0-ab64-cb29e997ccd4 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:44.423950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56543e87-e28f-4d3f-9b44-7e85121edcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:44.424947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56543e87-e28f-4d3f-9b44-7e85121edcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:44.425468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56543e87-e28f-4d3f-9b44-7e85121edcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:44.425957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56543e87-e28f-4d3f-9b44-7e85121edcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:44.426891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56543e87-e28f-4d3f-9b44-7e85121edcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:44.428701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56543e87-e28f-4d3f-9b44-7e85121edcd7 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:44.490204 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 824/1671] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:44.494358 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb0401-1db5-41a6-9cc1-1a71c58b250b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:44.509841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb0401-1db5-41a6-9cc1-1a71c58b250b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:44.525551 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1d3c1-0aff-45c2-a2ac-0b4b4bb4bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:44.526385 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1d3c1-0aff-45c2-a2ac-0b4b4bb4bba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:44.526745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1d3c1-0aff-45c2-a2ac-0b4b4bb4bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:44.527133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1d3c1-0aff-45c2-a2ac-0b4b4bb4bba6 admin admin] PATH_INFO: `/v3/projects/7f24b285963b4e65afdd43bc8f921c19/users/df97e0ef8b3e460f80bb36a870d12352/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:44.564190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1d3c1-0aff-45c2-a2ac-0b4b4bb4bba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f24b285963b4e65afdd43bc8f921c19, user_id=df97e0ef8b3e460f80bb36a870d12352, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:44.570914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1d3c1-0aff-45c2-a2ac-0b4b4bb4bba6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:44.595240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:44.601764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 848/1672] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:44 2022] PUT /identity/v3/projects/7f24b285963b4e65afdd43bc8f921c19/users/df97e0ef8b3e460f80bb36a870d12352/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:44.606301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56543e87-e28f-4d3f-9b44-7e85121edcd7 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:44.622087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56543e87-e28f-4d3f-9b44-7e85121edcd7 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:44.651992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1d3c1-0aff-45c2-a2ac-0b4b4bb4bba6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:44.654331 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ceb1d3c1-0aff-45c2-a2ac-0b4b4bb4bba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:44.679921 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:44.895802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714954a-88bc-4056-a990-b3bea1286ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:44.895923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714954a-88bc-4056-a990-b3bea1286ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:44.896155 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714954a-88bc-4056-a990-b3bea1286ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:44.896542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714954a-88bc-4056-a990-b3bea1286ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:44.897270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714954a-88bc-4056-a990-b3bea1286ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:44.903554 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714954a-88bc-4056-a990-b3bea1286ccb admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:44.906381 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1d3c1-0aff-45c2-a2ac-0b4b4bb4bba6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:44.927882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859f4e2-907d-4273-818e-69f9f3d0b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:44.928578 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859f4e2-907d-4273-818e-69f9f3d0b2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:44.928866 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859f4e2-907d-4273-818e-69f9f3d0b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:44.929148 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859f4e2-907d-4273-818e-69f9f3d0b2e8 admin admin] PATH_INFO: `/v3/projects/858f874fc7f94b3f9d3ff535fb2b50e6` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:44.930621 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859f4e2-907d-4273-818e-69f9f3d0b2e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=858f874fc7f94b3f9d3ff535fb2b50e6)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:44.937569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859f4e2-907d-4273-818e-69f9f3d0b2e8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:44.937894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 825/1673] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:44.941686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714954a-88bc-4056-a990-b3bea1286ccb admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:44.977033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714954a-88bc-4056-a990-b3bea1286ccb admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:44.990633 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445c26e-1bda-46a9-8b5a-c2c2657e8afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:44.991258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445c26e-1bda-46a9-8b5a-c2c2657e8afd admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:44.991543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445c26e-1bda-46a9-8b5a-c2c2657e8afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:44.992134 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445c26e-1bda-46a9-8b5a-c2c2657e8afd admin admin] PATH_INFO: `/v3/projects/7f24b285963b4e65afdd43bc8f921c19/users/df97e0ef8b3e460f80bb36a870d12352/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:44.996700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445c26e-1bda-46a9-8b5a-c2c2657e8afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f24b285963b4e65afdd43bc8f921c19, user_id=df97e0ef8b3e460f80bb36a870d12352, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:45.006766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445c26e-1bda-46a9-8b5a-c2c2657e8afd admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:45.040883 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 826/1674] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:44 2022] PUT /identity/v3/projects/7f24b285963b4e65afdd43bc8f921c19/users/df97e0ef8b3e460f80bb36a870d12352/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:45.053882 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af96265-7008-46bf-a3ff-9ee8bb0dc2e0 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:45.054186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af96265-7008-46bf-a3ff-9ee8bb0dc2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:45.054694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af96265-7008-46bf-a3ff-9ee8bb0dc2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:45.084912 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1859f4e2-907d-4273-818e-69f9f3d0b2e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858f874fc7f94b3f9d3ff535fb2b50e6', 'request_id': 'req-1859f4e2-907d-4273-818e-69f9f3d0b2e8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:45.092759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1859f4e2-907d-4273-818e-69f9f3d0b2e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858f874fc7f94b3f9d3ff535fb2b50e6', 'request_id': 'req-1859f4e2-907d-4273-818e-69f9f3d0b2e8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:45.121782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1859f4e2-907d-4273-818e-69f9f3d0b2e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858f874fc7f94b3f9d3ff535fb2b50e6', 'request_id': 'req-1859f4e2-907d-4273-818e-69f9f3d0b2e8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:45.151530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1859f4e2-907d-4273-818e-69f9f3d0b2e8 admin admin] The token cache is being invalidate because project 858f874fc7f94b3f9d3ff535fb2b50e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:25:45.151975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1859f4e2-907d-4273-818e-69f9f3d0b2e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:45.155465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1859f4e2-907d-4273-818e-69f9f3d0b2e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:45.164538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 849/1675] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:25:44 2022] DELETE /identity/v3/projects/858f874fc7f94b3f9d3ff535fb2b50e6 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:45.167410 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ff458-149f-430f-988e-3180915fe061 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:45.170447 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ff458-149f-430f-988e-3180915fe061 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:45.170447 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ff458-149f-430f-988e-3180915fe061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:45.185658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5af96265-7008-46bf-a3ff-9ee8bb0dc2e0 None None] MFA Rules not processed for user `df97e0ef8b3e460f80bb36a870d12352`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:45.187078 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5af96265-7008-46bf-a3ff-9ee8bb0dc2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:45.238125 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8a9ff458-149f-430f-988e-3180915fe061 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:45.259277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8a9ff458-149f-430f-988e-3180915fe061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:45.404494 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 827/1676] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:25:45.412406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af96265-7008-46bf-a3ff-9ee8bb0dc2e0 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:45.414693 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5af96265-7008-46bf-a3ff-9ee8bb0dc2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:45.522287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 850/1677] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:45.524051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff5350-6916-4603-b4e7-abc2d49d2a89 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:45.524345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff5350-6916-4603-b4e7-abc2d49d2a89 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:45.524623 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff5350-6916-4603-b4e7-abc2d49d2a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:45.606230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-24ff5350-6916-4603-b4e7-abc2d49d2a89 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:45.607514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-24ff5350-6916-4603-b4e7-abc2d49d2a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:45.608643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af96265-7008-46bf-a3ff-9ee8bb0dc2e0 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:45.615718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bada40-0770-4c5d-8a0a-d4311145f097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:45.616592 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bada40-0770-4c5d-8a0a-d4311145f097 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:45.618111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bada40-0770-4c5d-8a0a-d4311145f097 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:45.618601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bada40-0770-4c5d-8a0a-d4311145f097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:45.626114 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 851/1678] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:25:45.634279 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff5350-6916-4603-b4e7-abc2d49d2a89 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:45.657881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bada40-0770-4c5d-8a0a-d4311145f097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:45.659387 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bada40-0770-4c5d-8a0a-d4311145f097 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:45.695295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff5350-6916-4603-b4e7-abc2d49d2a89 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:45.722626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0e951-70a3-4064-9d47-3467324690e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:45.734845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 828/1679] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:25:45.736978 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0e951-70a3-4064-9d47-3467324690e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:45.737117 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0e951-70a3-4064-9d47-3467324690e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:45.737533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0e951-70a3-4064-9d47-3467324690e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:45.738309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0e951-70a3-4064-9d47-3467324690e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:25:45.738679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0e951-70a3-4064-9d47-3467324690e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:45.740414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0e951-70a3-4064-9d47-3467324690e2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:45.798178 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 852/1680] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:25:45.799170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bada40-0770-4c5d-8a0a-d4311145f097 service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:45.825019 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bada40-0770-4c5d-8a0a-d4311145f097 service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:45.849629 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbdc1a-e3b5-4308-9af6-cdb0fc776bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:45.852575 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbdc1a-e3b5-4308-9af6-cdb0fc776bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:45.852878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbdc1a-e3b5-4308-9af6-cdb0fc776bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:45.853148 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbdc1a-e3b5-4308-9af6-cdb0fc776bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:45.854768 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbdc1a-e3b5-4308-9af6-cdb0fc776bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:45.859646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbdc1a-e3b5-4308-9af6-cdb0fc776bb8 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:45.974603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 829/1681] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:45 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:45.978727 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0e951-70a3-4064-9d47-3467324690e2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:46.004637 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0e951-70a3-4064-9d47-3467324690e2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:46.026425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:46.333861 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f6496-4b71-41ef-bb0d-748333e13230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:46.342509 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f6496-4b71-41ef-bb0d-748333e13230 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:46.343670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f6496-4b71-41ef-bb0d-748333e13230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:46.345800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f6496-4b71-41ef-bb0d-748333e13230 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:46.346768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f6496-4b71-41ef-bb0d-748333e13230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:46.348891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f6496-4b71-41ef-bb0d-748333e13230 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:46.420787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 853/1682] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:45 2022] POST /identity/v3/users => generated 287 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:46.424717 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbdc1a-e3b5-4308-9af6-cdb0fc776bb8 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:46.449457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbdc1a-e3b5-4308-9af6-cdb0fc776bb8 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:46.458795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f6496-4b71-41ef-bb0d-748333e13230 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:46.462609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4a7f6496-4b71-41ef-bb0d-748333e13230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:46.471254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b389f5-9f1d-4e77-a478-a0036c2039e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:46.472005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b389f5-9f1d-4e77-a478-a0036c2039e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:46.475034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b389f5-9f1d-4e77-a478-a0036c2039e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:46.475417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b389f5-9f1d-4e77-a478-a0036c2039e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:46.477548 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b389f5-9f1d-4e77-a478-a0036c2039e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:46.485843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b389f5-9f1d-4e77-a478-a0036c2039e5 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:46.496147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:46.529294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 830/1683] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:46.533029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2bcda-0807-4d8a-8b98-355dab4b2eec None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:46.533171 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2bcda-0807-4d8a-8b98-355dab4b2eec None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:46.533406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2bcda-0807-4d8a-8b98-355dab4b2eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:46.583964 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f6496-4b71-41ef-bb0d-748333e13230 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:46.599685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-19d2bcda-0807-4d8a-8b98-355dab4b2eec None None] MFA Rules not processed for user `edd38bf6e5f849ff99259f9f494203d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:46.602241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-19d2bcda-0807-4d8a-8b98-355dab4b2eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:46.614133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1314-aa76-4a15-ae2b-5e84924b4c87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:46.614824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1314-aa76-4a15-ae2b-5e84924b4c87 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:46.615107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1314-aa76-4a15-ae2b-5e84924b4c87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:46.615384 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1314-aa76-4a15-ae2b-5e84924b4c87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:46.620259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-727b1314-aa76-4a15-ae2b-5e84924b4c87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:46.766758 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b1314-aa76-4a15-ae2b-5e84924b4c87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:46.768974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b1314-aa76-4a15-ae2b-5e84924b4c87 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:46.787559 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 854/1684] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:46.789243 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1314-aa76-4a15-ae2b-5e84924b4c87 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:46.803491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 831/1685] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:46.809311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1314-aa76-4a15-ae2b-5e84924b4c87 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:46.815598 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd44d9-8d8f-493e-b691-422dd0145a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:46.816248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd44d9-8d8f-493e-b691-422dd0145a85 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:46.816735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd44d9-8d8f-493e-b691-422dd0145a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:46.817024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd44d9-8d8f-493e-b691-422dd0145a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:46.817815 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd44d9-8d8f-493e-b691-422dd0145a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:46.819806 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd44d9-8d8f-493e-b691-422dd0145a85 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:46.825697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2bcda-0807-4d8a-8b98-355dab4b2eec None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:46.829292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-19d2bcda-0807-4d8a-8b98-355dab4b2eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:46.835738 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 855/1686] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:46.843857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd44d9-8d8f-493e-b691-422dd0145a85 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:46.868871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd44d9-8d8f-493e-b691-422dd0145a85 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:46.881201 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df7858-d646-4688-ba3e-b5df06b9c74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:46.882620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df7858-d646-4688-ba3e-b5df06b9c74e admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:46.882915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df7858-d646-4688-ba3e-b5df06b9c74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:46.883198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df7858-d646-4688-ba3e-b5df06b9c74e admin admin] PATH_INFO: `/v3/projects/90faa56195834da1863b5f3117148176/users/d9e590d31fab4298838c58fbc088867e/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:46.921539 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df7858-d646-4688-ba3e-b5df06b9c74e admin admin] RBAC: Authorizing `identity:create_grant(project_id=90faa56195834da1863b5f3117148176, user_id=d9e590d31fab4298838c58fbc088867e, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:46.926215 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df7858-d646-4688-ba3e-b5df06b9c74e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:46.954394 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 856/1687] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:46 2022] PUT /identity/v3/projects/90faa56195834da1863b5f3117148176/users/d9e590d31fab4298838c58fbc088867e/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:25:46.967320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4b02d-4a28-4d25-a7b8-0d96af0985b0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:46.967606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4b02d-4a28-4d25-a7b8-0d96af0985b0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:46.967876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4b02d-4a28-4d25-a7b8-0d96af0985b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:47.004361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f5b4b02d-4a28-4d25-a7b8-0d96af0985b0 None None] MFA Rules not processed for user `d9e590d31fab4298838c58fbc088867e`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:47.005853 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f5b4b02d-4a28-4d25-a7b8-0d96af0985b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:47.012672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:47.041139 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2bcda-0807-4d8a-8b98-355dab4b2eec None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:47.147447 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 857/1688] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:47.148902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4b02d-4a28-4d25-a7b8-0d96af0985b0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:47.250673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4b02d-4a28-4d25-a7b8-0d96af0985b0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:47.257740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775dc40-3fe9-40e9-940e-e68a18179087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:47.258913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775dc40-3fe9-40e9-940e-e68a18179087 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:47.259497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775dc40-3fe9-40e9-940e-e68a18179087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:47.260713 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775dc40-3fe9-40e9-940e-e68a18179087 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:47.262074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775dc40-3fe9-40e9-940e-e68a18179087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:47.264886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775dc40-3fe9-40e9-940e-e68a18179087 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:47.273255 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e8dcf-2019-49e7-af3d-a3ba35804a83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:47.274174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e8dcf-2019-49e7-af3d-a3ba35804a83 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:47.274482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e8dcf-2019-49e7-af3d-a3ba35804a83 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:47.274763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e8dcf-2019-49e7-af3d-a3ba35804a83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:47.309684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 858/1689] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:47 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:47.316601 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775dc40-3fe9-40e9-940e-e68a18179087 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:47.333622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:47.455824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e8dcf-2019-49e7-af3d-a3ba35804a83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:47.459180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e8dcf-2019-49e7-af3d-a3ba35804a83 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:47.483549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 832/1690] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:47.487165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775dc40-3fe9-40e9-940e-e68a18179087 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:47.492558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066a2d3-9ce1-4fb2-8c35-a54451476df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:47.493346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066a2d3-9ce1-4fb2-8c35-a54451476df6 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:47.493693 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066a2d3-9ce1-4fb2-8c35-a54451476df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:47.494041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066a2d3-9ce1-4fb2-8c35-a54451476df6 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:47.495076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066a2d3-9ce1-4fb2-8c35-a54451476df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:47.499862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066a2d3-9ce1-4fb2-8c35-a54451476df6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:47.563272 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 859/1691] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:47 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:47.564480 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e8dcf-2019-49e7-af3d-a3ba35804a83 service nova] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:47.593857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e8dcf-2019-49e7-af3d-a3ba35804a83 service nova] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:47.613974 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fac5e-b4da-433f-b40e-b9f6a56ff83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:47.615934 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fac5e-b4da-433f-b40e-b9f6a56ff83b admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:47.616226 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fac5e-b4da-433f-b40e-b9f6a56ff83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:47.617243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fac5e-b4da-433f-b40e-b9f6a56ff83b admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:47.617243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fac5e-b4da-433f-b40e-b9f6a56ff83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:47.618871 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fac5e-b4da-433f-b40e-b9f6a56ff83b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:47.654837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 833/1692] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:47.659701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066a2d3-9ce1-4fb2-8c35-a54451476df6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:47.685723 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066a2d3-9ce1-4fb2-8c35-a54451476df6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:47.695189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af0f86-9dae-4cf4-9224-041d64a95a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:47.701337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af0f86-9dae-4cf4-9224-041d64a95a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:47.703267 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af0f86-9dae-4cf4-9224-041d64a95a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:47.705750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af0f86-9dae-4cf4-9224-041d64a95a94 admin admin] PATH_INFO: `/v3/projects/e7867cf156da4e90a023d83692f8bb5e/users/0cdab7d29b7a42029bfab23b5dbe7f27/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:47.741718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af0f86-9dae-4cf4-9224-041d64a95a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7867cf156da4e90a023d83692f8bb5e, user_id=0cdab7d29b7a42029bfab23b5dbe7f27, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:47.757711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af0f86-9dae-4cf4-9224-041d64a95a94 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:47.816124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:47.843508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 860/1693] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:47 2022] PUT /identity/v3/projects/e7867cf156da4e90a023d83692f8bb5e/users/0cdab7d29b7a42029bfab23b5dbe7f27/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:47.848716 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fac5e-b4da-433f-b40e-b9f6a56ff83b admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:47.868117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fac5e-b4da-433f-b40e-b9f6a56ff83b admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:47.989491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415b795-755c-4636-8e2c-c64612d16c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:47.991018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415b795-755c-4636-8e2c-c64612d16c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:47.991355 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415b795-755c-4636-8e2c-c64612d16c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:47.991649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415b795-755c-4636-8e2c-c64612d16c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:47.992962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415b795-755c-4636-8e2c-c64612d16c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:47.996220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415b795-755c-4636-8e2c-c64612d16c0f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:48.016947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 834/1694] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:48.021376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af0f86-9dae-4cf4-9224-041d64a95a94 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:48.040417 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af0f86-9dae-4cf4-9224-041d64a95a94 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:48.056508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529d40d-f6ec-46a2-9e8c-68716a10a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:48.058482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529d40d-f6ec-46a2-9e8c-68716a10a68c admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:48.059644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529d40d-f6ec-46a2-9e8c-68716a10a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:48.060213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529d40d-f6ec-46a2-9e8c-68716a10a68c admin admin] PATH_INFO: `/v3/projects/e7867cf156da4e90a023d83692f8bb5e/users/0cdab7d29b7a42029bfab23b5dbe7f27/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:48.065363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529d40d-f6ec-46a2-9e8c-68716a10a68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7867cf156da4e90a023d83692f8bb5e, user_id=0cdab7d29b7a42029bfab23b5dbe7f27, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:48.071295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529d40d-f6ec-46a2-9e8c-68716a10a68c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:48.093605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 861/1695] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:48 2022] PUT /identity/v3/projects/e7867cf156da4e90a023d83692f8bb5e/users/0cdab7d29b7a42029bfab23b5dbe7f27/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:48.105642 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a5dcf-3a4a-46f4-8961-403c451eeb4a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:48.106430 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a5dcf-3a4a-46f4-8961-403c451eeb4a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:48.106863 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a5dcf-3a4a-46f4-8961-403c451eeb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:48.179580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-522a5dcf-3a4a-46f4-8961-403c451eeb4a None None] MFA Rules not processed for user `0cdab7d29b7a42029bfab23b5dbe7f27`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:48.180860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-522a5dcf-3a4a-46f4-8961-403c451eeb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:48.473208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 835/1696] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:48.545986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529d40d-f6ec-46a2-9e8c-68716a10a68c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:48.681623 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529d40d-f6ec-46a2-9e8c-68716a10a68c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:48.688019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ce644-ae65-4ffe-bf8d-7c76dbeacdc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:48.689156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ce644-ae65-4ffe-bf8d-7c76dbeacdc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:48.689454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ce644-ae65-4ffe-bf8d-7c76dbeacdc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:48.689882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ce644-ae65-4ffe-bf8d-7c76dbeacdc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:48.706153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ce644-ae65-4ffe-bf8d-7c76dbeacdc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:48.708276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ce644-ae65-4ffe-bf8d-7c76dbeacdc3 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:48.730901 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 862/1697] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:50.116639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a5dcf-3a4a-46f4-8961-403c451eeb4a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:50.184070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:50.233157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a5dcf-3a4a-46f4-8961-403c451eeb4a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:50.238695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21347db-0c6f-4d75-a3d0-df0a686bbc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:50.239937 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21347db-0c6f-4d75-a3d0-df0a686bbc28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:50.240706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21347db-0c6f-4d75-a3d0-df0a686bbc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:50.241214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21347db-0c6f-4d75-a3d0-df0a686bbc28 admin admin] PATH_INFO: `/v3/users/d9e590d31fab4298838c58fbc088867e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:50.242893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21347db-0c6f-4d75-a3d0-df0a686bbc28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e590d31fab4298838c58fbc088867e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:50.245647 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21347db-0c6f-4d75-a3d0-df0a686bbc28 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:50.340252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ce644-ae65-4ffe-bf8d-7c76dbeacdc3 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:50.341855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-330ce644-ae65-4ffe-bf8d-7c76dbeacdc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:50.348414 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d21347db-0c6f-4d75-a3d0-df0a686bbc28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e590d31fab4298838c58fbc088867e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:50.360888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d21347db-0c6f-4d75-a3d0-df0a686bbc28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e590d31fab4298838c58fbc088867e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:50.367073 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ce644-ae65-4ffe-bf8d-7c76dbeacdc3 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:50.371300 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d21347db-0c6f-4d75-a3d0-df0a686bbc28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e590d31fab4298838c58fbc088867e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:50.375697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d21347db-0c6f-4d75-a3d0-df0a686bbc28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e590d31fab4298838c58fbc088867e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:50.382441 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50cdc4-ee50-4996-af8c-b72a58e9acc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:50.383137 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50cdc4-ee50-4996-af8c-b72a58e9acc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:50.383390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50cdc4-ee50-4996-af8c-b72a58e9acc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:50.383669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50cdc4-ee50-4996-af8c-b72a58e9acc0 admin admin] PATH_INFO: `/v3/users/87cc572f28a84ab7b8c9ef0e41eb097c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:50.394190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50cdc4-ee50-4996-af8c-b72a58e9acc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87cc572f28a84ab7b8c9ef0e41eb097c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:50.396213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50cdc4-ee50-4996-af8c-b72a58e9acc0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:50.405387 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d21347db-0c6f-4d75-a3d0-df0a686bbc28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e590d31fab4298838c58fbc088867e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:50.421339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 836/1698] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:25:50 2022] DELETE /identity/v3/users/d9e590d31fab4298838c58fbc088867e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:50.425798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def82ae8-a604-4d52-9fef-9c0f672fcd56 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:50.426223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def82ae8-a604-4d52-9fef-9c0f672fcd56 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:50.426652 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def82ae8-a604-4d52-9fef-9c0f672fcd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:50.494236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-def82ae8-a604-4d52-9fef-9c0f672fcd56 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:50.498919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-def82ae8-a604-4d52-9fef-9c0f672fcd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:50.511711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9a50cdc4-ee50-4996-af8c-b72a58e9acc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87cc572f28a84ab7b8c9ef0e41eb097c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:50.534581 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9a50cdc4-ee50-4996-af8c-b72a58e9acc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87cc572f28a84ab7b8c9ef0e41eb097c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:50.558336 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9a50cdc4-ee50-4996-af8c-b72a58e9acc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87cc572f28a84ab7b8c9ef0e41eb097c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:50.559626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9a50cdc4-ee50-4996-af8c-b72a58e9acc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87cc572f28a84ab7b8c9ef0e41eb097c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:50.579890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9a50cdc4-ee50-4996-af8c-b72a58e9acc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87cc572f28a84ab7b8c9ef0e41eb097c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:50.596667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 863/1699] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:25:50 2022] DELETE /identity/v3/users/87cc572f28a84ab7b8c9ef0e41eb097c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:50.600200 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9cdf-c16b-4e7d-af2a-b53eb5a05bc0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:50.602638 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9cdf-c16b-4e7d-af2a-b53eb5a05bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:50.603208 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9cdf-c16b-4e7d-af2a-b53eb5a05bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:50.685230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-11dd9cdf-c16b-4e7d-af2a-b53eb5a05bc0 None None] MFA Rules not processed for user `ad5781045de04647bd213028d7209fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:50.693392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-11dd9cdf-c16b-4e7d-af2a-b53eb5a05bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:50.754039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 837/1700] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:25:50.758561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb79d8a-5820-4fc8-aff2-27f5338aee4a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:50.758958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb79d8a-5820-4fc8-aff2-27f5338aee4a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:50.760698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb79d8a-5820-4fc8-aff2-27f5338aee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:50.794882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:50.834049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 864/1701] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:50.844090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd9cdf-c16b-4e7d-af2a-b53eb5a05bc0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:50.844187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-8cb79d8a-5820-4fc8-aff2-27f5338aee4a None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:50.844187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8cb79d8a-5820-4fc8-aff2-27f5338aee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:50.844342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-11dd9cdf-c16b-4e7d-af2a-b53eb5a05bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:51.000575 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:51.051307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 838/1702] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:51.053220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd35cb1-2a3b-4a1d-96d5-7e90152042a2 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:51.053650 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd35cb1-2a3b-4a1d-96d5-7e90152042a2 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:51.054132 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd35cb1-2a3b-4a1d-96d5-7e90152042a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:51.082437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-1fd35cb1-2a3b-4a1d-96d5-7e90152042a2 None None] MFA Rules not processed for user `ad5781045de04647bd213028d7209fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:51.084645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1fd35cb1-2a3b-4a1d-96d5-7e90152042a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:51.099188 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 839/1703] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:51.100395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd35cb1-2a3b-4a1d-96d5-7e90152042a2 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:51.101738 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd9cdf-c16b-4e7d-af2a-b53eb5a05bc0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:51.102280 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1fd35cb1-2a3b-4a1d-96d5-7e90152042a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:51.118526 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd35cb1-2a3b-4a1d-96d5-7e90152042a2 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:51.127527 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1335dc0-018f-4c84-ba9c-c1fc2e64e22f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:51.128593 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1335dc0-018f-4c84-ba9c-c1fc2e64e22f service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:51.129235 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1335dc0-018f-4c84-ba9c-c1fc2e64e22f service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:51.129710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3935a8-ee86-4b8b-85b0-12924c91d17f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:51.129876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1335dc0-018f-4c84-ba9c-c1fc2e64e22f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:51.131766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3935a8-ee86-4b8b-85b0-12924c91d17f service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:51.131766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3935a8-ee86-4b8b-85b0-12924c91d17f service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:51.131766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3935a8-ee86-4b8b-85b0-12924c91d17f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:51.154781 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1335dc0-018f-4c84-ba9c-c1fc2e64e22f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:51.156741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1335dc0-018f-4c84-ba9c-c1fc2e64e22f service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:51.173770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3935a8-ee86-4b8b-85b0-12924c91d17f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:51.175172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3935a8-ee86-4b8b-85b0-12924c91d17f service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:51.198727 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 840/1704] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:51.201561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1335dc0-018f-4c84-ba9c-c1fc2e64e22f service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:51.205392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e1335dc0-018f-4c84-ba9c-c1fc2e64e22f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:51.227890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 865/1705] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:25:51.459811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1335dc0-018f-4c84-ba9c-c1fc2e64e22f service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:51.474684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d4e88-9f30-4607-9287-c11689add80d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:51.475258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d4e88-9f30-4607-9287-c11689add80d service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:51.475546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d4e88-9f30-4607-9287-c11689add80d service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:51.475831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d4e88-9f30-4607-9287-c11689add80d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:51.503905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d4e88-9f30-4607-9287-c11689add80d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:51.510720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d4e88-9f30-4607-9287-c11689add80d service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:51.538436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 841/1706] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:51.989850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0ef4-dc78-4e42-9e21-ae89075c5627 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:51.990307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0ef4-dc78-4e42-9e21-ae89075c5627 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:51.990868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0ef4-dc78-4e42-9e21-ae89075c5627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:52.023896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-063f0ef4-dc78-4e42-9e21-ae89075c5627 None None] MFA Rules not processed for user `edd38bf6e5f849ff99259f9f494203d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:52.025123 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-063f0ef4-dc78-4e42-9e21-ae89075c5627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:52.151344 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 866/1707] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:25:52.825123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9e06-050e-4599-88e4-ff95df4e7f57 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:52.826230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9e06-050e-4599-88e4-ff95df4e7f57 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:52.826563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9e06-050e-4599-88e4-ff95df4e7f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:52.841420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f0ef4-dc78-4e42-9e21-ae89075c5627 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:52.842876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-063f0ef4-dc78-4e42-9e21-ae89075c5627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:52.876347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f0ef4-dc78-4e42-9e21-ae89075c5627 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:52.907796 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81d9fa-3664-4186-acee-115799b4dab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:52.908525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d9fa-3664-4186-acee-115799b4dab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:52.908805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d9fa-3664-4186-acee-115799b4dab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:52.909076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d9fa-3664-4186-acee-115799b4dab0 admin admin] PATH_INFO: `/v3/projects/785ed2aed2a94fa68175d2504d715329` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:52.910313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81d9fa-3664-4186-acee-115799b4dab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=785ed2aed2a94fa68175d2504d715329)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:52.914570 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81d9fa-3664-4186-acee-115799b4dab0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:52.924382 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-47ae9e06-050e-4599-88e4-ff95df4e7f57 None None] MFA Rules not processed for user `ffee73e2e3d2449ba017f04ed8b511d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:52.931172 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-47ae9e06-050e-4599-88e4-ff95df4e7f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:53.105252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fc81d9fa-3664-4186-acee-115799b4dab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '785ed2aed2a94fa68175d2504d715329', 'request_id': 'req-fc81d9fa-3664-4186-acee-115799b4dab0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:53.127583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fc81d9fa-3664-4186-acee-115799b4dab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '785ed2aed2a94fa68175d2504d715329', 'request_id': 'req-fc81d9fa-3664-4186-acee-115799b4dab0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:53.139516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 842/1708] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:53.140905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd13038-2fcc-4047-8f4c-f960c743fd5c None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:53.141198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd13038-2fcc-4047-8f4c-f960c743fd5c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:53.141545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd13038-2fcc-4047-8f4c-f960c743fd5c None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:53.142840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 843/1709] 10.222.0.27 () {54 vars in 912 bytes} [Thu Aug 4 22:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:25:53.152501 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16243-d533-4d04-8bef-ed9b7beefc62 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:53.153040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16243-d533-4d04-8bef-ed9b7beefc62 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:53.153578 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e16243-d533-4d04-8bef-ed9b7beefc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:53.161944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fc81d9fa-3664-4186-acee-115799b4dab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '785ed2aed2a94fa68175d2504d715329', 'request_id': 'req-fc81d9fa-3664-4186-acee-115799b4dab0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:53.199367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-05e16243-d533-4d04-8bef-ed9b7beefc62 None None] MFA Rules not processed for user `ffee73e2e3d2449ba017f04ed8b511d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:53.200623 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-05e16243-d533-4d04-8bef-ed9b7beefc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:53.208035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fc81d9fa-3664-4186-acee-115799b4dab0 admin admin] The token cache is being invalidate because project 785ed2aed2a94fa68175d2504d715329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:25:53.211749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fc81d9fa-3664-4186-acee-115799b4dab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:53.226195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fc81d9fa-3664-4186-acee-115799b4dab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:53.230770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 867/1710] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:25:52 2022] DELETE /identity/v3/projects/785ed2aed2a94fa68175d2504d715329 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:53.233954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62d26c-9231-40b3-8988-4ee4f0ecdcf4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:53.242994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62d26c-9231-40b3-8988-4ee4f0ecdcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:53.243533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62d26c-9231-40b3-8988-4ee4f0ecdcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:53.307693 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:53.323455 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:53.335314 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 844/1711] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:53.336882 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd1ee-9d6a-4a4d-93be-bd4db5e4fa8b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:53.337319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd1ee-9d6a-4a4d-93be-bd4db5e4fa8b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:53.337710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ff62d26c-9231-40b3-8988-4ee4f0ecdcf4 None None] MFA Rules not processed for user `9ee0de72ba804ba491342a8ae82a44f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:53.337860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd1ee-9d6a-4a4d-93be-bd4db5e4fa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:53.341623 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ff62d26c-9231-40b3-8988-4ee4f0ecdcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:53.376330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-3a8fd1ee-9d6a-4a4d-93be-bd4db5e4fa8b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:53.382318 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3a8fd1ee-9d6a-4a4d-93be-bd4db5e4fa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:53.449219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 868/1712] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:25:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:53.477746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62d26c-9231-40b3-8988-4ee4f0ecdcf4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:53.480158 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ff62d26c-9231-40b3-8988-4ee4f0ecdcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:53.505045 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62d26c-9231-40b3-8988-4ee4f0ecdcf4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:53.512886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c6dd1-decc-47f4-a17a-b6c3c8691a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:53.513750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6dd1-decc-47f4-a17a-b6c3c8691a16 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:53.514197 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6dd1-decc-47f4-a17a-b6c3c8691a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:53.514753 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6dd1-decc-47f4-a17a-b6c3c8691a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:53.532128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c6dd1-decc-47f4-a17a-b6c3c8691a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:53.537468 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c6dd1-decc-47f4-a17a-b6c3c8691a16 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:53.581719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 845/1713] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:53.583654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fe3fd-54e4-4f19-a867-91b59685c9f3 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:53.583953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fe3fd-54e4-4f19-a867-91b59685c9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:53.584234 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fe3fd-54e4-4f19-a867-91b59685c9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:53.593868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 869/1714] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:53.620130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-330fe3fd-54e4-4f19-a867-91b59685c9f3 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:53.621398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-330fe3fd-54e4-4f19-a867-91b59685c9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:53.640457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 846/1715] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:53.641605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c6dd1-decc-47f4-a17a-b6c3c8691a16 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:53.661031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c6dd1-decc-47f4-a17a-b6c3c8691a16 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:53.683663 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b61345-66ba-49e4-845f-260303f51d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:53.684508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b61345-66ba-49e4-845f-260303f51d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:53.684804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b61345-66ba-49e4-845f-260303f51d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:53.685088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b61345-66ba-49e4-845f-260303f51d11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:53.685799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b61345-66ba-49e4-845f-260303f51d11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:25:53.689965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b61345-66ba-49e4-845f-260303f51d11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:53.692302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b61345-66ba-49e4-845f-260303f51d11 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:53.726679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 870/1716] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:25:53.731389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fe3fd-54e4-4f19-a867-91b59685c9f3 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:53.741982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fe3fd-54e4-4f19-a867-91b59685c9f3 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:53.758964 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625c772-97ae-4ead-ba11-c795d1a687cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:53.759619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625c772-97ae-4ead-ba11-c795d1a687cb admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:53.760434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625c772-97ae-4ead-ba11-c795d1a687cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:53.760434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625c772-97ae-4ead-ba11-c795d1a687cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:53.760969 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625c772-97ae-4ead-ba11-c795d1a687cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:53.762951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625c772-97ae-4ead-ba11-c795d1a687cb admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:53.840167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b61345-66ba-49e4-845f-260303f51d11 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:53.840620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 847/1717] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:53 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:53.854781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b61345-66ba-49e4-845f-260303f51d11 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:54.001833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75510fd-a583-4df8-bf1f-ed1eaa981b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:54.002772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75510fd-a583-4df8-bf1f-ed1eaa981b8a admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:54.003215 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75510fd-a583-4df8-bf1f-ed1eaa981b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:54.003634 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75510fd-a583-4df8-bf1f-ed1eaa981b8a admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:54.004546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75510fd-a583-4df8-bf1f-ed1eaa981b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:54.006676 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75510fd-a583-4df8-bf1f-ed1eaa981b8a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:54.053484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 871/1718] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:53 2022] POST /identity/v3/users => generated 285 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:54.057978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625c772-97ae-4ead-ba11-c795d1a687cb admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:54.071115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625c772-97ae-4ead-ba11-c795d1a687cb admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:54.081089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48e977-0da7-429f-b871-dd20c6ff7014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:54.082007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48e977-0da7-429f-b871-dd20c6ff7014 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:54.082469 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48e977-0da7-429f-b871-dd20c6ff7014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:54.083143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48e977-0da7-429f-b871-dd20c6ff7014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:54.085365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48e977-0da7-429f-b871-dd20c6ff7014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:54.090810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48e977-0da7-429f-b871-dd20c6ff7014 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:54.124683 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 848/1719] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:54.125881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75510fd-a583-4df8-bf1f-ed1eaa981b8a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:54.138237 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75510fd-a583-4df8-bf1f-ed1eaa981b8a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:54.148394 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260679b-6359-4210-b9a2-56a27c79a1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:54.149039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260679b-6359-4210-b9a2-56a27c79a1aa admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:54.149337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260679b-6359-4210-b9a2-56a27c79a1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:54.149626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260679b-6359-4210-b9a2-56a27c79a1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:54.153814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48e977-0da7-429f-b871-dd20c6ff7014 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:54.155737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9a48e977-0da7-429f-b871-dd20c6ff7014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:54.164896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260679b-6359-4210-b9a2-56a27c79a1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:54.167822 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260679b-6359-4210-b9a2-56a27c79a1aa admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:54.184128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48e977-0da7-429f-b871-dd20c6ff7014 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:54.191732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:54.192957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:54.193396 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:54.193833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] PATH_INFO: `/v3/projects/90faa56195834da1863b5f3117148176` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:54.195368 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=90faa56195834da1863b5f3117148176)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:54.198853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:54.234551 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 872/1720] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:54.236759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260679b-6359-4210-b9a2-56a27c79a1aa admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:54.244177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5260679b-6359-4210-b9a2-56a27c79a1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:54.277213 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90faa56195834da1863b5f3117148176', 'request_id': 'req-1ea1ece1-caae-44f5-a098-9b507460e6bc'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:54.288375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90faa56195834da1863b5f3117148176', 'request_id': 'req-1ea1ece1-caae-44f5-a098-9b507460e6bc'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:54.298230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90faa56195834da1863b5f3117148176', 'request_id': 'req-1ea1ece1-caae-44f5-a098-9b507460e6bc'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:54.318385 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] The token cache is being invalidate because project 90faa56195834da1863b5f3117148176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:25:54.318970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:54.320033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:54.322482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 849/1721] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:25:54 2022] DELETE /identity/v3/projects/90faa56195834da1863b5f3117148176 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:54.323640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:54.325247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:54.380961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:54.415947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1ece1-caae-44f5-a098-9b507460e6bc admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:54.427204 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64fd14-4645-4978-a92d-5fd92095ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:54.427923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64fd14-4645-4978-a92d-5fd92095ac8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:54.428214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64fd14-4645-4978-a92d-5fd92095ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:54.428497 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64fd14-4645-4978-a92d-5fd92095ac8d admin admin] PATH_INFO: `/v3/projects/baf7a42c3e84478ab8a36c629c7b57dc/users/d2d13eb4fa2b4a5586feae94349b4cf4/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:54.448370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64fd14-4645-4978-a92d-5fd92095ac8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=baf7a42c3e84478ab8a36c629c7b57dc, user_id=d2d13eb4fa2b4a5586feae94349b4cf4, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:54.451317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64fd14-4645-4978-a92d-5fd92095ac8d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:54.498822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 850/1722] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:54 2022] PUT /identity/v3/projects/baf7a42c3e84478ab8a36c629c7b57dc/users/d2d13eb4fa2b4a5586feae94349b4cf4/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:54.500289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64fd14-4645-4978-a92d-5fd92095ac8d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:54.502370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260679b-6359-4210-b9a2-56a27c79a1aa admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:54.510800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ea64fd14-4645-4978-a92d-5fd92095ac8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:54.511623 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:54.705351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64fd14-4645-4978-a92d-5fd92095ac8d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:54.710904 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b20ae-9638-41d2-99f9-d762baaf929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:54.712103 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b20ae-9638-41d2-99f9-d762baaf929a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:54.712396 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b20ae-9638-41d2-99f9-d762baaf929a admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:54.712675 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b20ae-9638-41d2-99f9-d762baaf929a admin admin] PATH_INFO: `/v3/users/0cdab7d29b7a42029bfab23b5dbe7f27` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:54.716512 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b20ae-9638-41d2-99f9-d762baaf929a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cdab7d29b7a42029bfab23b5dbe7f27)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:54.720151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b20ae-9638-41d2-99f9-d762baaf929a admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:54.774093 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054e1fe-7cea-40ed-b288-b7c6e075a3ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:54.778044 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e1fe-7cea-40ed-b288-b7c6e075a3ac service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:54.778554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e1fe-7cea-40ed-b288-b7c6e075a3ac service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:54.778784 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e1fe-7cea-40ed-b288-b7c6e075a3ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:54.789231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a054e1fe-7cea-40ed-b288-b7c6e075a3ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:54.811664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b56b20ae-9638-41d2-99f9-d762baaf929a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cdab7d29b7a42029bfab23b5dbe7f27'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:54.825505 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b56b20ae-9638-41d2-99f9-d762baaf929a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cdab7d29b7a42029bfab23b5dbe7f27'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:54.844019 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b56b20ae-9638-41d2-99f9-d762baaf929a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cdab7d29b7a42029bfab23b5dbe7f27'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:54.844838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b56b20ae-9638-41d2-99f9-d762baaf929a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cdab7d29b7a42029bfab23b5dbe7f27'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:54.879905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b56b20ae-9638-41d2-99f9-d762baaf929a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cdab7d29b7a42029bfab23b5dbe7f27'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:54.897284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 851/1723] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:25:54 2022] DELETE /identity/v3/users/0cdab7d29b7a42029bfab23b5dbe7f27 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:54.897284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330677b-054d-4a68-afed-664bb572479f None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:54.897284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330677b-054d-4a68-afed-664bb572479f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:54.897284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330677b-054d-4a68-afed-664bb572479f None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:54.903052 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 852/1724] 10.222.0.27 () {54 vars in 961 bytes} [Thu Aug 4 22:25:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:25:54.909722 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1eef3-f414-4931-8dde-0fa3d7c91d96 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:54.910022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1eef3-f414-4931-8dde-0fa3d7c91d96 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:54.910308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1eef3-f414-4931-8dde-0fa3d7c91d96 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:54.911782 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 853/1725] 10.222.0.27 () {54 vars in 912 bytes} [Thu Aug 4 22:25:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:25:54.912941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7697c4-814f-4aa2-892d-ff659448bc8d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:54.913231 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7697c4-814f-4aa2-892d-ff659448bc8d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:54.913516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7697c4-814f-4aa2-892d-ff659448bc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:54.994291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054e1fe-7cea-40ed-b288-b7c6e075a3ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:55.000548 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054e1fe-7cea-40ed-b288-b7c6e075a3ac service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:55.024209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 873/1726] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:55.029525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86922987-262e-4605-ae0b-44c65db147ce None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:55.031899 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86922987-262e-4605-ae0b-44c65db147ce None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:55.032557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86922987-262e-4605-ae0b-44c65db147ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:55.035315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5f7697c4-814f-4aa2-892d-ff659448bc8d None None] MFA Rules not processed for user `d2d13eb4fa2b4a5586feae94349b4cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:55.043853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5f7697c4-814f-4aa2-892d-ff659448bc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:55.103622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-86922987-262e-4605-ae0b-44c65db147ce None None] MFA Rules not processed for user `94b2448489cc4ad1a6fd3096ebd3f746`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:55.113181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-86922987-262e-4605-ae0b-44c65db147ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:55.152971 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:55.308436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 854/1727] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:55.312572 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f93cf-68fb-4f41-9e83-aa3e69919c54 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:55.315784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f93cf-68fb-4f41-9e83-aa3e69919c54 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:55.319289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f93cf-68fb-4f41-9e83-aa3e69919c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:55.392179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 874/1728] 10.222.0.27 () {58 vars in 1058 bytes} [Thu Aug 4 22:25:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:55.393421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-021f93cf-68fb-4f41-9e83-aa3e69919c54 None None] MFA Rules not processed for user `9ee0de72ba804ba491342a8ae82a44f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:55.395279 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86922987-262e-4605-ae0b-44c65db147ce None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:55.396076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-021f93cf-68fb-4f41-9e83-aa3e69919c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:55.398718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-86922987-262e-4605-ae0b-44c65db147ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:55.604871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:55.613635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 855/1729] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:25:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:55.616956 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f93cf-68fb-4f41-9e83-aa3e69919c54 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:55.651923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f93cf-68fb-4f41-9e83-aa3e69919c54 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:55.657678 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86922987-262e-4605-ae0b-44c65db147ce None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:55.664268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2fc7d-1297-489a-bed8-63cb6809a930 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2448489cc4ad1a6fd3096ebd3f746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:55.664918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2fc7d-1297-489a-bed8-63cb6809a930 service placement] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:55.665205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2fc7d-1297-489a-bed8-63cb6809a930 service placement] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:55.665484 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2fc7d-1297-489a-bed8-63cb6809a930 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:55.668106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44698a0a-a25c-465f-94f5-4c6a6d581446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:55.668768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44698a0a-a25c-465f-94f5-4c6a6d581446 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:55.669033 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44698a0a-a25c-465f-94f5-4c6a6d581446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:55.669673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44698a0a-a25c-465f-94f5-4c6a6d581446 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:55.670637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-63d2fc7d-1297-489a-bed8-63cb6809a930 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:55.672701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44698a0a-a25c-465f-94f5-4c6a6d581446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:55.677313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44698a0a-a25c-465f-94f5-4c6a6d581446 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:55.711039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2fc7d-1297-489a-bed8-63cb6809a930 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:55.718594 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2fc7d-1297-489a-bed8-63cb6809a930 service placement] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:55.756384 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 856/1730] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:55.768661 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 875/1731] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:55 2022] POST /identity/v3/projects => generated 371 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:55.773248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2fc7d-1297-489a-bed8-63cb6809a930 service placement] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:55.788813 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2fc7d-1297-489a-bed8-63cb6809a930 service placement] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:55.970217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769d4d3-9a25-40ca-a271-38d84656a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:55.970895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769d4d3-9a25-40ca-a271-38d84656a442 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:55.971185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769d4d3-9a25-40ca-a271-38d84656a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:55.971464 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769d4d3-9a25-40ca-a271-38d84656a442 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:55.972151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769d4d3-9a25-40ca-a271-38d84656a442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:55.976002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769d4d3-9a25-40ca-a271-38d84656a442 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:55.995018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44698a0a-a25c-465f-94f5-4c6a6d581446 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:55.996776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-44698a0a-a25c-465f-94f5-4c6a6d581446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:56.073076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 857/1732] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:55 2022] POST /identity/v3/users => generated 292 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:56.073990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769d4d3-9a25-40ca-a271-38d84656a442 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:56.144075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769d4d3-9a25-40ca-a271-38d84656a442 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:56.159893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6f4ce-8671-4ac4-bf34-92581ae3eca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:56.160541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6f4ce-8671-4ac4-bf34-92581ae3eca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:56.163352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6f4ce-8671-4ac4-bf34-92581ae3eca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:56.164541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6f4ce-8671-4ac4-bf34-92581ae3eca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:56.168272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6f4ce-8671-4ac4-bf34-92581ae3eca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:56.170383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6f4ce-8671-4ac4-bf34-92581ae3eca3 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:56.203542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 858/1733] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:56.211189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6f4ce-8671-4ac4-bf34-92581ae3eca3 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:56.227635 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44698a0a-a25c-465f-94f5-4c6a6d581446 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:56.235921 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6f4ce-8671-4ac4-bf34-92581ae3eca3 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:56.247245 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4aee1-352c-4c3b-aea3-3c72bd4ea351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:56.247909 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4aee1-352c-4c3b-aea3-3c72bd4ea351 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:56.248198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4aee1-352c-4c3b-aea3-3c72bd4ea351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:56.248490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4aee1-352c-4c3b-aea3-3c72bd4ea351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:56.256360 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d515b-3d31-4c19-92e4-3e9276926d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:56.259530 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d515b-3d31-4c19-92e4-3e9276926d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:56.260403 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d515b-3d31-4c19-92e4-3e9276926d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:56.261065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d515b-3d31-4c19-92e4-3e9276926d77 admin admin] PATH_INFO: `/v3/projects/c31d5e9d774a4f12b0679b06fec712c8/users/7897a4d080534a5eb750653fe2230a3d/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:56.279872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4aee1-352c-4c3b-aea3-3c72bd4ea351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:56.281335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4aee1-352c-4c3b-aea3-3c72bd4ea351 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:56.311391 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d515b-3d31-4c19-92e4-3e9276926d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31d5e9d774a4f12b0679b06fec712c8, user_id=7897a4d080534a5eb750653fe2230a3d, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:56.314183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d515b-3d31-4c19-92e4-3e9276926d77 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:56.329839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 876/1734] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:25:56.331368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dc3f3-3ac7-4f1d-88da-cd08a4f0b8ce None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:56.334603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dc3f3-3ac7-4f1d-88da-cd08a4f0b8ce None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:56.334911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dc3f3-3ac7-4f1d-88da-cd08a4f0b8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:56.363173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 859/1735] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:56 2022] PUT /identity/v3/projects/c31d5e9d774a4f12b0679b06fec712c8/users/7897a4d080534a5eb750653fe2230a3d/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:56.367930 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d515b-3d31-4c19-92e4-3e9276926d77 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:56.404285 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:56.450378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2d1dc3f3-3ac7-4f1d-88da-cd08a4f0b8ce None None] MFA Rules not processed for user `951b36037e3a413ba8e43487fce4f651`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:56.452213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2d1dc3f3-3ac7-4f1d-88da-cd08a4f0b8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:56.504262 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d515b-3d31-4c19-92e4-3e9276926d77 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:56.513472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6437d-bd70-4e38-803c-9da3abe68570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:56.514290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6437d-bd70-4e38-803c-9da3abe68570 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:56.514579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6437d-bd70-4e38-803c-9da3abe68570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:56.514936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6437d-bd70-4e38-803c-9da3abe68570 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:56.515801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6437d-bd70-4e38-803c-9da3abe68570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:56.517736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6437d-bd70-4e38-803c-9da3abe68570 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:56.544020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 860/1736] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:25:56.545374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6437d-bd70-4e38-803c-9da3abe68570 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:56.578949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6437d-bd70-4e38-803c-9da3abe68570 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:56.595778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85865de-985d-4c22-b46c-bfbc91aca774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:56.596864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85865de-985d-4c22-b46c-bfbc91aca774 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:56.597238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85865de-985d-4c22-b46c-bfbc91aca774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:56.597617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85865de-985d-4c22-b46c-bfbc91aca774 admin admin] PATH_INFO: `/v3/projects/c31d5e9d774a4f12b0679b06fec712c8/users/7897a4d080534a5eb750653fe2230a3d/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:56.602631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85865de-985d-4c22-b46c-bfbc91aca774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31d5e9d774a4f12b0679b06fec712c8, user_id=7897a4d080534a5eb750653fe2230a3d, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:56.607551 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85865de-985d-4c22-b46c-bfbc91aca774 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:56.642266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 861/1737] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:56 2022] PUT /identity/v3/projects/c31d5e9d774a4f12b0679b06fec712c8/users/7897a4d080534a5eb750653fe2230a3d/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:56.654367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dd2ba-55b3-4d53-9285-d35f43599792 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:56.654686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dd2ba-55b3-4d53-9285-d35f43599792 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:56.654976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dd2ba-55b3-4d53-9285-d35f43599792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:56.677119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 877/1738] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:56.757153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-499dd2ba-55b3-4d53-9285-d35f43599792 None None] MFA Rules not processed for user `7897a4d080534a5eb750653fe2230a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:56.758438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-499dd2ba-55b3-4d53-9285-d35f43599792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:56.878641 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dc3f3-3ac7-4f1d-88da-cd08a4f0b8ce None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:56.888411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2d1dc3f3-3ac7-4f1d-88da-cd08a4f0b8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:56.951491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dc3f3-3ac7-4f1d-88da-cd08a4f0b8ce None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:57.002667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 862/1739] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:25:57.019968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dd2ba-55b3-4d53-9285-d35f43599792 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:57.023917 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-499dd2ba-55b3-4d53-9285-d35f43599792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:57.117112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:57.141100 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb03c2d-7a89-4197-9140-2c7e96bff98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:57.142025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb03c2d-7a89-4197-9140-2c7e96bff98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:57.142520 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb03c2d-7a89-4197-9140-2c7e96bff98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:57.142985 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb03c2d-7a89-4197-9140-2c7e96bff98d admin admin] PATH_INFO: `/v3/projects/e7867cf156da4e90a023d83692f8bb5e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:57.145625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb03c2d-7a89-4197-9140-2c7e96bff98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7867cf156da4e90a023d83692f8bb5e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:57.150773 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb03c2d-7a89-4197-9140-2c7e96bff98d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:57.217294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dd2ba-55b3-4d53-9285-d35f43599792 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:57.235285 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5719a-fe4c-4d9c-837c-c1afc3729f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:57.236977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5719a-fe4c-4d9c-837c-c1afc3729f96 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:57.238902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5719a-fe4c-4d9c-837c-c1afc3729f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:57.247072 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5719a-fe4c-4d9c-837c-c1afc3729f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:57.284374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5719a-fe4c-4d9c-837c-c1afc3729f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:57.285987 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5719a-fe4c-4d9c-837c-c1afc3729f96 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:57.301831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0fb03c2d-7a89-4197-9140-2c7e96bff98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7867cf156da4e90a023d83692f8bb5e', 'request_id': 'req-0fb03c2d-7a89-4197-9140-2c7e96bff98d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:57.320189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0fb03c2d-7a89-4197-9140-2c7e96bff98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7867cf156da4e90a023d83692f8bb5e', 'request_id': 'req-0fb03c2d-7a89-4197-9140-2c7e96bff98d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:57.346993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0fb03c2d-7a89-4197-9140-2c7e96bff98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7867cf156da4e90a023d83692f8bb5e', 'request_id': 'req-0fb03c2d-7a89-4197-9140-2c7e96bff98d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:57.357911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 863/1740] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:57.362789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5719a-fe4c-4d9c-837c-c1afc3729f96 service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:57.363191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0fb03c2d-7a89-4197-9140-2c7e96bff98d admin admin] The token cache is being invalidate because project e7867cf156da4e90a023d83692f8bb5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:25:57.374508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0fb03c2d-7a89-4197-9140-2c7e96bff98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:57.375268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0fb03c2d-7a89-4197-9140-2c7e96bff98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:57.377228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 878/1741] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:25:56 2022] DELETE /identity/v3/projects/e7867cf156da4e90a023d83692f8bb5e => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:25:57.381417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d4d5719a-fe4c-4d9c-837c-c1afc3729f96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:57.383203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3c026-8669-41c9-aae6-cc7a81ab3f55 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:57.386305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3c026-8669-41c9-aae6-cc7a81ab3f55 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:57.386868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3c026-8669-41c9-aae6-cc7a81ab3f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:57.437892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4ab3c026-8669-41c9-aae6-cc7a81ab3f55 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:57.439933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4ab3c026-8669-41c9-aae6-cc7a81ab3f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:57.462112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5719a-fe4c-4d9c-837c-c1afc3729f96 service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:57.601810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:57.656005 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 879/1742] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:57.656898 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3c026-8669-41c9-aae6-cc7a81ab3f55 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:57.658285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4ab3c026-8669-41c9-aae6-cc7a81ab3f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:57.684826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be449ee-a32f-4c77-ae1d-55b11600913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:57.685431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be449ee-a32f-4c77-ae1d-55b11600913f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:57.685715 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be449ee-a32f-4c77-ae1d-55b11600913f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:57.685993 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be449ee-a32f-4c77-ae1d-55b11600913f admin admin] PATH_INFO: `/v3/users/06ba43a0507a4b70a04cdfaf9867f32f` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:57.688518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be449ee-a32f-4c77-ae1d-55b11600913f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ba43a0507a4b70a04cdfaf9867f32f)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:57.695690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be449ee-a32f-4c77-ae1d-55b11600913f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:57.839477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9be449ee-a32f-4c77-ae1d-55b11600913f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ba43a0507a4b70a04cdfaf9867f32f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:57.841392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3c026-8669-41c9-aae6-cc7a81ab3f55 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:57.848167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07d240-83e6-4a99-9558-3449ff9b8272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:57.849291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07d240-83e6-4a99-9558-3449ff9b8272 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:57.849701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07d240-83e6-4a99-9558-3449ff9b8272 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:57.849897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07d240-83e6-4a99-9558-3449ff9b8272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:57.860695 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ac07d240-83e6-4a99-9558-3449ff9b8272 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:57.863977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9be449ee-a32f-4c77-ae1d-55b11600913f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ba43a0507a4b70a04cdfaf9867f32f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:57.876626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9be449ee-a32f-4c77-ae1d-55b11600913f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ba43a0507a4b70a04cdfaf9867f32f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:57.878043 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9be449ee-a32f-4c77-ae1d-55b11600913f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ba43a0507a4b70a04cdfaf9867f32f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:57.943119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9be449ee-a32f-4c77-ae1d-55b11600913f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ba43a0507a4b70a04cdfaf9867f32f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:57.965628 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 864/1743] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:25:57 2022] DELETE /identity/v3/users/06ba43a0507a4b70a04cdfaf9867f32f => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:57.968950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be449ee-a32f-4c77-ae1d-55b11600913f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:57.974669 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9be449ee-a32f-4c77-ae1d-55b11600913f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:58.061441 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:58.141854 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07d240-83e6-4a99-9558-3449ff9b8272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:58.144457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07d240-83e6-4a99-9558-3449ff9b8272 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:58.200527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 880/1744] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:58.203561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae594a-52f1-46fa-adc7-2f62922fec53 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:58.203863 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae594a-52f1-46fa-adc7-2f62922fec53 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:58.204143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae594a-52f1-46fa-adc7-2f62922fec53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:58.238062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be449ee-a32f-4c77-ae1d-55b11600913f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:58.255506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-fdae594a-52f1-46fa-adc7-2f62922fec53 None None] MFA Rules not processed for user `ad5781045de04647bd213028d7209fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:58.257456 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fdae594a-52f1-46fa-adc7-2f62922fec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:58.260252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d39230-5dad-4c92-9785-98b1e55712d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:58.260999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d39230-5dad-4c92-9785-98b1e55712d6 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:58.261287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d39230-5dad-4c92-9785-98b1e55712d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:58.261566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d39230-5dad-4c92-9785-98b1e55712d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:58.267456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-42d39230-5dad-4c92-9785-98b1e55712d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:58.461918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:58.484820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d39230-5dad-4c92-9785-98b1e55712d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:58.486520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d39230-5dad-4c92-9785-98b1e55712d6 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:58.509056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 865/1745] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:58.512020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa2ec9-aee2-45b6-8c26-207ec51d6043 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:58.512465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa2ec9-aee2-45b6-8c26-207ec51d6043 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:58.513020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa2ec9-aee2-45b6-8c26-207ec51d6043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:58.545833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5afa2ec9-aee2-45b6-8c26-207ec51d6043 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:58.547662 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5afa2ec9-aee2-45b6-8c26-207ec51d6043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:58.629210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 881/1746] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:58.640436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f27fc9-5561-4e8f-ad7d-71c2727512da None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:58.641458 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f27fc9-5561-4e8f-ad7d-71c2727512da None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:58.641743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f27fc9-5561-4e8f-ad7d-71c2727512da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:58.737467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-51f27fc9-5561-4e8f-ad7d-71c2727512da None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:58.739621 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-51f27fc9-5561-4e8f-ad7d-71c2727512da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:58.950199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 866/1747] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:58.953900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa2ec9-aee2-45b6-8c26-207ec51d6043 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:58.982761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa2ec9-aee2-45b6-8c26-207ec51d6043 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:58.995580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 882/1748] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:25:59.001676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8126c-aa21-4269-83a4-bde111704f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:59.003521 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8126c-aa21-4269-83a4-bde111704f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:59.005375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8126c-aa21-4269-83a4-bde111704f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:59.006704 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8126c-aa21-4269-83a4-bde111704f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:59.008410 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8126c-aa21-4269-83a4-bde111704f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:25:59.013642 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8126c-aa21-4269-83a4-bde111704f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:59.016866 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8126c-aa21-4269-83a4-bde111704f51 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:59.073710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f27fc9-5561-4e8f-ad7d-71c2727512da None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:59.077447 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-51f27fc9-5561-4e8f-ad7d-71c2727512da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:59.081285 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 867/1749] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:25:59.085225 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8126c-aa21-4269-83a4-bde111704f51 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:59.118067 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8126c-aa21-4269-83a4-bde111704f51 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:59.135434 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d9838-bd53-46ab-8bc6-5be968e255a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:59.136099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d9838-bd53-46ab-8bc6-5be968e255a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:59.138083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d9838-bd53-46ab-8bc6-5be968e255a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:59.138083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d9838-bd53-46ab-8bc6-5be968e255a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:59.144986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d9838-bd53-46ab-8bc6-5be968e255a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:59.150756 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d9838-bd53-46ab-8bc6-5be968e255a1 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:59.242737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 868/1750] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:25:59 2022] POST /identity/v3/projects => generated 363 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:59.247884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d9838-bd53-46ab-8bc6-5be968e255a1 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:59.330572 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f27fc9-5561-4e8f-ad7d-71c2727512da None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:59.476519 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:59.507670 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d9838-bd53-46ab-8bc6-5be968e255a1 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:59.518133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bd72f-fadf-484d-89cd-7d75b9899256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:59.518811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bd72f-fadf-484d-89cd-7d75b9899256 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:59.519124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bd72f-fadf-484d-89cd-7d75b9899256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:59.519368 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bd72f-fadf-484d-89cd-7d75b9899256 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:59.520050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bd72f-fadf-484d-89cd-7d75b9899256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:59.521999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bd72f-fadf-484d-89cd-7d75b9899256 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:59.546030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d55f0f-2158-498d-84a4-a6a7dece4b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:59.547195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d55f0f-2158-498d-84a4-a6a7dece4b88 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:59.547585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d55f0f-2158-498d-84a4-a6a7dece4b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:59.548084 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d55f0f-2158-498d-84a4-a6a7dece4b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:59.571396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d55f0f-2158-498d-84a4-a6a7dece4b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:59.573882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d55f0f-2158-498d-84a4-a6a7dece4b88 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:59.578287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 869/1751] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:25:59 2022] POST /identity/v3/users => generated 282 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:25:59.579865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bd72f-fadf-484d-89cd-7d75b9899256 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:59.581859 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-959bd72f-fadf-484d-89cd-7d75b9899256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:25:59.603452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 883/1752] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:25:59.603452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d55f0f-2158-498d-84a4-a6a7dece4b88 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:59.621173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bd72f-fadf-484d-89cd-7d75b9899256 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:59.631163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1936d-c77c-4dee-a0c2-a5de886b9c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:59.632052 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1936d-c77c-4dee-a0c2-a5de886b9c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:59.634745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1936d-c77c-4dee-a0c2-a5de886b9c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:59.635698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1936d-c77c-4dee-a0c2-a5de886b9c56 admin admin] PATH_INFO: `/v3/users/337f7ac0f93a43f3a15f57798f0b8a09` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:59.638293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1936d-c77c-4dee-a0c2-a5de886b9c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=337f7ac0f93a43f3a15f57798f0b8a09)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:59.641008 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1936d-c77c-4dee-a0c2-a5de886b9c56 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:59.649557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d55f0f-2158-498d-84a4-a6a7dece4b88 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:59.662580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8293703-75dc-40c1-a568-a982bde53759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:59.663479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8293703-75dc-40c1-a568-a982bde53759 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:59.665236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8293703-75dc-40c1-a568-a982bde53759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:59.665236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8293703-75dc-40c1-a568-a982bde53759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:59.679839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8293703-75dc-40c1-a568-a982bde53759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:59.685333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8293703-75dc-40c1-a568-a982bde53759 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:59.705105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 884/1753] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:59.710369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8293703-75dc-40c1-a568-a982bde53759 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:59.731924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:25:59.758038 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8293703-75dc-40c1-a568-a982bde53759 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:59.767531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3aa1936d-c77c-4dee-a0c2-a5de886b9c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337f7ac0f93a43f3a15f57798f0b8a09'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:59.780244 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd1a61-0402-4bd5-94e0-da406bd8601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:25:59.780919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd1a61-0402-4bd5-94e0-da406bd8601d admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:59.781290 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd1a61-0402-4bd5-94e0-da406bd8601d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:59.784320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd1a61-0402-4bd5-94e0-da406bd8601d admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:59.786895 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd1a61-0402-4bd5-94e0-da406bd8601d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:25:59.793284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd1a61-0402-4bd5-94e0-da406bd8601d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:25:59.796204 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3aa1936d-c77c-4dee-a0c2-a5de886b9c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337f7ac0f93a43f3a15f57798f0b8a09'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:59.812713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3aa1936d-c77c-4dee-a0c2-a5de886b9c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337f7ac0f93a43f3a15f57798f0b8a09'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:59.815092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3aa1936d-c77c-4dee-a0c2-a5de886b9c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337f7ac0f93a43f3a15f57798f0b8a09'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:59.843156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 885/1754] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:25:59.844740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd1a61-0402-4bd5-94e0-da406bd8601d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:25:59.845415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3aa1936d-c77c-4dee-a0c2-a5de886b9c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337f7ac0f93a43f3a15f57798f0b8a09'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:25:59.862162 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 870/1755] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:25:59 2022] DELETE /identity/v3/users/337f7ac0f93a43f3a15f57798f0b8a09 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:25:59.869986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11e12-f7f5-44ac-b908-cc3d265e2d38 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:25:59.870371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11e12-f7f5-44ac-b908-cc3d265e2d38 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:25:59.871332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11e12-f7f5-44ac-b908-cc3d265e2d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:25:59.891264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd1a61-0402-4bd5-94e0-da406bd8601d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:25:59.917058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6bc11e12-f7f5-44ac-b908-cc3d265e2d38 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:25:59.919588 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6bc11e12-f7f5-44ac-b908-cc3d265e2d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:00.061339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86aaa2-22a6-4bed-aeaa-a9e41c8f4b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:00.062126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86aaa2-22a6-4bed-aeaa-a9e41c8f4b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:00.062437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86aaa2-22a6-4bed-aeaa-a9e41c8f4b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:00.063044 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86aaa2-22a6-4bed-aeaa-a9e41c8f4b5e admin admin] PATH_INFO: `/v3/projects/7432b2e7062141c597b31eacf986aad3/users/34eeced51061413191b59f5b088e0e27/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:00.098089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86aaa2-22a6-4bed-aeaa-a9e41c8f4b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7432b2e7062141c597b31eacf986aad3, user_id=34eeced51061413191b59f5b088e0e27, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:00.108962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86aaa2-22a6-4bed-aeaa-a9e41c8f4b5e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:00.143307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 886/1756] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:25:59 2022] PUT /identity/v3/projects/7432b2e7062141c597b31eacf986aad3/users/34eeced51061413191b59f5b088e0e27/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:00.153761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469af28-1a57-4917-a023-5d20c5f95fea None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:00.154125 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469af28-1a57-4917-a023-5d20c5f95fea None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:00.154461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469af28-1a57-4917-a023-5d20c5f95fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:00.169140 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 871/1757] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:00.216313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc11e12-f7f5-44ac-b908-cc3d265e2d38 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:00.218583 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6bc11e12-f7f5-44ac-b908-cc3d265e2d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:00.226230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4469af28-1a57-4917-a023-5d20c5f95fea None None] MFA Rules not processed for user `34eeced51061413191b59f5b088e0e27`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:00.228464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4469af28-1a57-4917-a023-5d20c5f95fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:00.426744 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc11e12-f7f5-44ac-b908-cc3d265e2d38 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:00.507372 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 887/1758] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:00.513615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469af28-1a57-4917-a023-5d20c5f95fea None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:00.515811 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4469af28-1a57-4917-a023-5d20c5f95fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:00.581853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cd486-a090-43a1-81f7-fdc394c4aa7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:00.582977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cd486-a090-43a1-81f7-fdc394c4aa7e service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:00.585246 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cd486-a090-43a1-81f7-fdc394c4aa7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:00.585429 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cd486-a090-43a1-81f7-fdc394c4aa7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:00.619887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:00.636032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:00.719508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469af28-1a57-4917-a023-5d20c5f95fea None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:00.733433 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502130d-eaff-479a-83b6-0c2cc96db02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:00.734219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502130d-eaff-479a-83b6-0c2cc96db02b admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:00.734634 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502130d-eaff-479a-83b6-0c2cc96db02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:00.735014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502130d-eaff-479a-83b6-0c2cc96db02b admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:00.736618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502130d-eaff-479a-83b6-0c2cc96db02b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:00.738881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502130d-eaff-479a-83b6-0c2cc96db02b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:00.769776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cd486-a090-43a1-81f7-fdc394c4aa7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:00.774130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cd486-a090-43a1-81f7-fdc394c4aa7e service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:00.837325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 888/1759] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:00 2022] POST /identity/v3/projects => generated 365 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:00.838250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 872/1760] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:00.838933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502130d-eaff-479a-83b6-0c2cc96db02b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:00.996513 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502130d-eaff-479a-83b6-0c2cc96db02b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:01.009884 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822015e4-6d2e-463b-b782-b54188e3dbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:01.010844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822015e4-6d2e-463b-b782-b54188e3dbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:01.011305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822015e4-6d2e-463b-b782-b54188e3dbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:01.011701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822015e4-6d2e-463b-b782-b54188e3dbc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:01.012555 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822015e4-6d2e-463b-b782-b54188e3dbc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:01.015049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822015e4-6d2e-463b-b782-b54188e3dbc2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:01.070160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 889/1761] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:00 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:01.074700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cd486-a090-43a1-81f7-fdc394c4aa7e service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:01.090684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cd486-a090-43a1-81f7-fdc394c4aa7e service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:01.098701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8b5eb-96f5-43ee-bdb3-de5939d2aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:01.099665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8b5eb-96f5-43ee-bdb3-de5939d2aa91 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:01.100013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8b5eb-96f5-43ee-bdb3-de5939d2aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:01.100386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8b5eb-96f5-43ee-bdb3-de5939d2aa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:01.101205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8b5eb-96f5-43ee-bdb3-de5939d2aa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:01.103067 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8b5eb-96f5-43ee-bdb3-de5939d2aa91 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:01.152595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822015e4-6d2e-463b-b782-b54188e3dbc2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:01.164809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 873/1762] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:01.167469 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822015e4-6d2e-463b-b782-b54188e3dbc2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:01.181207 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45503495-75f3-42d6-aaec-0baeb08dbcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:01.182579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45503495-75f3-42d6-aaec-0baeb08dbcf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:01.183016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45503495-75f3-42d6-aaec-0baeb08dbcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:01.183535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45503495-75f3-42d6-aaec-0baeb08dbcf5 admin admin] PATH_INFO: `/v3/projects/b9f5ad327f3b4cf3a759d384c11685eb/users/d6bcfdfded7d47fc886198418ae77a53/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:01.205786 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45503495-75f3-42d6-aaec-0baeb08dbcf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f5ad327f3b4cf3a759d384c11685eb, user_id=d6bcfdfded7d47fc886198418ae77a53, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:01.209371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45503495-75f3-42d6-aaec-0baeb08dbcf5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:01.237832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8b5eb-96f5-43ee-bdb3-de5939d2aa91 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:01.245589 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 890/1763] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:01 2022] PUT /identity/v3/projects/b9f5ad327f3b4cf3a759d384c11685eb/users/d6bcfdfded7d47fc886198418ae77a53/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:01.254426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8b5eb-96f5-43ee-bdb3-de5939d2aa91 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:01.393444 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34df7b2-7ddc-4bf2-9097-5958cd9794c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:01.394321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34df7b2-7ddc-4bf2-9097-5958cd9794c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:01.394764 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34df7b2-7ddc-4bf2-9097-5958cd9794c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:01.395150 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34df7b2-7ddc-4bf2-9097-5958cd9794c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:01.396215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34df7b2-7ddc-4bf2-9097-5958cd9794c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:01.401262 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34df7b2-7ddc-4bf2-9097-5958cd9794c2 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:01.426736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 874/1764] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:01.431397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45503495-75f3-42d6-aaec-0baeb08dbcf5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:01.448427 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45503495-75f3-42d6-aaec-0baeb08dbcf5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:01.462729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd084668-0b2c-448f-bfdd-afc42a810109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:01.463495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd084668-0b2c-448f-bfdd-afc42a810109 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:01.463783 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd084668-0b2c-448f-bfdd-afc42a810109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:01.464054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd084668-0b2c-448f-bfdd-afc42a810109 admin admin] PATH_INFO: `/v3/projects/b9f5ad327f3b4cf3a759d384c11685eb/users/d6bcfdfded7d47fc886198418ae77a53/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:01.476414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd084668-0b2c-448f-bfdd-afc42a810109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f5ad327f3b4cf3a759d384c11685eb, user_id=d6bcfdfded7d47fc886198418ae77a53, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:01.484024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd084668-0b2c-448f-bfdd-afc42a810109 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:01.520850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 891/1765] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:01 2022] PUT /identity/v3/projects/b9f5ad327f3b4cf3a759d384c11685eb/users/d6bcfdfded7d47fc886198418ae77a53/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:01.526170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a21dc0-6b0f-4428-9b24-2b089e043585 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:01.527018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a21dc0-6b0f-4428-9b24-2b089e043585 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:01.527018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a21dc0-6b0f-4428-9b24-2b089e043585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:01.567522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a5a21dc0-6b0f-4428-9b24-2b089e043585 None None] MFA Rules not processed for user `d6bcfdfded7d47fc886198418ae77a53`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:01.568672 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a5a21dc0-6b0f-4428-9b24-2b089e043585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:01.691914 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 875/1766] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:01.705881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd084668-0b2c-448f-bfdd-afc42a810109 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:01.710842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dd084668-0b2c-448f-bfdd-afc42a810109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:01.855052 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d53ed-d2fc-4aff-9f68-81f4a5d0a042 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:01.855052 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d53ed-d2fc-4aff-9f68-81f4a5d0a042 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:01.855052 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d53ed-d2fc-4aff-9f68-81f4a5d0a042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:01.986945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd084668-0b2c-448f-bfdd-afc42a810109 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:02.016224 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8987d-8dcc-44c2-8240-59028d6ab2ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:02.016884 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8987d-8dcc-44c2-8240-59028d6ab2ab service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:02.017177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8987d-8dcc-44c2-8240-59028d6ab2ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:02.017463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8987d-8dcc-44c2-8240-59028d6ab2ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:02.055075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:02.079396 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b50d53ed-d2fc-4aff-9f68-81f4a5d0a042 None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:02.087400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b50d53ed-d2fc-4aff-9f68-81f4a5d0a042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:02.100290 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8987d-8dcc-44c2-8240-59028d6ab2ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:02.124374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8987d-8dcc-44c2-8240-59028d6ab2ab service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:02.172446 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 892/1767] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:02.245090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8987d-8dcc-44c2-8240-59028d6ab2ab service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:02.249191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cef8987d-8dcc-44c2-8240-59028d6ab2ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:02.307751 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:02.316413 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 876/1768] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:26:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 04 22:26:02.381362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d53ed-d2fc-4aff-9f68-81f4a5d0a042 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:02.394461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d53ed-d2fc-4aff-9f68-81f4a5d0a042 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:02.408143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f49bf6-5f96-486f-8914-a34734b7cffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:02.408797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f49bf6-5f96-486f-8914-a34734b7cffa service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:02.412418 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f49bf6-5f96-486f-8914-a34734b7cffa service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:02.413864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f49bf6-5f96-486f-8914-a34734b7cffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:02.544745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8987d-8dcc-44c2-8240-59028d6ab2ab service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:02.570826 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:02.571959 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:02.572526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:02.573117 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] PATH_INFO: `/v3/projects/b6161a2ea89b4f82a2f5760d0cbd139d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:02.587268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6161a2ea89b4f82a2f5760d0cbd139d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:02.597795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:02.628066 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f49bf6-5f96-486f-8914-a34734b7cffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:02.629554 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f49bf6-5f96-486f-8914-a34734b7cffa service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:02.663580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 877/1769] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:26:02.686088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f49bf6-5f96-486f-8914-a34734b7cffa service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:02.687972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b9f49bf6-5f96-486f-8914-a34734b7cffa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:02.866118 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6161a2ea89b4f82a2f5760d0cbd139d', 'request_id': 'req-68a80631-43ed-4e3f-937b-39c15db89e5d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:02.888732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6161a2ea89b4f82a2f5760d0cbd139d', 'request_id': 'req-68a80631-43ed-4e3f-937b-39c15db89e5d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:02.914987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6161a2ea89b4f82a2f5760d0cbd139d', 'request_id': 'req-68a80631-43ed-4e3f-937b-39c15db89e5d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:02.947968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f49bf6-5f96-486f-8914-a34734b7cffa service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:02.951077 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] The token cache is being invalidate because project b6161a2ea89b4f82a2f5760d0cbd139d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:02.951626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:02.960240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:02.968566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 893/1770] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:02 2022] DELETE /identity/v3/projects/b6161a2ea89b4f82a2f5760d0cbd139d => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:02.972379 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:02.976880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:03.011478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:03.153389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b694f4f-34e6-4e41-9e5c-c0873c1b44fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:03.154048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b694f4f-34e6-4e41-9e5c-c0873c1b44fc service swift] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:03.158761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b694f4f-34e6-4e41-9e5c-c0873c1b44fc service swift] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:03.159071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b694f4f-34e6-4e41-9e5c-c0873c1b44fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:03.169100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3b694f4f-34e6-4e41-9e5c-c0873c1b44fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:03.203105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a80631-43ed-4e3f-937b-39c15db89e5d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:03.209792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def3379-c2df-43c4-9661-c5ddddf6fcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:03.211083 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def3379-c2df-43c4-9661-c5ddddf6fcf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:03.211083 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def3379-c2df-43c4-9661-c5ddddf6fcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:03.211289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def3379-c2df-43c4-9661-c5ddddf6fcf9 admin admin] PATH_INFO: `/v3/users/df97e0ef8b3e460f80bb36a870d12352` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:03.212481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def3379-c2df-43c4-9661-c5ddddf6fcf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df97e0ef8b3e460f80bb36a870d12352)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:03.214891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def3379-c2df-43c4-9661-c5ddddf6fcf9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:03.358779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b694f4f-34e6-4e41-9e5c-c0873c1b44fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:03.360644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b694f4f-34e6-4e41-9e5c-c0873c1b44fc service swift] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:03.368094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8def3379-c2df-43c4-9661-c5ddddf6fcf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df97e0ef8b3e460f80bb36a870d12352'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:03.372729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:03.375830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 878/1771] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:26:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:26:03.397926 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8def3379-c2df-43c4-9661-c5ddddf6fcf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df97e0ef8b3e460f80bb36a870d12352'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:03.498576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8def3379-c2df-43c4-9661-c5ddddf6fcf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df97e0ef8b3e460f80bb36a870d12352'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:03.500298 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8def3379-c2df-43c4-9661-c5ddddf6fcf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df97e0ef8b3e460f80bb36a870d12352'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:03.535603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8def3379-c2df-43c4-9661-c5ddddf6fcf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df97e0ef8b3e460f80bb36a870d12352'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:03.566091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 894/1772] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:02 2022] DELETE /identity/v3/users/df97e0ef8b3e460f80bb36a870d12352 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:03.763323 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b694f4f-34e6-4e41-9e5c-c0873c1b44fc service swift] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:03.766160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3b694f4f-34e6-4e41-9e5c-c0873c1b44fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:03.793502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b694f4f-34e6-4e41-9e5c-c0873c1b44fc service swift] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:03.960372 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad574da6-7261-484d-bcf9-51cc77f43c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:03.961049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad574da6-7261-484d-bcf9-51cc77f43c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:03.961329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad574da6-7261-484d-bcf9-51cc77f43c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:03.961753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad574da6-7261-484d-bcf9-51cc77f43c14 admin admin] PATH_INFO: `/v3/projects/9e032865317040fba190f223210f8844` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:03.963674 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad574da6-7261-484d-bcf9-51cc77f43c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e032865317040fba190f223210f8844)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:03.965624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad574da6-7261-484d-bcf9-51cc77f43c14 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:04.188084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ad574da6-7261-484d-bcf9-51cc77f43c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e032865317040fba190f223210f8844', 'request_id': 'req-ad574da6-7261-484d-bcf9-51cc77f43c14'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:04.210253 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ad574da6-7261-484d-bcf9-51cc77f43c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e032865317040fba190f223210f8844', 'request_id': 'req-ad574da6-7261-484d-bcf9-51cc77f43c14'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:04.237295 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ad574da6-7261-484d-bcf9-51cc77f43c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e032865317040fba190f223210f8844', 'request_id': 'req-ad574da6-7261-484d-bcf9-51cc77f43c14'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:04.238726 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:04.301106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ad574da6-7261-484d-bcf9-51cc77f43c14 admin admin] The token cache is being invalidate because project 9e032865317040fba190f223210f8844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:04.301431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ad574da6-7261-484d-bcf9-51cc77f43c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:04.310152 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ad574da6-7261-484d-bcf9-51cc77f43c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:04.318743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def3379-c2df-43c4-9661-c5ddddf6fcf9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:04.319227 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 879/1773] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:03 2022] DELETE /identity/v3/projects/9e032865317040fba190f223210f8844 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:04.321034 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8def3379-c2df-43c4-9661-c5ddddf6fcf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:04.359692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def3379-c2df-43c4-9661-c5ddddf6fcf9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:04.539292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600a4e7-0690-4d31-8a72-4261c3f840fe None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:04.539580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600a4e7-0690-4d31-8a72-4261c3f840fe None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:04.539858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600a4e7-0690-4d31-8a72-4261c3f840fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:04.607272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-7600a4e7-0690-4d31-8a72-4261c3f840fe None None] MFA Rules not processed for user `9ee0de72ba804ba491342a8ae82a44f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:04.608537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7600a4e7-0690-4d31-8a72-4261c3f840fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:04.623828 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10f87d-179b-4349-adf0-7ec342aefcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:04.624481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10f87d-179b-4349-adf0-7ec342aefcc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:04.624757 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10f87d-179b-4349-adf0-7ec342aefcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:04.625051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10f87d-179b-4349-adf0-7ec342aefcc7 admin admin] PATH_INFO: `/v3/users/3f1a3cbde5884b7c99544ca606fa1282` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:04.633370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10f87d-179b-4349-adf0-7ec342aefcc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1a3cbde5884b7c99544ca606fa1282)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:04.635479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10f87d-179b-4349-adf0-7ec342aefcc7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:04.757775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 880/1774] 10.222.0.110 () {58 vars in 1016 bytes} [Thu Aug 4 22:26:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:04.763247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5e10f87d-179b-4349-adf0-7ec342aefcc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1a3cbde5884b7c99544ca606fa1282'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:04.782851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5e10f87d-179b-4349-adf0-7ec342aefcc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1a3cbde5884b7c99544ca606fa1282'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:04.808046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5e10f87d-179b-4349-adf0-7ec342aefcc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1a3cbde5884b7c99544ca606fa1282'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:04.810138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5e10f87d-179b-4349-adf0-7ec342aefcc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1a3cbde5884b7c99544ca606fa1282'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:04.829708 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5e10f87d-179b-4349-adf0-7ec342aefcc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1a3cbde5884b7c99544ca606fa1282'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:04.850501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 895/1775] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:04 2022] DELETE /identity/v3/users/3f1a3cbde5884b7c99544ca606fa1282 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:05.052700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600a4e7-0690-4d31-8a72-4261c3f840fe None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:05.054782 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7600a4e7-0690-4d31-8a72-4261c3f840fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:05.068753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600a4e7-0690-4d31-8a72-4261c3f840fe None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:05.293584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152e099-52c9-4781-8a1f-d48a20b98851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:05.294549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e099-52c9-4781-8a1f-d48a20b98851 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:05.294937 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e099-52c9-4781-8a1f-d48a20b98851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:05.295319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152e099-52c9-4781-8a1f-d48a20b98851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:05.301299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5152e099-52c9-4781-8a1f-d48a20b98851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:05.325475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152e099-52c9-4781-8a1f-d48a20b98851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:05.333516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152e099-52c9-4781-8a1f-d48a20b98851 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:05.350660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 881/1776] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:05.943981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a80f8-2d2e-4e03-a139-437974ce2a0f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:05.944500 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a80f8-2d2e-4e03-a139-437974ce2a0f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:05.944717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a80f8-2d2e-4e03-a139-437974ce2a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:06.001779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cf1a80f8-2d2e-4e03-a139-437974ce2a0f None None] MFA Rules not processed for user `951b36037e3a413ba8e43487fce4f651`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:06.008114 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cf1a80f8-2d2e-4e03-a139-437974ce2a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:06.169676 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:06.190971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 896/1777] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:07.571118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152e099-52c9-4781-8a1f-d48a20b98851 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:07.575997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5152e099-52c9-4781-8a1f-d48a20b98851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:07.712165 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152e099-52c9-4781-8a1f-d48a20b98851 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:07.723159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:07.724056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:07.724500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:07.725355 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] PATH_INFO: `/v3/projects/7f24b285963b4e65afdd43bc8f921c19` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:07.728012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f24b285963b4e65afdd43bc8f921c19)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:07.730970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:07.830573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:07.834176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f24b285963b4e65afdd43bc8f921c19', 'request_id': 'req-7fb9f286-2d6b-4241-9c43-361e843066f8'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:07.855977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f24b285963b4e65afdd43bc8f921c19', 'request_id': 'req-7fb9f286-2d6b-4241-9c43-361e843066f8'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:07.872956 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f24b285963b4e65afdd43bc8f921c19', 'request_id': 'req-7fb9f286-2d6b-4241-9c43-361e843066f8'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:07.904280 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] The token cache is being invalidate because project 7f24b285963b4e65afdd43bc8f921c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:07.906436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:07.908808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:07.919157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 882/1778] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:07 2022] DELETE /identity/v3/projects/7f24b285963b4e65afdd43bc8f921c19 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:07.920149 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cc40d-a53a-4890-9504-a2a6fc4facdd None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:07.920630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cc40d-a53a-4890-9504-a2a6fc4facdd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:07.920852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cc40d-a53a-4890-9504-a2a6fc4facdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:07.972382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-944cc40d-a53a-4890-9504-a2a6fc4facdd None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:07.972382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-944cc40d-a53a-4890-9504-a2a6fc4facdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:08.067856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:08.070930 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:08.267599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9f286-2d6b-4241-9c43-361e843066f8 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:08.279672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 897/1779] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:08.283836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ca5a3-a716-4d8c-8afe-28346381df01 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:08.284817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ca5a3-a716-4d8c-8afe-28346381df01 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:08.284817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ca5a3-a716-4d8c-8afe-28346381df01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:08.287595 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:08.288816 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:08.289368 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:08.289810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe admin admin] PATH_INFO: `/v3/projects/8c840369521d4af6bfb2b076b782f7ce` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:08.292001 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c840369521d4af6bfb2b076b782f7ce)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:08.294378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:08.344060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1a9ca5a3-a716-4d8c-8afe-28346381df01 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:08.345325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1a9ca5a3-a716-4d8c-8afe-28346381df01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:08.378514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 898/1780] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:08.383370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ca5a3-a716-4d8c-8afe-28346381df01 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:08.410938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c840369521d4af6bfb2b076b782f7ce', 'request_id': 'req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:08.422273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ca5a3-a716-4d8c-8afe-28346381df01 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:08.430736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c840369521d4af6bfb2b076b782f7ce', 'request_id': 'req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:08.443390 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c840369521d4af6bfb2b076b782f7ce', 'request_id': 'req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:08.502893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe admin admin] The token cache is being invalidate because project 8c840369521d4af6bfb2b076b782f7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:08.503255 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:08.505888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0706d2e4-fe90-4154-af60-dfaf7c6ef9fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:08.507910 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 883/1781] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:08 2022] DELETE /identity/v3/projects/8c840369521d4af6bfb2b076b782f7ce => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:08.521575 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8f38f-0b82-44ed-b49f-fc49d23395ed None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:08.521865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8f38f-0b82-44ed-b49f-fc49d23395ed None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:08.522142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8f38f-0b82-44ed-b49f-fc49d23395ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:08.576333 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-8bf8f38f-0b82-44ed-b49f-fc49d23395ed None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:08.577685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8bf8f38f-0b82-44ed-b49f-fc49d23395ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:08.616695 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1533-7108-4c4b-9e14-6519721d874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:08.618391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1533-7108-4c4b-9e14-6519721d874e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:08.619207 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1533-7108-4c4b-9e14-6519721d874e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:08.619677 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1533-7108-4c4b-9e14-6519721d874e admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:08.620636 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e1533-7108-4c4b-9e14-6519721d874e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:08.630772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e1533-7108-4c4b-9e14-6519721d874e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:08.632837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e1533-7108-4c4b-9e14-6519721d874e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:08.656990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 899/1782] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:26:08.657942 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1533-7108-4c4b-9e14-6519721d874e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:08.660405 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-de7e1533-7108-4c4b-9e14-6519721d874e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:08.678595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1533-7108-4c4b-9e14-6519721d874e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:08.685510 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b4899-b6b4-468c-aa40-0bcc5fc02c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:08.687492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b4899-b6b4-468c-aa40-0bcc5fc02c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:08.687825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b4899-b6b4-468c-aa40-0bcc5fc02c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:08.688147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b4899-b6b4-468c-aa40-0bcc5fc02c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:08.689145 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b4899-b6b4-468c-aa40-0bcc5fc02c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:08.715641 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b4899-b6b4-468c-aa40-0bcc5fc02c0a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:08.759513 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 884/1783] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:08.761257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad29eef-f48d-4265-ac9b-8c4a52505d5e None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:08.761549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad29eef-f48d-4265-ac9b-8c4a52505d5e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:08.761823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad29eef-f48d-4265-ac9b-8c4a52505d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:08.784148 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 900/1784] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:08 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:08.793652 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b4899-b6b4-468c-aa40-0bcc5fc02c0a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:08.814910 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:08.843584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2ad29eef-f48d-4265-ac9b-8c4a52505d5e None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:08.846679 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2ad29eef-f48d-4265-ac9b-8c4a52505d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:08.938137 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:08.959750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b4899-b6b4-468c-aa40-0bcc5fc02c0a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:08.989521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f152f-8d2f-4ad9-b5a2-8865a59fa7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:08.992591 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f152f-8d2f-4ad9-b5a2-8865a59fa7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:08.993278 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f152f-8d2f-4ad9-b5a2-8865a59fa7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:08.994428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f152f-8d2f-4ad9-b5a2-8865a59fa7d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:08.995523 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f152f-8d2f-4ad9-b5a2-8865a59fa7d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:09.003442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f152f-8d2f-4ad9-b5a2-8865a59fa7d7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:09.086396 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 885/1785] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:09.090011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 901/1786] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:08 2022] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:09.091199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad29eef-f48d-4265-ac9b-8c4a52505d5e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:09.092465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f152f-8d2f-4ad9-b5a2-8865a59fa7d7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:09.138472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f152f-8d2f-4ad9-b5a2-8865a59fa7d7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:09.139502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad29eef-f48d-4265-ac9b-8c4a52505d5e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:09.154304 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1094cc5-0d1f-45d1-82c6-4f4114daa523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:09.154980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1094cc5-0d1f-45d1-82c6-4f4114daa523 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:09.155262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1094cc5-0d1f-45d1-82c6-4f4114daa523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:09.155538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1094cc5-0d1f-45d1-82c6-4f4114daa523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:09.157973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4471f5-0156-4020-b6c9-662874fdc810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:09.158676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4471f5-0156-4020-b6c9-662874fdc810 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:09.158867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1094cc5-0d1f-45d1-82c6-4f4114daa523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:09.158986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4471f5-0156-4020-b6c9-662874fdc810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:09.159220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4471f5-0156-4020-b6c9-662874fdc810 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:09.159930 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4471f5-0156-4020-b6c9-662874fdc810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:09.160232 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4471f5-0156-4020-b6c9-662874fdc810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:09.160504 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1094cc5-0d1f-45d1-82c6-4f4114daa523 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:09.161821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4471f5-0156-4020-b6c9-662874fdc810 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:09.224408 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 886/1787] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:26:09.225323 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4471f5-0156-4020-b6c9-662874fdc810 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:09.233848 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 902/1788] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:09.234978 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1094cc5-0d1f-45d1-82c6-4f4114daa523 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:09.242669 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4471f5-0156-4020-b6c9-662874fdc810 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:09.263320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c8790-b937-476d-ba68-84c1256cefcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:09.263970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c8790-b937-476d-ba68-84c1256cefcf admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:09.264255 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c8790-b937-476d-ba68-84c1256cefcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:09.264538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c8790-b937-476d-ba68-84c1256cefcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:09.265202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c8790-b937-476d-ba68-84c1256cefcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:09.267290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c8790-b937-476d-ba68-84c1256cefcf admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:09.282970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1094cc5-0d1f-45d1-82c6-4f4114daa523 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:09.298697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd61ae-5f32-42ce-8c43-ed28841e90fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:09.299566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd61ae-5f32-42ce-8c43-ed28841e90fd admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:09.299686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd61ae-5f32-42ce-8c43-ed28841e90fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:09.299908 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd61ae-5f32-42ce-8c43-ed28841e90fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:09.300611 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd61ae-5f32-42ce-8c43-ed28841e90fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:09.302250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd61ae-5f32-42ce-8c43-ed28841e90fd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:09.326820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 887/1789] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:09 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:09.328770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c8790-b937-476d-ba68-84c1256cefcf admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:09.342688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 903/1790] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:09.360528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd61ae-5f32-42ce-8c43-ed28841e90fd admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:09.386072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd61ae-5f32-42ce-8c43-ed28841e90fd admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:09.555347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c8790-b937-476d-ba68-84c1256cefcf admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:09.561253 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21a1aa-7b27-4139-b950-0aa7d3e0572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:09.561950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21a1aa-7b27-4139-b950-0aa7d3e0572e admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:09.562657 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21a1aa-7b27-4139-b950-0aa7d3e0572e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:09.562928 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21a1aa-7b27-4139-b950-0aa7d3e0572e admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:09.563742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21a1aa-7b27-4139-b950-0aa7d3e0572e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:09.565997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21a1aa-7b27-4139-b950-0aa7d3e0572e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:09.617129 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 888/1791] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:09 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:09.620995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21a1aa-7b27-4139-b950-0aa7d3e0572e admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:09.641701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21a1aa-7b27-4139-b950-0aa7d3e0572e admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:09.654241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2de054-58e2-4139-bfb3-48289ae81a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:09.654979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2de054-58e2-4139-bfb3-48289ae81a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:09.655286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2de054-58e2-4139-bfb3-48289ae81a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:09.655520 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2de054-58e2-4139-bfb3-48289ae81a7a admin admin] PATH_INFO: `/v3/projects/7e29d99069de4a85be47f7c9165ae9bd/users/3deafec718a04e489782ec5e250a3622/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:09.669368 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e67005-a940-4ce2-9ba8-ddfa73c5693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:09.672754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e67005-a940-4ce2-9ba8-ddfa73c5693d admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:09.674048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e67005-a940-4ce2-9ba8-ddfa73c5693d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:09.674835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e67005-a940-4ce2-9ba8-ddfa73c5693d admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:09.677227 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e67005-a940-4ce2-9ba8-ddfa73c5693d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:09.680152 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e67005-a940-4ce2-9ba8-ddfa73c5693d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:09.739461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 889/1792] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:09.743329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e67005-a940-4ce2-9ba8-ddfa73c5693d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:09.748625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2de054-58e2-4139-bfb3-48289ae81a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e29d99069de4a85be47f7c9165ae9bd, user_id=3deafec718a04e489782ec5e250a3622, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:09.765245 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2de054-58e2-4139-bfb3-48289ae81a7a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:09.798957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e67005-a940-4ce2-9ba8-ddfa73c5693d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:09.841039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 904/1793] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:09 2022] PUT /identity/v3/projects/7e29d99069de4a85be47f7c9165ae9bd/users/3deafec718a04e489782ec5e250a3622/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:09.844508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3032-a946-4a18-ae07-604c151ebeb8 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:09.844826 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3032-a946-4a18-ae07-604c151ebeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:09.848480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3032-a946-4a18-ae07-604c151ebeb8 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:09.850137 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 905/1794] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 4 22:26:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:26:09.854035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a437f-68a2-4056-b3b2-76fa90a379ca None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:09.854340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a437f-68a2-4056-b3b2-76fa90a379ca None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:09.854664 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a437f-68a2-4056-b3b2-76fa90a379ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:09.959187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:09.959999 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-983a437f-68a2-4056-b3b2-76fa90a379ca None None] MFA Rules not processed for user `3deafec718a04e489782ec5e250a3622`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:09.961805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-983a437f-68a2-4056-b3b2-76fa90a379ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:09.981817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7963c-7c49-48b2-ad48-297409bc1b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:09.982559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7963c-7c49-48b2-ad48-297409bc1b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:09.982845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7963c-7c49-48b2-ad48-297409bc1b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:09.983123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7963c-7c49-48b2-ad48-297409bc1b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:09.986522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7963c-7c49-48b2-ad48-297409bc1b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:09.988339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7963c-7c49-48b2-ad48-297409bc1b00 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:10.013230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 890/1795] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:10.015556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1070d46-0cc8-4728-8f31-ac4c32071d3b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:10.016060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1070d46-0cc8-4728-8f31-ac4c32071d3b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:10.016556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1070d46-0cc8-4728-8f31-ac4c32071d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:10.071419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c1070d46-0cc8-4728-8f31-ac4c32071d3b None None] MFA Rules not processed for user `04899781f67746e193a05bdc004804cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:10.073119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c1070d46-0cc8-4728-8f31-ac4c32071d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:10.172245 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 906/1796] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:10.173111 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a437f-68a2-4056-b3b2-76fa90a379ca None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:10.204646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a437f-68a2-4056-b3b2-76fa90a379ca None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:10.209563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 891/1797] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 4 22:26:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:10.211186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1070d46-0cc8-4728-8f31-ac4c32071d3b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:10.225309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2221a-b8a6-43a0-ba73-f9f780f05323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:10.227286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2221a-b8a6-43a0-ba73-f9f780f05323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:10.227286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2221a-b8a6-43a0-ba73-f9f780f05323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:10.227286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2221a-b8a6-43a0-ba73-f9f780f05323 admin admin] PATH_INFO: `/v3/projects/0d9d17accf25486e975fb65508cad14c/users/28278990b7aa423cb6e34a1916268c77/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:10.239756 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1070d46-0cc8-4728-8f31-ac4c32071d3b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:10.245744 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa4ea3-937a-4895-b3a7-cc02e0c7e8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:10.246425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa4ea3-937a-4895-b3a7-cc02e0c7e8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:10.246733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa4ea3-937a-4895-b3a7-cc02e0c7e8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:10.247014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa4ea3-937a-4895-b3a7-cc02e0c7e8d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:10.247712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa4ea3-937a-4895-b3a7-cc02e0c7e8d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:10.249882 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa4ea3-937a-4895-b3a7-cc02e0c7e8d6 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:10.268512 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2221a-b8a6-43a0-ba73-f9f780f05323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9d17accf25486e975fb65508cad14c, user_id=28278990b7aa423cb6e34a1916268c77, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:10.273302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2221a-b8a6-43a0-ba73-f9f780f05323 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:10.315204 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 892/1798] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:10 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:10.316118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa4ea3-937a-4895-b3a7-cc02e0c7e8d6 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:10.318618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f0aa4ea3-937a-4895-b3a7-cc02e0c7e8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:10.347108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 907/1799] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:10 2022] PUT /identity/v3/projects/0d9d17accf25486e975fb65508cad14c/users/28278990b7aa423cb6e34a1916268c77/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:10.349413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2221a-b8a6-43a0-ba73-f9f780f05323 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:10.373602 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:10.454472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa4ea3-937a-4895-b3a7-cc02e0c7e8d6 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:10.455637 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2221a-b8a6-43a0-ba73-f9f780f05323 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:10.474165 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a60cb-1a8d-4da1-a9a7-ad42f1aa826c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:10.475743 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a60cb-1a8d-4da1-a9a7-ad42f1aa826c service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:10.476259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a60cb-1a8d-4da1-a9a7-ad42f1aa826c service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:10.479763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a60cb-1a8d-4da1-a9a7-ad42f1aa826c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:10.503172 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a60cb-1a8d-4da1-a9a7-ad42f1aa826c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:10.507209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a60cb-1a8d-4da1-a9a7-ad42f1aa826c service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:10.535287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 893/1800] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:10.558898 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e91278-7e29-45c0-8201-9e11046ddc47 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:10.559292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e91278-7e29-45c0-8201-9e11046ddc47 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:10.559558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e91278-7e29-45c0-8201-9e11046ddc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:10.583476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87fd20-f310-4a1d-9597-70c6211e9058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:10.584939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87fd20-f310-4a1d-9597-70c6211e9058 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:10.585632 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87fd20-f310-4a1d-9597-70c6211e9058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:10.586136 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87fd20-f310-4a1d-9597-70c6211e9058 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:10.587394 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87fd20-f310-4a1d-9597-70c6211e9058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:10.591340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87fd20-f310-4a1d-9597-70c6211e9058 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:10.637150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 908/1801] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:10 2022] POST /identity/v3/users => generated 302 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:10.639788 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87fd20-f310-4a1d-9597-70c6211e9058 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:10.644068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a6e91278-7e29-45c0-8201-9e11046ddc47 None None] MFA Rules not processed for user `28278990b7aa423cb6e34a1916268c77`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:10.645503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a6e91278-7e29-45c0-8201-9e11046ddc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:10.660024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87fd20-f310-4a1d-9597-70c6211e9058 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:10.674213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c97a9-64ed-4e8f-b60f-482ed29bcbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:10.674213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c97a9-64ed-4e8f-b60f-482ed29bcbde admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:10.674213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c97a9-64ed-4e8f-b60f-482ed29bcbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:10.674213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c97a9-64ed-4e8f-b60f-482ed29bcbde admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:10.674617 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c97a9-64ed-4e8f-b60f-482ed29bcbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:10.675002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c97a9-64ed-4e8f-b60f-482ed29bcbde admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:10.703919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:10.727724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 909/1802] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:10.732911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c97a9-64ed-4e8f-b60f-482ed29bcbde admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:10.745839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c97a9-64ed-4e8f-b60f-482ed29bcbde admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:10.751106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed255d9-5c18-47d6-9566-babc951ab61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:10.751799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed255d9-5c18-47d6-9566-babc951ab61d admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:10.752181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed255d9-5c18-47d6-9566-babc951ab61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:10.752480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed255d9-5c18-47d6-9566-babc951ab61d admin admin] PATH_INFO: `/v3/projects/1a1c76c36e5643ae9d6c2678fef6103b/users/44ac091758cf4ac886f778553c73aaca/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:10.779618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 894/1803] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:10.785091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed255d9-5c18-47d6-9566-babc951ab61d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1c76c36e5643ae9d6c2678fef6103b, user_id=44ac091758cf4ac886f778553c73aaca, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:10.787751 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e91278-7e29-45c0-8201-9e11046ddc47 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:10.788246 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed255d9-5c18-47d6-9566-babc951ab61d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:10.805031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 910/1804] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:10 2022] PUT /identity/v3/projects/1a1c76c36e5643ae9d6c2678fef6103b/users/44ac091758cf4ac886f778553c73aaca/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:10.808422 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e91278-7e29-45c0-8201-9e11046ddc47 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:10.808894 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed255d9-5c18-47d6-9566-babc951ab61d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:10.892335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d9286-a423-480e-9b94-c0d87600c22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:10.893277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d9286-a423-480e-9b94-c0d87600c22f admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:10.893756 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d9286-a423-480e-9b94-c0d87600c22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:10.894286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d9286-a423-480e-9b94-c0d87600c22f admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:10.895339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d9286-a423-480e-9b94-c0d87600c22f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:10.897612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d9286-a423-480e-9b94-c0d87600c22f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:10.909483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed255d9-5c18-47d6-9566-babc951ab61d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:10.916118 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4200fd9-61d9-40ed-a506-f6f72e0397be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:10.916816 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4200fd9-61d9-40ed-a506-f6f72e0397be admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:10.917495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4200fd9-61d9-40ed-a506-f6f72e0397be admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:10.917784 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4200fd9-61d9-40ed-a506-f6f72e0397be admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:10.918527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4200fd9-61d9-40ed-a506-f6f72e0397be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:10.920346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4200fd9-61d9-40ed-a506-f6f72e0397be admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:10.932917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 911/1805] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:10.936943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4200fd9-61d9-40ed-a506-f6f72e0397be admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:10.943687 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 895/1806] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:10 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:10.945955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d9286-a423-480e-9b94-c0d87600c22f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:10.950009 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4200fd9-61d9-40ed-a506-f6f72e0397be admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:10.959367 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:11.112352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d9286-a423-480e-9b94-c0d87600c22f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:11.116686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733ee40-3a70-4121-aaf6-99180ded7f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:11.119911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0d037-895e-4a75-911a-1eaf9ca82258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:11.120743 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0d037-895e-4a75-911a-1eaf9ca82258 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:11.120964 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0d037-895e-4a75-911a-1eaf9ca82258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:11.121248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0d037-895e-4a75-911a-1eaf9ca82258 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:11.121727 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ee40-3a70-4121-aaf6-99180ded7f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:11.121998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0d037-895e-4a75-911a-1eaf9ca82258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:11.122389 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ee40-3a70-4121-aaf6-99180ded7f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:11.122983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ee40-3a70-4121-aaf6-99180ded7f6d admin admin] PATH_INFO: `/v3/projects/1a1c76c36e5643ae9d6c2678fef6103b/users/44ac091758cf4ac886f778553c73aaca/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:11.124032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0d037-895e-4a75-911a-1eaf9ca82258 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:11.126244 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733ee40-3a70-4121-aaf6-99180ded7f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1c76c36e5643ae9d6c2678fef6103b, user_id=44ac091758cf4ac886f778553c73aaca, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:11.129399 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733ee40-3a70-4121-aaf6-99180ded7f6d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:11.172113 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 896/1807] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:10 2022] POST /identity/v3/users => generated 300 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:11.175815 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 912/1808] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:10 2022] PUT /identity/v3/projects/1a1c76c36e5643ae9d6c2678fef6103b/users/44ac091758cf4ac886f778553c73aaca/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:11.184599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0d037-895e-4a75-911a-1eaf9ca82258 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:11.186718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697edacf-fbdc-445f-9c72-c41c28920fde None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:11.187477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697edacf-fbdc-445f-9c72-c41c28920fde None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:11.189958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697edacf-fbdc-445f-9c72-c41c28920fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:11.223917 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0d037-895e-4a75-911a-1eaf9ca82258 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:11.240692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-697edacf-fbdc-445f-9c72-c41c28920fde None None] MFA Rules not processed for user `44ac091758cf4ac886f778553c73aaca`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:11.242107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-697edacf-fbdc-445f-9c72-c41c28920fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:11.283830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:11.300329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74e056-c8f7-43f1-9c5d-2dccea85981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:11.301083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74e056-c8f7-43f1-9c5d-2dccea85981b admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:11.301457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74e056-c8f7-43f1-9c5d-2dccea85981b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:11.301730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74e056-c8f7-43f1-9c5d-2dccea85981b admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:11.302864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74e056-c8f7-43f1-9c5d-2dccea85981b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:11.305384 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74e056-c8f7-43f1-9c5d-2dccea85981b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:11.319452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 897/1809] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:11.324484 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74e056-c8f7-43f1-9c5d-2dccea85981b admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:11.335394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74e056-c8f7-43f1-9c5d-2dccea85981b admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:11.340388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7a0ea-8c60-4ba4-83c2-50a17cdd9fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:11.341280 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7a0ea-8c60-4ba4-83c2-50a17cdd9fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:11.341569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7a0ea-8c60-4ba4-83c2-50a17cdd9fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:11.342329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7a0ea-8c60-4ba4-83c2-50a17cdd9fdc admin admin] PATH_INFO: `/v3/projects/640d99b745f34371b0cadcb122205aca/users/6a4d7850b377405bb5cc3ef968b4f0bb/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:11.374096 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7a0ea-8c60-4ba4-83c2-50a17cdd9fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=640d99b745f34371b0cadcb122205aca, user_id=6a4d7850b377405bb5cc3ef968b4f0bb, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:11.391134 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7a0ea-8c60-4ba4-83c2-50a17cdd9fdc admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:11.414902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 898/1810] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:11 2022] PUT /identity/v3/projects/640d99b745f34371b0cadcb122205aca/users/6a4d7850b377405bb5cc3ef968b4f0bb/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:11.420879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7a0ea-8c60-4ba4-83c2-50a17cdd9fdc admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:11.425777 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 913/1811] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:11.442595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697edacf-fbdc-445f-9c72-c41c28920fde None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:11.444172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-697edacf-fbdc-445f-9c72-c41c28920fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:11.547003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697edacf-fbdc-445f-9c72-c41c28920fde None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:11.578703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7a0ea-8c60-4ba4-83c2-50a17cdd9fdc admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:11.597697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eadabe-5feb-4c10-ac47-e7c12fc6456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:11.597697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eadabe-5feb-4c10-ac47-e7c12fc6456b admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:11.597697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eadabe-5feb-4c10-ac47-e7c12fc6456b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:11.597922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eadabe-5feb-4c10-ac47-e7c12fc6456b admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:11.600845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eadabe-5feb-4c10-ac47-e7c12fc6456b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:11.602512 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eadabe-5feb-4c10-ac47-e7c12fc6456b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:11.632974 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 899/1812] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:11.634103 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eadabe-5feb-4c10-ac47-e7c12fc6456b admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:11.657011 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eadabe-5feb-4c10-ac47-e7c12fc6456b admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:11.659805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:11.668558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe22c03-0265-47d1-b5a8-2e822203b266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:11.669266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22c03-0265-47d1-b5a8-2e822203b266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:11.669659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22c03-0265-47d1-b5a8-2e822203b266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:11.670808 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a9cac-cf57-4376-b452-93792451e0fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:11.671030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22c03-0265-47d1-b5a8-2e822203b266 admin admin] PATH_INFO: `/v3/projects/640d99b745f34371b0cadcb122205aca/users/6a4d7850b377405bb5cc3ef968b4f0bb/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:11.672667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a9cac-cf57-4376-b452-93792451e0fb service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:11.673500 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a9cac-cf57-4376-b452-93792451e0fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:11.673829 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a9cac-cf57-4376-b452-93792451e0fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:11.675696 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe22c03-0265-47d1-b5a8-2e822203b266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=640d99b745f34371b0cadcb122205aca, user_id=6a4d7850b377405bb5cc3ef968b4f0bb, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:11.685002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe22c03-0265-47d1-b5a8-2e822203b266 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:11.734375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 900/1813] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:11 2022] PUT /identity/v3/projects/640d99b745f34371b0cadcb122205aca/users/6a4d7850b377405bb5cc3ef968b4f0bb/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:11.736287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7785db-c5a2-4877-a5a7-bf7acacd6591 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:11.736876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7785db-c5a2-4877-a5a7-bf7acacd6591 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:11.737251 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7785db-c5a2-4877-a5a7-bf7acacd6591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:11.766432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a9cac-cf57-4376-b452-93792451e0fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:11.767913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a9cac-cf57-4376-b452-93792451e0fb service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:11.774419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-ac7785db-c5a2-4877-a5a7-bf7acacd6591 None None] MFA Rules not processed for user `6a4d7850b377405bb5cc3ef968b4f0bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:11.775850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ac7785db-c5a2-4877-a5a7-bf7acacd6591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:11.788712 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 914/1814] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:11 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:11.870091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a9cac-cf57-4376-b452-93792451e0fb service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:11.874579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 901/1815] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:11.880582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a9cac-cf57-4376-b452-93792451e0fb service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:11.893884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7785db-c5a2-4877-a5a7-bf7acacd6591 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:11.895782 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ac7785db-c5a2-4877-a5a7-bf7acacd6591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:11.935730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:11.970460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4050e5-1b32-4e52-935e-73397d80d111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:11.970460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4050e5-1b32-4e52-935e-73397d80d111 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:11.970460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4050e5-1b32-4e52-935e-73397d80d111 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:11.970460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4050e5-1b32-4e52-935e-73397d80d111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:11.981915 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7785db-c5a2-4877-a5a7-bf7acacd6591 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:11.986528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674fff9-7784-4d32-becc-334041a153bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:11.987095 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674fff9-7784-4d32-becc-334041a153bb service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:11.987540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674fff9-7784-4d32-becc-334041a153bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:11.987806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674fff9-7784-4d32-becc-334041a153bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:11.997727 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674fff9-7784-4d32-becc-334041a153bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:11.999194 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674fff9-7784-4d32-becc-334041a153bb service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:12.009540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 902/1816] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:12.052415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674fff9-7784-4d32-becc-334041a153bb service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:12.071696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4050e5-1b32-4e52-935e-73397d80d111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:12.073728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4050e5-1b32-4e52-935e-73397d80d111 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:12.102598 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 915/1817] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:26:12.185724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674fff9-7784-4d32-becc-334041a153bb service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:12.196639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5988d9-55bf-4bf0-b9cc-8f83aca0f448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:12.198009 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5988d9-55bf-4bf0-b9cc-8f83aca0f448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:12.198443 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5988d9-55bf-4bf0-b9cc-8f83aca0f448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:12.198805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5988d9-55bf-4bf0-b9cc-8f83aca0f448 admin admin] PATH_INFO: `/v3/users/28278990b7aa423cb6e34a1916268c77` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:12.199990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5988d9-55bf-4bf0-b9cc-8f83aca0f448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28278990b7aa423cb6e34a1916268c77)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:12.202200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5988d9-55bf-4bf0-b9cc-8f83aca0f448 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:12.305085 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5f5988d9-55bf-4bf0-b9cc-8f83aca0f448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28278990b7aa423cb6e34a1916268c77'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:12.324824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5f5988d9-55bf-4bf0-b9cc-8f83aca0f448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28278990b7aa423cb6e34a1916268c77'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:12.346268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5f5988d9-55bf-4bf0-b9cc-8f83aca0f448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28278990b7aa423cb6e34a1916268c77'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:12.348103 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5f5988d9-55bf-4bf0-b9cc-8f83aca0f448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28278990b7aa423cb6e34a1916268c77'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:12.380817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5f5988d9-55bf-4bf0-b9cc-8f83aca0f448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28278990b7aa423cb6e34a1916268c77'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:12.402447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 903/1818] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:12 2022] DELETE /identity/v3/users/28278990b7aa423cb6e34a1916268c77 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:12.406798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28808b04-ad6e-4abd-8097-12d5432f51e0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:12.407341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28808b04-ad6e-4abd-8097-12d5432f51e0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:12.407805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28808b04-ad6e-4abd-8097-12d5432f51e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:12.454847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-28808b04-ad6e-4abd-8097-12d5432f51e0 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:12.456372 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-28808b04-ad6e-4abd-8097-12d5432f51e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:12.510596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:12.546947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 916/1819] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:12.557902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5988d9-55bf-4bf0-b9cc-8f83aca0f448 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:12.559393 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5f5988d9-55bf-4bf0-b9cc-8f83aca0f448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:12.685686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:12.690217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5988d9-55bf-4bf0-b9cc-8f83aca0f448 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:12.700005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ec997-7684-49a5-ba56-13d47ea3a465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:12.700876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ec997-7684-49a5-ba56-13d47ea3a465 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:12.709446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ec997-7684-49a5-ba56-13d47ea3a465 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:12.709979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ec997-7684-49a5-ba56-13d47ea3a465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:12.744323 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ec997-7684-49a5-ba56-13d47ea3a465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:12.746549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ec997-7684-49a5-ba56-13d47ea3a465 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:12.762368 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 904/1820] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:13.002837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28808b04-ad6e-4abd-8097-12d5432f51e0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:13.004349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-28808b04-ad6e-4abd-8097-12d5432f51e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:13.017413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28808b04-ad6e-4abd-8097-12d5432f51e0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:13.023356 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6ab65-7b24-4cc3-8648-f9844a2d8dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:13.024098 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6ab65-7b24-4cc3-8648-f9844a2d8dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:13.024382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6ab65-7b24-4cc3-8648-f9844a2d8dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:13.024782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6ab65-7b24-4cc3-8648-f9844a2d8dd4 admin admin] PATH_INFO: `/v3/users/34eeced51061413191b59f5b088e0e27` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:13.026718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6ab65-7b24-4cc3-8648-f9844a2d8dd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34eeced51061413191b59f5b088e0e27)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:13.028708 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6ab65-7b24-4cc3-8648-f9844a2d8dd4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:13.092918 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0ca6ab65-7b24-4cc3-8648-f9844a2d8dd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34eeced51061413191b59f5b088e0e27'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:13.119032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0ca6ab65-7b24-4cc3-8648-f9844a2d8dd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34eeced51061413191b59f5b088e0e27'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:13.144541 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0ca6ab65-7b24-4cc3-8648-f9844a2d8dd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34eeced51061413191b59f5b088e0e27'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:13.146919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0ca6ab65-7b24-4cc3-8648-f9844a2d8dd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34eeced51061413191b59f5b088e0e27'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:13.163275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0ca6ab65-7b24-4cc3-8648-f9844a2d8dd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34eeced51061413191b59f5b088e0e27'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:13.179324 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 917/1821] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:13 2022] DELETE /identity/v3/users/34eeced51061413191b59f5b088e0e27 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:13.183474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cb4fa-202e-499c-ad9b-99b0c6ddf8fe None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:13.183950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cb4fa-202e-499c-ad9b-99b0c6ddf8fe None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:13.184216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cb4fa-202e-499c-ad9b-99b0c6ddf8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:13.210644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-079cb4fa-202e-499c-ad9b-99b0c6ddf8fe None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:13.212472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-079cb4fa-202e-499c-ad9b-99b0c6ddf8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:13.307056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 905/1822] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:13.319081 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6ab65-7b24-4cc3-8648-f9844a2d8dd4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:13.324211 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0ca6ab65-7b24-4cc3-8648-f9844a2d8dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:13.419910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6ab65-7b24-4cc3-8648-f9844a2d8dd4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:13.424815 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db463b0-dbd9-4b7e-9c7e-edc84be0558a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:13.425562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db463b0-dbd9-4b7e-9c7e-edc84be0558a service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:13.425957 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db463b0-dbd9-4b7e-9c7e-edc84be0558a service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:13.426304 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db463b0-dbd9-4b7e-9c7e-edc84be0558a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:13.439812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db463b0-dbd9-4b7e-9c7e-edc84be0558a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:13.441644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db463b0-dbd9-4b7e-9c7e-edc84be0558a service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:13.454823 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 918/1823] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:13.514019 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cb4fa-202e-499c-ad9b-99b0c6ddf8fe None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:13.515780 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-079cb4fa-202e-499c-ad9b-99b0c6ddf8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:13.544794 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cb4fa-202e-499c-ad9b-99b0c6ddf8fe None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:13.563451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:13.565751 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:13.566083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:13.566703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] PATH_INFO: `/v3/projects/0d9d17accf25486e975fb65508cad14c` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:13.569317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9d17accf25486e975fb65508cad14c)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:13.573679 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:13.662159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9d17accf25486e975fb65508cad14c', 'request_id': 'req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:13.683005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9d17accf25486e975fb65508cad14c', 'request_id': 'req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:13.698787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9d17accf25486e975fb65508cad14c', 'request_id': 'req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:13.722377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] The token cache is being invalidate because project 0d9d17accf25486e975fb65508cad14c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:13.722750 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:13.723927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:13.728401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 906/1824] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:13 2022] DELETE /identity/v3/projects/0d9d17accf25486e975fb65508cad14c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:13.729410 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db463b0-dbd9-4b7e-9c7e-edc84be0558a service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:13.739930 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db463b0-dbd9-4b7e-9c7e-edc84be0558a service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:13.848565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d128a8-6cb1-4f21-ad1a-757bb3fbacca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:13.849227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d128a8-6cb1-4f21-ad1a-757bb3fbacca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:13.849512 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d128a8-6cb1-4f21-ad1a-757bb3fbacca admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:13.849790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d128a8-6cb1-4f21-ad1a-757bb3fbacca admin admin] PATH_INFO: `/v3/users/6a4d7850b377405bb5cc3ef968b4f0bb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:13.851084 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d128a8-6cb1-4f21-ad1a-757bb3fbacca admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a4d7850b377405bb5cc3ef968b4f0bb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:13.867545 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d128a8-6cb1-4f21-ad1a-757bb3fbacca admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:13.881306 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:13.968714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-05d128a8-6cb1-4f21-ad1a-757bb3fbacca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a4d7850b377405bb5cc3ef968b4f0bb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:13.983960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-05d128a8-6cb1-4f21-ad1a-757bb3fbacca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a4d7850b377405bb5cc3ef968b4f0bb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.012320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-05d128a8-6cb1-4f21-ad1a-757bb3fbacca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a4d7850b377405bb5cc3ef968b4f0bb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.013585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-05d128a8-6cb1-4f21-ad1a-757bb3fbacca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a4d7850b377405bb5cc3ef968b4f0bb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.023027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-05d128a8-6cb1-4f21-ad1a-757bb3fbacca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a4d7850b377405bb5cc3ef968b4f0bb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.031350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 919/1825] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:13 2022] DELETE /identity/v3/users/6a4d7850b377405bb5cc3ef968b4f0bb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:14.109723 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:14.111513 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:14.170796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc0799-5a2b-4e95-b164-4f3c5feeef9c admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:14.278914 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:14.279925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:14.280390 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:14.280938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] PATH_INFO: `/v3/projects/7432b2e7062141c597b31eacf986aad3` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:14.284272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7432b2e7062141c597b31eacf986aad3)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:14.286978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:14.345297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:14.414062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7432b2e7062141c597b31eacf986aad3', 'request_id': 'req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.441133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7432b2e7062141c597b31eacf986aad3', 'request_id': 'req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.460738 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7432b2e7062141c597b31eacf986aad3', 'request_id': 'req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.491816 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] The token cache is being invalidate because project 7432b2e7062141c597b31eacf986aad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:14.492108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.494460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.497969 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 907/1826] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:14 2022] DELETE /identity/v3/projects/7432b2e7062141c597b31eacf986aad3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:14.502301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d128a8-6cb1-4f21-ad1a-757bb3fbacca admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:14.504069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-05d128a8-6cb1-4f21-ad1a-757bb3fbacca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:14.554528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d128a8-6cb1-4f21-ad1a-757bb3fbacca admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:14.628544 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:14.630204 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:14.649593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e757f7-5713-4b07-85e7-311aff0db1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:14.650977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e757f7-5713-4b07-85e7-311aff0db1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:14.651484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e757f7-5713-4b07-85e7-311aff0db1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:14.651918 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e757f7-5713-4b07-85e7-311aff0db1ab admin admin] PATH_INFO: `/v3/users/d6bcfdfded7d47fc886198418ae77a53` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:14.653465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e757f7-5713-4b07-85e7-311aff0db1ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6bcfdfded7d47fc886198418ae77a53)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:14.655745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e757f7-5713-4b07-85e7-311aff0db1ab admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:14.753325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-97e757f7-5713-4b07-85e7-311aff0db1ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6bcfdfded7d47fc886198418ae77a53'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.756933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53301343-fa4e-4dcc-8ffd-f23da8b2bbbd admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:14.761810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-97e757f7-5713-4b07-85e7-311aff0db1ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6bcfdfded7d47fc886198418ae77a53'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.766147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00926af7-3f8c-448c-bd6e-ce931ad37ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:14.766904 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926af7-3f8c-448c-bd6e-ce931ad37ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:14.767184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926af7-3f8c-448c-bd6e-ce931ad37ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:14.767457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00926af7-3f8c-448c-bd6e-ce931ad37ffb admin admin] PATH_INFO: `/v3/projects/640d99b745f34371b0cadcb122205aca` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:14.768798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00926af7-3f8c-448c-bd6e-ce931ad37ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=640d99b745f34371b0cadcb122205aca)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:14.770713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00926af7-3f8c-448c-bd6e-ce931ad37ffb admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:14.776867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-97e757f7-5713-4b07-85e7-311aff0db1ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6bcfdfded7d47fc886198418ae77a53'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.777736 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-97e757f7-5713-4b07-85e7-311aff0db1ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6bcfdfded7d47fc886198418ae77a53'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.788114 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-97e757f7-5713-4b07-85e7-311aff0db1ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6bcfdfded7d47fc886198418ae77a53'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.816588 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 920/1827] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:14 2022] DELETE /identity/v3/users/d6bcfdfded7d47fc886198418ae77a53 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:14.841093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-00926af7-3f8c-448c-bd6e-ce931ad37ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640d99b745f34371b0cadcb122205aca', 'request_id': 'req-00926af7-3f8c-448c-bd6e-ce931ad37ffb'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.856200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-00926af7-3f8c-448c-bd6e-ce931ad37ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640d99b745f34371b0cadcb122205aca', 'request_id': 'req-00926af7-3f8c-448c-bd6e-ce931ad37ffb'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.863913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-00926af7-3f8c-448c-bd6e-ce931ad37ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640d99b745f34371b0cadcb122205aca', 'request_id': 'req-00926af7-3f8c-448c-bd6e-ce931ad37ffb'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.881782 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-00926af7-3f8c-448c-bd6e-ce931ad37ffb admin admin] The token cache is being invalidate because project 640d99b745f34371b0cadcb122205aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:14.882324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-00926af7-3f8c-448c-bd6e-ce931ad37ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.883288 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-00926af7-3f8c-448c-bd6e-ce931ad37ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:14.891590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c9e0-e8c4-488f-8b12-01d12aecdca4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:14.891919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c9e0-e8c4-488f-8b12-01d12aecdca4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:14.892223 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c9e0-e8c4-488f-8b12-01d12aecdca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:14.895292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 908/1828] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:14 2022] DELETE /identity/v3/projects/640d99b745f34371b0cadcb122205aca => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:14.920816 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:14.945366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4763c9e0-e8c4-488f-8b12-01d12aecdca4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:14.946836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4763c9e0-e8c4-488f-8b12-01d12aecdca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:15.048032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6ac00-d487-4610-b37f-addc0ab25f66 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:15.048716 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6ac00-d487-4610-b37f-addc0ab25f66 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:15.048716 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6ac00-d487-4610-b37f-addc0ab25f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:15.060730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 921/1829] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:15.081879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-62c6ac00-d487-4610-b37f-addc0ab25f66 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:15.083517 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-62c6ac00-d487-4610-b37f-addc0ab25f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:15.101006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 909/1830] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:15.102078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763c9e0-e8c4-488f-8b12-01d12aecdca4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:15.115049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763c9e0-e8c4-488f-8b12-01d12aecdca4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:15.129984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62525155-9f72-43d7-83f1-3da50d059c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:15.131016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62525155-9f72-43d7-83f1-3da50d059c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:15.132637 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62525155-9f72-43d7-83f1-3da50d059c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:15.133190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62525155-9f72-43d7-83f1-3da50d059c09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:15.134287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62525155-9f72-43d7-83f1-3da50d059c09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:15.135178 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62525155-9f72-43d7-83f1-3da50d059c09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:15.138166 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62525155-9f72-43d7-83f1-3da50d059c09 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:15.167473 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 922/1831] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:26:15.174850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6ac00-d487-4610-b37f-addc0ab25f66 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:15.196030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6ac00-d487-4610-b37f-addc0ab25f66 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:15.206895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b923972-c815-4c77-86a3-5c2c08ad8ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:15.208094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b923972-c815-4c77-86a3-5c2c08ad8ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:15.208477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b923972-c815-4c77-86a3-5c2c08ad8ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:15.208886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b923972-c815-4c77-86a3-5c2c08ad8ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:15.211421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b923972-c815-4c77-86a3-5c2c08ad8ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:15.222018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b923972-c815-4c77-86a3-5c2c08ad8ce3 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:15.270438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 910/1832] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:15 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:15.272575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62525155-9f72-43d7-83f1-3da50d059c09 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:15.290657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62525155-9f72-43d7-83f1-3da50d059c09 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:15.385657 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b923972-c815-4c77-86a3-5c2c08ad8ce3 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:15.390224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9b923972-c815-4c77-86a3-5c2c08ad8ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:15.415613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:15.425940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983793b9-00da-40dc-b5c8-faffab91eefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:15.427733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983793b9-00da-40dc-b5c8-faffab91eefc admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:15.428188 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983793b9-00da-40dc-b5c8-faffab91eefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:15.428859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983793b9-00da-40dc-b5c8-faffab91eefc admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:15.429837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983793b9-00da-40dc-b5c8-faffab91eefc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:15.432299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983793b9-00da-40dc-b5c8-faffab91eefc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:15.496080 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 923/1833] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:15 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:15.505355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983793b9-00da-40dc-b5c8-faffab91eefc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:15.543092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983793b9-00da-40dc-b5c8-faffab91eefc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:15.555341 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b923972-c815-4c77-86a3-5c2c08ad8ce3 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:15.558388 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4059573-d1e8-4039-80ab-566d058f3e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:15.559364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059573-d1e8-4039-80ab-566d058f3e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:15.559855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059573-d1e8-4039-80ab-566d058f3e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:15.559978 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4059573-d1e8-4039-80ab-566d058f3e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:15.560630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4059573-d1e8-4039-80ab-566d058f3e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:15.562392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4059573-d1e8-4039-80ab-566d058f3e46 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:15.571781 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa45d4-509a-4756-95d5-fdd929fdee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:15.572481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa45d4-509a-4756-95d5-fdd929fdee1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:15.572760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa45d4-509a-4756-95d5-fdd929fdee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:15.573038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa45d4-509a-4756-95d5-fdd929fdee1f admin admin] PATH_INFO: `/v3/projects/b9f5ad327f3b4cf3a759d384c11685eb` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:15.574978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa45d4-509a-4756-95d5-fdd929fdee1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f5ad327f3b4cf3a759d384c11685eb)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:15.587559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa45d4-509a-4756-95d5-fdd929fdee1f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:15.589180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 924/1834] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:15.593515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4059573-d1e8-4039-80ab-566d058f3e46 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:15.627813 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4059573-d1e8-4039-80ab-566d058f3e46 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:15.639000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3dfad-4148-4d50-9c0d-0e10aa4ad314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:15.642610 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3dfad-4148-4d50-9c0d-0e10aa4ad314 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:15.643754 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3dfad-4148-4d50-9c0d-0e10aa4ad314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:15.644432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3dfad-4148-4d50-9c0d-0e10aa4ad314 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:15.647265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3dfad-4148-4d50-9c0d-0e10aa4ad314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:15.653202 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3dfad-4148-4d50-9c0d-0e10aa4ad314 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:15.692879 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 925/1835] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:15.696058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3dfad-4148-4d50-9c0d-0e10aa4ad314 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:15.730208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-80fa45d4-509a-4756-95d5-fdd929fdee1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f5ad327f3b4cf3a759d384c11685eb', 'request_id': 'req-80fa45d4-509a-4756-95d5-fdd929fdee1f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:15.749513 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3dfad-4148-4d50-9c0d-0e10aa4ad314 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:15.755462 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-80fa45d4-509a-4756-95d5-fdd929fdee1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f5ad327f3b4cf3a759d384c11685eb', 'request_id': 'req-80fa45d4-509a-4756-95d5-fdd929fdee1f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:15.778754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-80fa45d4-509a-4756-95d5-fdd929fdee1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f5ad327f3b4cf3a759d384c11685eb', 'request_id': 'req-80fa45d4-509a-4756-95d5-fdd929fdee1f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:15.823764 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-80fa45d4-509a-4756-95d5-fdd929fdee1f admin admin] The token cache is being invalidate because project b9f5ad327f3b4cf3a759d384c11685eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:15.824053 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-80fa45d4-509a-4756-95d5-fdd929fdee1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:15.826655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-80fa45d4-509a-4756-95d5-fdd929fdee1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:15.834247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 911/1836] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:15 2022] DELETE /identity/v3/projects/b9f5ad327f3b4cf3a759d384c11685eb => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:15.836875 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d59fe5-103c-43d0-835d-8d99a934878a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:15.837169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d59fe5-103c-43d0-835d-8d99a934878a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:15.837450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d59fe5-103c-43d0-835d-8d99a934878a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:15.898783 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-d0d59fe5-103c-43d0-835d-8d99a934878a None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:15.900023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d0d59fe5-103c-43d0-835d-8d99a934878a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:15.963438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62604f58-6e4e-46b8-889c-f46ce7d1fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:15.964309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62604f58-6e4e-46b8-889c-f46ce7d1fb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:15.964585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62604f58-6e4e-46b8-889c-f46ce7d1fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:15.964860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62604f58-6e4e-46b8-889c-f46ce7d1fb8c admin admin] PATH_INFO: `/v3/projects/365ff6ba10074407876363f4a48fbc81/users/54f3e43ae6bc4b6690d3d4fce137ce75/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:15.967736 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:16.020900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62604f58-6e4e-46b8-889c-f46ce7d1fb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=365ff6ba10074407876363f4a48fbc81, user_id=54f3e43ae6bc4b6690d3d4fce137ce75, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.026214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62604f58-6e4e-46b8-889c-f46ce7d1fb8c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:16.070356 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 926/1837] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:15 2022] PUT /identity/v3/projects/365ff6ba10074407876363f4a48fbc81/users/54f3e43ae6bc4b6690d3d4fce137ce75/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:16.081521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40766e-5684-4ed2-be33-d8bb33c58834 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.082087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40766e-5684-4ed2-be33-d8bb33c58834 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.082489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40766e-5684-4ed2-be33-d8bb33c58834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.111091 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 912/1838] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:16.125140 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b532bc7-e519-4a8b-a54f-21e43d3d630c None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.127105 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b532bc7-e519-4a8b-a54f-21e43d3d630c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.127646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b532bc7-e519-4a8b-a54f-21e43d3d630c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.139096 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5c40766e-5684-4ed2-be33-d8bb33c58834 None None] MFA Rules not processed for user `54f3e43ae6bc4b6690d3d4fce137ce75`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:16.140409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5c40766e-5684-4ed2-be33-d8bb33c58834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:16.181271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5b532bc7-e519-4a8b-a54f-21e43d3d630c None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:16.183842 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5b532bc7-e519-4a8b-a54f-21e43d3d630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:16.231414 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:16.286454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 927/1839] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:16.287983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 913/1840] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:16.289191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40766e-5684-4ed2-be33-d8bb33c58834 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:16.292925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b532bc7-e519-4a8b-a54f-21e43d3d630c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:16.294173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5c40766e-5684-4ed2-be33-d8bb33c58834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:16.310190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b532bc7-e519-4a8b-a54f-21e43d3d630c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:16.326558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376c105-f788-4258-83f7-6256ebed769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:16.327212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376c105-f788-4258-83f7-6256ebed769b admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.327499 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376c105-f788-4258-83f7-6256ebed769b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.327919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376c105-f788-4258-83f7-6256ebed769b admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.328188 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40766e-5684-4ed2-be33-d8bb33c58834 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:16.328639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376c105-f788-4258-83f7-6256ebed769b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:16.328951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376c105-f788-4258-83f7-6256ebed769b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.332492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376c105-f788-4258-83f7-6256ebed769b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:16.348958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 914/1841] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:26:16.350584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7ad5d-7325-428c-9443-0bb7261c01c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:16.351630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7ad5d-7325-428c-9443-0bb7261c01c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.352080 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7ad5d-7325-428c-9443-0bb7261c01c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.353074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376c105-f788-4258-83f7-6256ebed769b admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:16.354364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7ad5d-7325-428c-9443-0bb7261c01c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.355530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7ad5d-7325-428c-9443-0bb7261c01c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.359733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7ad5d-7325-428c-9443-0bb7261c01c6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:16.368803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376c105-f788-4258-83f7-6256ebed769b admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:16.380916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f907fe9-0a9a-4529-a5f7-cdfbce822b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:16.381592 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907fe9-0a9a-4529-a5f7-cdfbce822b02 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.381843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907fe9-0a9a-4529-a5f7-cdfbce822b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.382120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907fe9-0a9a-4529-a5f7-cdfbce822b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.382898 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f907fe9-0a9a-4529-a5f7-cdfbce822b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.385406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f907fe9-0a9a-4529-a5f7-cdfbce822b02 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:16.409706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 928/1842] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:16 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:16.413873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7ad5d-7325-428c-9443-0bb7261c01c6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:16.424122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 915/1843] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:16 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:16.429621 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f907fe9-0a9a-4529-a5f7-cdfbce822b02 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:16.511037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7ad5d-7325-428c-9443-0bb7261c01c6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:16.529403 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f907fe9-0a9a-4529-a5f7-cdfbce822b02 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:16.534026 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfcb5a-ff83-49f0-b766-6f9d16c75001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:16.534739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfcb5a-ff83-49f0-b766-6f9d16c75001 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.535303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfcb5a-ff83-49f0-b766-6f9d16c75001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.535465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfcb5a-ff83-49f0-b766-6f9d16c75001 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.536153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfcb5a-ff83-49f0-b766-6f9d16c75001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.538118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfcb5a-ff83-49f0-b766-6f9d16c75001 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:16.562111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 916/1844] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:16 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:26:16.565895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfcb5a-ff83-49f0-b766-6f9d16c75001 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:16.575447 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:16.576331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfcb5a-ff83-49f0-b766-6f9d16c75001 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:16.581350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d3e19-ab42-4f32-9e12-8facd1c1663c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:16.582056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d3e19-ab42-4f32-9e12-8facd1c1663c admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.582247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d3e19-ab42-4f32-9e12-8facd1c1663c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.582553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d3e19-ab42-4f32-9e12-8facd1c1663c admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.583591 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fced46-7110-4807-a88e-a7ba6884c69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:16.583809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d3e19-ab42-4f32-9e12-8facd1c1663c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.584331 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fced46-7110-4807-a88e-a7ba6884c69f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.584910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fced46-7110-4807-a88e-a7ba6884c69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.585240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d3e19-ab42-4f32-9e12-8facd1c1663c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:16.585406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fced46-7110-4807-a88e-a7ba6884c69f admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.586370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fced46-7110-4807-a88e-a7ba6884c69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.588934 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fced46-7110-4807-a88e-a7ba6884c69f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:16.596611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 917/1845] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:16.600963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d3e19-ab42-4f32-9e12-8facd1c1663c admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:16.611287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d3e19-ab42-4f32-9e12-8facd1c1663c admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:16.612242 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 929/1846] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:16 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:16.619290 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fced46-7110-4807-a88e-a7ba6884c69f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:16.622054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f624b9f-f4a5-465b-9a64-26732f9fe381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:16.622815 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f624b9f-f4a5-465b-9a64-26732f9fe381 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.623166 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f624b9f-f4a5-465b-9a64-26732f9fe381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.623452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f624b9f-f4a5-465b-9a64-26732f9fe381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.624152 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f624b9f-f4a5-465b-9a64-26732f9fe381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.625773 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f624b9f-f4a5-465b-9a64-26732f9fe381 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:16.630458 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fced46-7110-4807-a88e-a7ba6884c69f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:16.635735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62924c24-7ecc-42a3-92c1-ea7353cac999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:16.636344 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62924c24-7ecc-42a3-92c1-ea7353cac999 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.636629 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62924c24-7ecc-42a3-92c1-ea7353cac999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.636936 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62924c24-7ecc-42a3-92c1-ea7353cac999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.640419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 918/1847] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:16.640559 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62924c24-7ecc-42a3-92c1-ea7353cac999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.640559 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62924c24-7ecc-42a3-92c1-ea7353cac999 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:16.641558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f624b9f-f4a5-465b-9a64-26732f9fe381 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:16.649785 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 930/1848] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:16.651924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f624b9f-f4a5-465b-9a64-26732f9fe381 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:16.654144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62924c24-7ecc-42a3-92c1-ea7353cac999 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:16.656496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4cd90-14c3-42e6-b117-ca8f2da6416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:16.657147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4cd90-14c3-42e6-b117-ca8f2da6416e admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.657432 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4cd90-14c3-42e6-b117-ca8f2da6416e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.657715 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4cd90-14c3-42e6-b117-ca8f2da6416e admin admin] PATH_INFO: `/v3/projects/fa9cfa811ed141bea1e00e4febd9a3f6/users/36d46dc94fe4419e8a357687e4095769/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.663951 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62924c24-7ecc-42a3-92c1-ea7353cac999 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:16.668724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6a3b8-4cf2-40e1-9fdd-f6cc721b8b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:16.669248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6a3b8-4cf2-40e1-9fdd-f6cc721b8b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.669539 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6a3b8-4cf2-40e1-9fdd-f6cc721b8b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.669820 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6a3b8-4cf2-40e1-9fdd-f6cc721b8b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.670587 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6a3b8-4cf2-40e1-9fdd-f6cc721b8b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.672182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6a3b8-4cf2-40e1-9fdd-f6cc721b8b0f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:16.672376 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4cd90-14c3-42e6-b117-ca8f2da6416e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9cfa811ed141bea1e00e4febd9a3f6, user_id=36d46dc94fe4419e8a357687e4095769, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.675039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4cd90-14c3-42e6-b117-ca8f2da6416e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:16.687284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 931/1849] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:16.688248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 919/1850] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:16 2022] PUT /identity/v3/projects/fa9cfa811ed141bea1e00e4febd9a3f6/users/36d46dc94fe4419e8a357687e4095769/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:16.688596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6a3b8-4cf2-40e1-9fdd-f6cc721b8b0f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:16.698864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d663c-07b6-41e4-9017-f493793ea715 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.699152 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d663c-07b6-41e4-9017-f493793ea715 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.699360 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6a3b8-4cf2-40e1-9fdd-f6cc721b8b0f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:16.699481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d663c-07b6-41e4-9017-f493793ea715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.728184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-796d663c-07b6-41e4-9017-f493793ea715 None None] MFA Rules not processed for user `36d46dc94fe4419e8a357687e4095769`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:16.729443 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-796d663c-07b6-41e4-9017-f493793ea715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:16.758503 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a065e6-1eec-4c8c-a2a5-f0b25b3a612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:16.759117 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a065e6-1eec-4c8c-a2a5-f0b25b3a612d admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.759404 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a065e6-1eec-4c8c-a2a5-f0b25b3a612d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.759761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a065e6-1eec-4c8c-a2a5-f0b25b3a612d admin admin] PATH_INFO: `/v3/projects/a44ffe5d6970438babe53755951a84b0/users/ff6ece82d1b541f0aaec1438d7f58813/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.764381 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:16.775019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a065e6-1eec-4c8c-a2a5-f0b25b3a612d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44ffe5d6970438babe53755951a84b0, user_id=ff6ece82d1b541f0aaec1438d7f58813, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.778246 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a065e6-1eec-4c8c-a2a5-f0b25b3a612d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:16.792188 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 932/1851] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:16 2022] PUT /identity/v3/projects/a44ffe5d6970438babe53755951a84b0/users/ff6ece82d1b541f0aaec1438d7f58813/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:16.804986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 920/1852] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:16.805831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad5dcb-7551-43ce-9d27-f5150eea6657 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.805831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad5dcb-7551-43ce-9d27-f5150eea6657 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.805831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad5dcb-7551-43ce-9d27-f5150eea6657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.806192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d663c-07b6-41e4-9017-f493793ea715 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:16.817376 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d663c-07b6-41e4-9017-f493793ea715 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:16.833369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-20ad5dcb-7551-43ce-9d27-f5150eea6657 None None] MFA Rules not processed for user `ff6ece82d1b541f0aaec1438d7f58813`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:16.834592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-20ad5dcb-7551-43ce-9d27-f5150eea6657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:16.878878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159396fc-ac5e-4cea-8201-15c4449bae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:16.879457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159396fc-ac5e-4cea-8201-15c4449bae2f admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.879750 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159396fc-ac5e-4cea-8201-15c4449bae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.880030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159396fc-ac5e-4cea-8201-15c4449bae2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.880721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159396fc-ac5e-4cea-8201-15c4449bae2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.882642 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159396fc-ac5e-4cea-8201-15c4449bae2f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:16.902168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 933/1853] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:16.907166 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad5dcb-7551-43ce-9d27-f5150eea6657 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:16.916042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 921/1854] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:16 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:16.916996 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159396fc-ac5e-4cea-8201-15c4449bae2f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:16.920480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad5dcb-7551-43ce-9d27-f5150eea6657 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:16.956632 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:16.981411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159396fc-ac5e-4cea-8201-15c4449bae2f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:16.983109 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bebb8-28e0-4337-b6a9-57234898bb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:16.983736 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bebb8-28e0-4337-b6a9-57234898bb33 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.984009 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bebb8-28e0-4337-b6a9-57234898bb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.984278 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bebb8-28e0-4337-b6a9-57234898bb33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.984930 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bebb8-28e0-4337-b6a9-57234898bb33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.986011 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87659649-d60f-4ffe-b129-21f6f837d06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:16.986660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87659649-d60f-4ffe-b129-21f6f837d06c admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:16.986860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bebb8-28e0-4337-b6a9-57234898bb33 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:16.986962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87659649-d60f-4ffe-b129-21f6f837d06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:16.987202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87659649-d60f-4ffe-b129-21f6f837d06c admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:16.987859 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87659649-d60f-4ffe-b129-21f6f837d06c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:16.989750 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87659649-d60f-4ffe-b129-21f6f837d06c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:17.012798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 922/1855] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:16 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:26:17.018142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 934/1856] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:16 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:26:17.018299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87659649-d60f-4ffe-b129-21f6f837d06c admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:17.019160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bebb8-28e0-4337-b6a9-57234898bb33 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:17.030169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87659649-d60f-4ffe-b129-21f6f837d06c admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:17.089779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:17.109813 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757e1ca-bf61-4802-aa15-8acb9c81f008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:17.110035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bebb8-28e0-4337-b6a9-57234898bb33 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:17.110984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757e1ca-bf61-4802-aa15-8acb9c81f008 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:17.111692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757e1ca-bf61-4802-aa15-8acb9c81f008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:17.112146 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757e1ca-bf61-4802-aa15-8acb9c81f008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:17.113054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757e1ca-bf61-4802-aa15-8acb9c81f008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:17.115029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757e1ca-bf61-4802-aa15-8acb9c81f008 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:17.116077 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ab898-46a6-4224-be54-c80ac60e25d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:17.116959 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ab898-46a6-4224-be54-c80ac60e25d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:17.117442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ab898-46a6-4224-be54-c80ac60e25d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:17.118150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ab898-46a6-4224-be54-c80ac60e25d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:17.119649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ab898-46a6-4224-be54-c80ac60e25d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:17.121387 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ab898-46a6-4224-be54-c80ac60e25d5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:17.128378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 923/1857] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:17.132389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757e1ca-bf61-4802-aa15-8acb9c81f008 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:17.150781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 935/1858] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:17 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:17.152454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ab898-46a6-4224-be54-c80ac60e25d5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:17.153403 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757e1ca-bf61-4802-aa15-8acb9c81f008 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:17.158239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bc69a-e0fd-4f9a-a3f5-e32339da216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:17.159293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bc69a-e0fd-4f9a-a3f5-e32339da216d admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:17.159451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bc69a-e0fd-4f9a-a3f5-e32339da216d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:17.159801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bc69a-e0fd-4f9a-a3f5-e32339da216d admin admin] PATH_INFO: `/v3/projects/5ccf913c01d94171802ef1da69ab4c66/users/4156c88f3dfb4f15bc4e07c4026e0803/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:17.163839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ab898-46a6-4224-be54-c80ac60e25d5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:17.172573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f656cf8-c0ba-497a-9231-ccf37a59efc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:17.173433 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f656cf8-c0ba-497a-9231-ccf37a59efc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:17.173823 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f656cf8-c0ba-497a-9231-ccf37a59efc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:17.174184 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f656cf8-c0ba-497a-9231-ccf37a59efc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:17.175029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f656cf8-c0ba-497a-9231-ccf37a59efc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:17.177157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f656cf8-c0ba-497a-9231-ccf37a59efc6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:17.180458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bc69a-e0fd-4f9a-a3f5-e32339da216d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccf913c01d94171802ef1da69ab4c66, user_id=4156c88f3dfb4f15bc4e07c4026e0803, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:17.183741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bc69a-e0fd-4f9a-a3f5-e32339da216d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:17.190027 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 936/1859] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:17.194772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f656cf8-c0ba-497a-9231-ccf37a59efc6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:17.200880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 924/1860] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:17 2022] PUT /identity/v3/projects/5ccf913c01d94171802ef1da69ab4c66/users/4156c88f3dfb4f15bc4e07c4026e0803/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:17.204864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bc69a-e0fd-4f9a-a3f5-e32339da216d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:17.208348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f656cf8-c0ba-497a-9231-ccf37a59efc6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:17.277107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ba5cd-c82a-46dc-ad07-f8efc3476cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:17.277107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ba5cd-c82a-46dc-ad07-f8efc3476cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:17.277107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ba5cd-c82a-46dc-ad07-f8efc3476cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:17.277107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ba5cd-c82a-46dc-ad07-f8efc3476cb1 admin admin] PATH_INFO: `/v3/projects/ddb8e1ca60634f8ea482e93acb7e25d6/users/1b8c62464ce14ecdb0856ec84f86e03e/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:17.291576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ba5cd-c82a-46dc-ad07-f8efc3476cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb8e1ca60634f8ea482e93acb7e25d6, user_id=1b8c62464ce14ecdb0856ec84f86e03e, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:17.294355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ba5cd-c82a-46dc-ad07-f8efc3476cb1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:17.303070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bc69a-e0fd-4f9a-a3f5-e32339da216d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:17.309111 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 937/1861] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:17 2022] PUT /identity/v3/projects/ddb8e1ca60634f8ea482e93acb7e25d6/users/1b8c62464ce14ecdb0856ec84f86e03e/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:17.312798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ba5cd-c82a-46dc-ad07-f8efc3476cb1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:17.351722 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:17.385713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5705f-fdbb-4925-9699-722849c485b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:17.386357 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5705f-fdbb-4925-9699-722849c485b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:17.386805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5705f-fdbb-4925-9699-722849c485b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:17.387073 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5705f-fdbb-4925-9699-722849c485b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:17.387697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5705f-fdbb-4925-9699-722849c485b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:17.389298 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5705f-fdbb-4925-9699-722849c485b6 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:17.399146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ba5cd-c82a-46dc-ad07-f8efc3476cb1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:17.402471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 925/1862] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:17.406262 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5705f-fdbb-4925-9699-722849c485b6 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:17.407327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d994a38-cd6c-480b-bf45-35f440882216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:17.408323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d994a38-cd6c-480b-bf45-35f440882216 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:17.408685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d994a38-cd6c-480b-bf45-35f440882216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:17.409221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d994a38-cd6c-480b-bf45-35f440882216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:17.410083 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d994a38-cd6c-480b-bf45-35f440882216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:17.412254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d994a38-cd6c-480b-bf45-35f440882216 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:17.420715 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5705f-fdbb-4925-9699-722849c485b6 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:17.426143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f827a0-8757-47c1-abbb-4b1e07aed10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:17.426711 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f827a0-8757-47c1-abbb-4b1e07aed10e admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:17.427002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f827a0-8757-47c1-abbb-4b1e07aed10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:17.427282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f827a0-8757-47c1-abbb-4b1e07aed10e admin admin] PATH_INFO: `/v3/projects/5ccf913c01d94171802ef1da69ab4c66/users/4156c88f3dfb4f15bc4e07c4026e0803/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:17.429520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f827a0-8757-47c1-abbb-4b1e07aed10e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccf913c01d94171802ef1da69ab4c66, user_id=4156c88f3dfb4f15bc4e07c4026e0803, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:17.430679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 938/1863] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:17.432878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f827a0-8757-47c1-abbb-4b1e07aed10e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:17.433099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d994a38-cd6c-480b-bf45-35f440882216 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:17.445145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 926/1864] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:17 2022] PUT /identity/v3/projects/5ccf913c01d94171802ef1da69ab4c66/users/4156c88f3dfb4f15bc4e07c4026e0803/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:17.454613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d994a38-cd6c-480b-bf45-35f440882216 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:17.458308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316801a-6052-4a51-a736-c5b7d642a67f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:17.458707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316801a-6052-4a51-a736-c5b7d642a67f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:17.459050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316801a-6052-4a51-a736-c5b7d642a67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:17.500411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-e316801a-6052-4a51-a736-c5b7d642a67f None None] MFA Rules not processed for user `4156c88f3dfb4f15bc4e07c4026e0803`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:17.501734 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e316801a-6052-4a51-a736-c5b7d642a67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:17.530259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3459740-ab01-46ce-86c3-eccea8998f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:17.532293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459740-ab01-46ce-86c3-eccea8998f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:17.533038 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459740-ab01-46ce-86c3-eccea8998f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:17.533387 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459740-ab01-46ce-86c3-eccea8998f67 admin admin] PATH_INFO: `/v3/projects/ddb8e1ca60634f8ea482e93acb7e25d6/users/1b8c62464ce14ecdb0856ec84f86e03e/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:17.535714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3459740-ab01-46ce-86c3-eccea8998f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb8e1ca60634f8ea482e93acb7e25d6, user_id=1b8c62464ce14ecdb0856ec84f86e03e, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:17.538941 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3459740-ab01-46ce-86c3-eccea8998f67 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:17.559923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:17.562145 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 939/1865] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:17 2022] PUT /identity/v3/projects/ddb8e1ca60634f8ea482e93acb7e25d6/users/1b8c62464ce14ecdb0856ec84f86e03e/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:17.572785 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189f57-5a38-4cda-bc70-7c0f9ad977b4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:17.573082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189f57-5a38-4cda-bc70-7c0f9ad977b4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:17.573363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189f57-5a38-4cda-bc70-7c0f9ad977b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:17.597016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 927/1866] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:17.604287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-15189f57-5a38-4cda-bc70-7c0f9ad977b4 None None] MFA Rules not processed for user `1b8c62464ce14ecdb0856ec84f86e03e`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:17.605384 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-15189f57-5a38-4cda-bc70-7c0f9ad977b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:17.611050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316801a-6052-4a51-a736-c5b7d642a67f None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:17.612598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e316801a-6052-4a51-a736-c5b7d642a67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:17.678701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316801a-6052-4a51-a736-c5b7d642a67f None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:17.716567 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 940/1867] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:17.764682 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e476fea-fc7f-4f58-afce-8e83601dc122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:17.765352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e476fea-fc7f-4f58-afce-8e83601dc122 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:17.765632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e476fea-fc7f-4f58-afce-8e83601dc122 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:17.765939 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e476fea-fc7f-4f58-afce-8e83601dc122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:17.832281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e476fea-fc7f-4f58-afce-8e83601dc122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:17.834112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e476fea-fc7f-4f58-afce-8e83601dc122 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:17.839421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15189f57-5a38-4cda-bc70-7c0f9ad977b4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:17.840852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-15189f57-5a38-4cda-bc70-7c0f9ad977b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:17.844637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 928/1868] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:26:17.845445 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e476fea-fc7f-4f58-afce-8e83601dc122 service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:17.846945 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4e476fea-fc7f-4f58-afce-8e83601dc122 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:17.860884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e476fea-fc7f-4f58-afce-8e83601dc122 service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:17.865976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69f9f9-f51b-4693-8901-99e4ee87b2a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:17.866621 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69f9f9-f51b-4693-8901-99e4ee87b2a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:17.866905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69f9f9-f51b-4693-8901-99e4ee87b2a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:17.867181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69f9f9-f51b-4693-8901-99e4ee87b2a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:17.879846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69f9f9-f51b-4693-8901-99e4ee87b2a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:17.881260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69f9f9-f51b-4693-8901-99e4ee87b2a5 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:17.893264 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 929/1869] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:17.897363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:17.922436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15189f57-5a38-4cda-bc70-7c0f9ad977b4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:17.927635 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e1b29-f5b6-4800-a123-579a99cbd787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:17.928523 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1b29-f5b6-4800-a123-579a99cbd787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:17.929020 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1b29-f5b6-4800-a123-579a99cbd787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:17.929304 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1b29-f5b6-4800-a123-579a99cbd787 admin admin] PATH_INFO: `/v3/users/3deafec718a04e489782ec5e250a3622` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:17.930582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e1b29-f5b6-4800-a123-579a99cbd787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3deafec718a04e489782ec5e250a3622)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:17.934978 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e1b29-f5b6-4800-a123-579a99cbd787 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:17.991431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d07e1b29-f5b6-4800-a123-579a99cbd787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3deafec718a04e489782ec5e250a3622'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:17.999172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d07e1b29-f5b6-4800-a123-579a99cbd787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3deafec718a04e489782ec5e250a3622'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:18.012872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d07e1b29-f5b6-4800-a123-579a99cbd787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3deafec718a04e489782ec5e250a3622'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:18.013557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d07e1b29-f5b6-4800-a123-579a99cbd787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3deafec718a04e489782ec5e250a3622'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:18.020701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d07e1b29-f5b6-4800-a123-579a99cbd787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3deafec718a04e489782ec5e250a3622'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:18.026849 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 941/1870] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:17 2022] DELETE /identity/v3/users/3deafec718a04e489782ec5e250a3622 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:18.031843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22946fe7-71ff-48d6-acd5-f9e2a6b0f556 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:18.032265 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22946fe7-71ff-48d6-acd5-f9e2a6b0f556 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:18.032618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22946fe7-71ff-48d6-acd5-f9e2a6b0f556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:18.054850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-22946fe7-71ff-48d6-acd5-f9e2a6b0f556 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:18.056148 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-22946fe7-71ff-48d6-acd5-f9e2a6b0f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:18.085399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:18.126753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 930/1871] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:18.136638 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e1b29-f5b6-4800-a123-579a99cbd787 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:18.138070 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d07e1b29-f5b6-4800-a123-579a99cbd787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:18.188695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22946fe7-71ff-48d6-acd5-f9e2a6b0f556 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:18.190083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-22946fe7-71ff-48d6-acd5-f9e2a6b0f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:18.212031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e1b29-f5b6-4800-a123-579a99cbd787 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:18.216206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a716c9-900c-4806-b7df-0050abcaf232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:18.216830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a716c9-900c-4806-b7df-0050abcaf232 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:18.217135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a716c9-900c-4806-b7df-0050abcaf232 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:18.217414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a716c9-900c-4806-b7df-0050abcaf232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:18.226913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a716c9-900c-4806-b7df-0050abcaf232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:18.228891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a716c9-900c-4806-b7df-0050abcaf232 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:18.239482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 942/1872] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:18.266965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22946fe7-71ff-48d6-acd5-f9e2a6b0f556 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:18.272383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261e554-448f-4fe6-aac1-b2f1fcf20ea6 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4156c88f3dfb4f15bc4e07c4026e0803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccf913c01d94171802ef1da69ab4c66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:18.273040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e554-448f-4fe6-aac1-b2f1fcf20ea6 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:18.273329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e554-448f-4fe6-aac1-b2f1fcf20ea6 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:18.273608 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e554-448f-4fe6-aac1-b2f1fcf20ea6 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:18.274313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261e554-448f-4fe6-aac1-b2f1fcf20ea6 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:18.274705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261e554-448f-4fe6-aac1-b2f1fcf20ea6 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:18.277040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261e554-448f-4fe6-aac1-b2f1fcf20ea6 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:18.293307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 931/1873] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:26:18.294377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a716c9-900c-4806-b7df-0050abcaf232 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:18.306804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a716c9-900c-4806-b7df-0050abcaf232 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:18.312641 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2227fb2-c773-4fab-bbdd-cac6d59a7221 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4156c88f3dfb4f15bc4e07c4026e0803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccf913c01d94171802ef1da69ab4c66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:18.313285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2227fb2-c773-4fab-bbdd-cac6d59a7221 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:18.313574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2227fb2-c773-4fab-bbdd-cac6d59a7221 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:18.313853 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2227fb2-c773-4fab-bbdd-cac6d59a7221 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:18.314725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2227fb2-c773-4fab-bbdd-cac6d59a7221 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:18.317204 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2227fb2-c773-4fab-bbdd-cac6d59a7221 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:18.354548 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 943/1874] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:18 2022] POST /identity/v3/projects => generated 353 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:18.358745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261e554-448f-4fe6-aac1-b2f1fcf20ea6 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:18.370242 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261e554-448f-4fe6-aac1-b2f1fcf20ea6 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:18.442536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682f729-735f-4b33-8037-90f385c7cd06 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4156c88f3dfb4f15bc4e07c4026e0803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccf913c01d94171802ef1da69ab4c66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:18.443177 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682f729-735f-4b33-8037-90f385c7cd06 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:18.443449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682f729-735f-4b33-8037-90f385c7cd06 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:18.443728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682f729-735f-4b33-8037-90f385c7cd06 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:18.444431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682f729-735f-4b33-8037-90f385c7cd06 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:18.444792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682f729-735f-4b33-8037-90f385c7cd06 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:18.446388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682f729-735f-4b33-8037-90f385c7cd06 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:18.460486 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 932/1875] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:26:18.527879 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2227fb2-c773-4fab-bbdd-cac6d59a7221 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:18.539359 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2227fb2-c773-4fab-bbdd-cac6d59a7221 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:18.545226 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4156c88f3dfb4f15bc4e07c4026e0803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ccf913c01d94171802ef1da69ab4c66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:18.546305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:18.546305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:18.546535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] PATH_INFO: `/v3/projects/12e2e52a56be4eaebd6c40446fbc5121` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:18.547823 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] RBAC: Authorizing `identity:delete_project(project_id=12e2e52a56be4eaebd6c40446fbc5121)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:18.549834 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:18.600853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682f729-735f-4b33-8037-90f385c7cd06 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:18.604888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9682f729-735f-4b33-8037-90f385c7cd06 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:18.611425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:18.655496 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e2e52a56be4eaebd6c40446fbc5121', 'request_id': 'req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:18.667542 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e2e52a56be4eaebd6c40446fbc5121', 'request_id': 'req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:18.683747 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e2e52a56be4eaebd6c40446fbc5121', 'request_id': 'req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:18.709669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] The token cache is being invalidate because project 12e2e52a56be4eaebd6c40446fbc5121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:18.709964 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:18.711074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:18.712203 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682f729-735f-4b33-8037-90f385c7cd06 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:18.716951 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 944/1876] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:18 2022] DELETE /identity/v3/projects/12e2e52a56be4eaebd6c40446fbc5121 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:18.721567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:18.812657 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:18.813672 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:18.813975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:18.814344 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] PATH_INFO: `/v3/projects/7e29d99069de4a85be47f7c9165ae9bd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:18.815701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e29d99069de4a85be47f7c9165ae9bd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:18.817751 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:18.908327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e29d99069de4a85be47f7c9165ae9bd', 'request_id': 'req-0a620a7f-f161-4243-974a-bd24221464c1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:18.925795 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e29d99069de4a85be47f7c9165ae9bd', 'request_id': 'req-0a620a7f-f161-4243-974a-bd24221464c1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:18.943828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e29d99069de4a85be47f7c9165ae9bd', 'request_id': 'req-0a620a7f-f161-4243-974a-bd24221464c1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:18.970425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] The token cache is being invalidate because project 7e29d99069de4a85be47f7c9165ae9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:18.971314 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:18.973401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:18.976900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 933/1877] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:18 2022] DELETE /identity/v3/projects/7e29d99069de4a85be47f7c9165ae9bd => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:18.981728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:18.983742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:19.014277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b12ef-fd7e-4f16-860d-da4ea6d0f157 tempest-VolumeQuotaClassesTest-2117649330 tempest-VolumeQuotaClassesTest-2117649330-project-admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:19.016505 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:19.017897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:19.142372 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a620a7f-f161-4243-974a-bd24221464c1 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:19.144130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8129846-101c-452a-a966-a4bc8e0d8249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:19.144800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129846-101c-452a-a966-a4bc8e0d8249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:19.145076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129846-101c-452a-a966-a4bc8e0d8249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:19.145348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129846-101c-452a-a966-a4bc8e0d8249 admin admin] PATH_INFO: `/v3/users/44ac091758cf4ac886f778553c73aaca` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:19.148081 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8129846-101c-452a-a966-a4bc8e0d8249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ac091758cf4ac886f778553c73aaca)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:19.150579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8129846-101c-452a-a966-a4bc8e0d8249 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:19.155919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4efb9-7b3a-405e-a0c0-11c366944556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:19.156583 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4efb9-7b3a-405e-a0c0-11c366944556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:19.157004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4efb9-7b3a-405e-a0c0-11c366944556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:19.157298 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4efb9-7b3a-405e-a0c0-11c366944556 admin admin] PATH_INFO: `/v3/users/36d46dc94fe4419e8a357687e4095769` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:19.169662 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4efb9-7b3a-405e-a0c0-11c366944556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d46dc94fe4419e8a357687e4095769)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:19.172305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4efb9-7b3a-405e-a0c0-11c366944556 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:19.281932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:19.289715 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d8129846-101c-452a-a966-a4bc8e0d8249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ac091758cf4ac886f778553c73aaca'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:19.299870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-68c4efb9-7b3a-405e-a0c0-11c366944556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d46dc94fe4419e8a357687e4095769'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:19.314297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d8129846-101c-452a-a966-a4bc8e0d8249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ac091758cf4ac886f778553c73aaca'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:19.326971 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-68c4efb9-7b3a-405e-a0c0-11c366944556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d46dc94fe4419e8a357687e4095769'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:19.350938 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-68c4efb9-7b3a-405e-a0c0-11c366944556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d46dc94fe4419e8a357687e4095769'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:19.353777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-68c4efb9-7b3a-405e-a0c0-11c366944556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d46dc94fe4419e8a357687e4095769'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:19.355207 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d8129846-101c-452a-a966-a4bc8e0d8249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ac091758cf4ac886f778553c73aaca'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:19.356800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d8129846-101c-452a-a966-a4bc8e0d8249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ac091758cf4ac886f778553c73aaca'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:19.372099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d8129846-101c-452a-a966-a4bc8e0d8249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ac091758cf4ac886f778553c73aaca'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:19.381354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-68c4efb9-7b3a-405e-a0c0-11c366944556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d46dc94fe4419e8a357687e4095769'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:19.390504 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 945/1878] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:18 2022] DELETE /identity/v3/users/44ac091758cf4ac886f778553c73aaca => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:19.394659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 934/1879] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:19 2022] DELETE /identity/v3/users/36d46dc94fe4419e8a357687e4095769 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:19.399106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7cbf1-6ac5-4263-b4f6-6c2273d98213 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:19.399637 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7cbf1-6ac5-4263-b4f6-6c2273d98213 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:19.400013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7cbf1-6ac5-4263-b4f6-6c2273d98213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:19.441142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-94c7cbf1-6ac5-4263-b4f6-6c2273d98213 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:19.442835 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-94c7cbf1-6ac5-4263-b4f6-6c2273d98213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:19.507843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:19.576841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 946/1880] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:19.702826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4efb9-7b3a-405e-a0c0-11c366944556 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:19.704658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-68c4efb9-7b3a-405e-a0c0-11c366944556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:19.726569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7cbf1-6ac5-4263-b4f6-6c2273d98213 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:19.727871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-94c7cbf1-6ac5-4263-b4f6-6c2273d98213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:19.836490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7cbf1-6ac5-4263-b4f6-6c2273d98213 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:19.857270 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4e42-ab18-49d5-acca-958627dbe94c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:19.858262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4e42-ab18-49d5-acca-958627dbe94c service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:19.858710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4e42-ab18-49d5-acca-958627dbe94c service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:19.859153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b4e42-ab18-49d5-acca-958627dbe94c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:19.866550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4efb9-7b3a-405e-a0c0-11c366944556 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:19.875751 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b40c4a-c0a8-422b-bf11-491042c989ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:19.876572 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b40c4a-c0a8-422b-bf11-491042c989ae service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:19.877403 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b40c4a-c0a8-422b-bf11-491042c989ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:19.877686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b40c4a-c0a8-422b-bf11-491042c989ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:19.879623 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-02b40c4a-c0a8-422b-bf11-491042c989ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:19.881287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b4e42-ab18-49d5-acca-958627dbe94c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:19.883431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b4e42-ab18-49d5-acca-958627dbe94c service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:19.902596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 947/1881] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:19.973632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b40c4a-c0a8-422b-bf11-491042c989ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:19.975223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b40c4a-c0a8-422b-bf11-491042c989ae service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:19.985962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 935/1882] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:20.543497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4e42-ab18-49d5-acca-958627dbe94c service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:20.545023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8d0b4e42-ab18-49d5-acca-958627dbe94c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:20.559155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b4e42-ab18-49d5-acca-958627dbe94c service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:20.566301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b3419-fd8c-482d-825a-0decf95490d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:20.567391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b3419-fd8c-482d-825a-0decf95490d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:20.567698 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b3419-fd8c-482d-825a-0decf95490d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:20.568075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b3419-fd8c-482d-825a-0decf95490d5 admin admin] PATH_INFO: `/v3/projects/1a1c76c36e5643ae9d6c2678fef6103b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:20.569165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b3419-fd8c-482d-825a-0decf95490d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1c76c36e5643ae9d6c2678fef6103b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:20.571488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b3419-fd8c-482d-825a-0decf95490d5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:20.624953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-674b3419-fd8c-482d-825a-0decf95490d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1c76c36e5643ae9d6c2678fef6103b', 'request_id': 'req-674b3419-fd8c-482d-825a-0decf95490d5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:20.631782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-674b3419-fd8c-482d-825a-0decf95490d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1c76c36e5643ae9d6c2678fef6103b', 'request_id': 'req-674b3419-fd8c-482d-825a-0decf95490d5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:20.640222 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-674b3419-fd8c-482d-825a-0decf95490d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1c76c36e5643ae9d6c2678fef6103b', 'request_id': 'req-674b3419-fd8c-482d-825a-0decf95490d5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:20.652350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-674b3419-fd8c-482d-825a-0decf95490d5 admin admin] The token cache is being invalidate because project 1a1c76c36e5643ae9d6c2678fef6103b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:20.652642 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-674b3419-fd8c-482d-825a-0decf95490d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:20.653306 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-674b3419-fd8c-482d-825a-0decf95490d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:20.654889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 948/1883] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:20 2022] DELETE /identity/v3/projects/1a1c76c36e5643ae9d6c2678fef6103b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:20.660963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514381-5b7b-4314-8220-5f3b0a2ecdc0 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:20.661252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514381-5b7b-4314-8220-5f3b0a2ecdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:20.661531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514381-5b7b-4314-8220-5f3b0a2ecdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:20.686848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a6514381-5b7b-4314-8220-5f3b0a2ecdc0 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:20.688146 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a6514381-5b7b-4314-8220-5f3b0a2ecdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:20.776185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 936/1884] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:20.783945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec95ca7-24ba-4e85-afc7-4fd311f44294 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:20.784324 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec95ca7-24ba-4e85-afc7-4fd311f44294 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:20.784583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec95ca7-24ba-4e85-afc7-4fd311f44294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:20.805096 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-eec95ca7-24ba-4e85-afc7-4fd311f44294 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:20.806833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-eec95ca7-24ba-4e85-afc7-4fd311f44294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:20.815897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 949/1885] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:20.819670 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6514381-5b7b-4314-8220-5f3b0a2ecdc0 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:20.840337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6514381-5b7b-4314-8220-5f3b0a2ecdc0 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:20.846753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac900db5-cb3f-4b8c-bf82-674fde551c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:20.847710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac900db5-cb3f-4b8c-bf82-674fde551c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:20.848048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac900db5-cb3f-4b8c-bf82-674fde551c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:20.848332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac900db5-cb3f-4b8c-bf82-674fde551c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:20.849614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac900db5-cb3f-4b8c-bf82-674fde551c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:20.849995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac900db5-cb3f-4b8c-bf82-674fde551c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:20.852336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac900db5-cb3f-4b8c-bf82-674fde551c1d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:20.878645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:20.890156 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 937/1886] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:26:20.891679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec95ca7-24ba-4e85-afc7-4fd311f44294 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:20.902459 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec95ca7-24ba-4e85-afc7-4fd311f44294 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:20.907856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6688b47-4711-4cc0-8e76-26c2bc011389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:20.908346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6688b47-4711-4cc0-8e76-26c2bc011389 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:20.908694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6688b47-4711-4cc0-8e76-26c2bc011389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:20.909034 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6688b47-4711-4cc0-8e76-26c2bc011389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:20.909778 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6688b47-4711-4cc0-8e76-26c2bc011389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:20.912233 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6688b47-4711-4cc0-8e76-26c2bc011389 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:20.946757 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 950/1887] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:20 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:20.948473 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac900db5-cb3f-4b8c-bf82-674fde551c1d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:20.959632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac900db5-cb3f-4b8c-bf82-674fde551c1d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:21.034743 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cf896-0742-428f-b8d0-8f8428453f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:21.035391 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cf896-0742-428f-b8d0-8f8428453f72 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:21.035662 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cf896-0742-428f-b8d0-8f8428453f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:21.035941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cf896-0742-428f-b8d0-8f8428453f72 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:21.037251 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cf896-0742-428f-b8d0-8f8428453f72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:21.039352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cf896-0742-428f-b8d0-8f8428453f72 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:21.073099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 938/1888] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:20 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:21.074715 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6688b47-4711-4cc0-8e76-26c2bc011389 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:21.092163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6688b47-4711-4cc0-8e76-26c2bc011389 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:21.119392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d2323-7deb-4e70-aa04-7b30153a232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:21.123612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d2323-7deb-4e70-aa04-7b30153a232b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:21.123612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d2323-7deb-4e70-aa04-7b30153a232b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:21.123612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d2323-7deb-4e70-aa04-7b30153a232b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:21.131496 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d2323-7deb-4e70-aa04-7b30153a232b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:21.133955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d2323-7deb-4e70-aa04-7b30153a232b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:21.150597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 951/1889] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:21.154272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cf896-0742-428f-b8d0-8f8428453f72 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:21.164845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cf896-0742-428f-b8d0-8f8428453f72 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:21.175898 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab9b47-586f-4b8f-8c6b-0fdcee760eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:21.177729 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab9b47-586f-4b8f-8c6b-0fdcee760eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:21.178020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab9b47-586f-4b8f-8c6b-0fdcee760eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:21.178598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab9b47-586f-4b8f-8c6b-0fdcee760eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:21.179070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab9b47-586f-4b8f-8c6b-0fdcee760eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:21.180705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab9b47-586f-4b8f-8c6b-0fdcee760eb8 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:21.197631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 939/1890] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:21.198911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d2323-7deb-4e70-aa04-7b30153a232b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:21.211605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d2323-7deb-4e70-aa04-7b30153a232b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:21.217225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967922da-aa9d-4788-a22e-71a93896be69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:21.218199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967922da-aa9d-4788-a22e-71a93896be69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:21.219357 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967922da-aa9d-4788-a22e-71a93896be69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:21.219357 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967922da-aa9d-4788-a22e-71a93896be69 admin admin] PATH_INFO: `/v3/projects/2e93c65e19a04b29aa5576b92035daf8/users/dd4f588c3e524072be9bf4a631f83140/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:21.227100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0debb83-23d1-48db-b02c-40bca253feb7 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:21.228859 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0debb83-23d1-48db-b02c-40bca253feb7 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:21.229134 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0debb83-23d1-48db-b02c-40bca253feb7 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:21.231366 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 940/1891] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 4 22:26:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:26:21.256998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967922da-aa9d-4788-a22e-71a93896be69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e93c65e19a04b29aa5576b92035daf8, user_id=dd4f588c3e524072be9bf4a631f83140, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:21.258300 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e090dd2-491d-455e-b375-d3561b6814d3 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:21.260115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e090dd2-491d-455e-b375-d3561b6814d3 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:21.261913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e090dd2-491d-455e-b375-d3561b6814d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:21.263349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967922da-aa9d-4788-a22e-71a93896be69 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:21.311415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-7e090dd2-491d-455e-b375-d3561b6814d3 None None] MFA Rules not processed for user `04899781f67746e193a05bdc004804cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:21.311415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7e090dd2-491d-455e-b375-d3561b6814d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:21.311588 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 952/1892] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:21 2022] PUT /identity/v3/projects/2e93c65e19a04b29aa5576b92035daf8/users/dd4f588c3e524072be9bf4a631f83140/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:21.313057 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc340e1d-0272-4154-9e5f-c391b92bbca6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:21.313352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc340e1d-0272-4154-9e5f-c391b92bbca6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:21.313749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc340e1d-0272-4154-9e5f-c391b92bbca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:21.323719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:21.367126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-fc340e1d-0272-4154-9e5f-c391b92bbca6 None None] MFA Rules not processed for user `dd4f588c3e524072be9bf4a631f83140`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:21.368620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fc340e1d-0272-4154-9e5f-c391b92bbca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:21.442061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 941/1893] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 4 22:26:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:21.510834 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 953/1894] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:21.510947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e090dd2-491d-455e-b375-d3561b6814d3 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:21.685165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc340e1d-0272-4154-9e5f-c391b92bbca6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:21.686691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fc340e1d-0272-4154-9e5f-c391b92bbca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:21.713359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e090dd2-491d-455e-b375-d3561b6814d3 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:21.719082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc340e1d-0272-4154-9e5f-c391b92bbca6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:21.724724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f60fa-57e8-4199-99ba-1d2be299330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:21.725943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f60fa-57e8-4199-99ba-1d2be299330e admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:21.726456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f60fa-57e8-4199-99ba-1d2be299330e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:21.727222 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f60fa-57e8-4199-99ba-1d2be299330e admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:21.732179 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f60fa-57e8-4199-99ba-1d2be299330e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:21.736902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f60fa-57e8-4199-99ba-1d2be299330e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:21.739004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d866d-884d-4e01-90d1-298c89791580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:21.741859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d866d-884d-4e01-90d1-298c89791580 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:21.742167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d866d-884d-4e01-90d1-298c89791580 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:21.743417 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d866d-884d-4e01-90d1-298c89791580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:21.760563 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d866d-884d-4e01-90d1-298c89791580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:21.762613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d866d-884d-4e01-90d1-298c89791580 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:21.779957 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 954/1895] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:21.784615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:21.811812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d866d-884d-4e01-90d1-298c89791580 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:21.812436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 942/1896] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:21 2022] POST /identity/v3/projects => generated 377 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:21.833695 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d866d-884d-4e01-90d1-298c89791580 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:21.851771 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f60fa-57e8-4199-99ba-1d2be299330e admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:21.854847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b19f60fa-57e8-4199-99ba-1d2be299330e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:21.995945 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f60fa-57e8-4199-99ba-1d2be299330e admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:22.001297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d06bdc-41c7-4b5c-8555-d5ae4abfd04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:22.001992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d06bdc-41c7-4b5c-8555-d5ae4abfd04c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:22.002342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d06bdc-41c7-4b5c-8555-d5ae4abfd04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:22.002658 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d06bdc-41c7-4b5c-8555-d5ae4abfd04c admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:22.002872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:22.003472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d06bdc-41c7-4b5c-8555-d5ae4abfd04c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:22.003577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:22.003797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:22.004077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] PATH_INFO: `/v3/projects/fa9cfa811ed141bea1e00e4febd9a3f6` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:22.005266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa9cfa811ed141bea1e00e4febd9a3f6)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:22.005576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d06bdc-41c7-4b5c-8555-d5ae4abfd04c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:22.007499 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:22.032852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 955/1897] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:21 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:26:22.037314 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d06bdc-41c7-4b5c-8555-d5ae4abfd04c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:22.055011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d06bdc-41c7-4b5c-8555-d5ae4abfd04c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:22.063514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b264-4b3b-4382-875d-694680974e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:22.065107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b264-4b3b-4382-875d-694680974e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:22.066182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b264-4b3b-4382-875d-694680974e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:22.066840 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b264-4b3b-4382-875d-694680974e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:22.067890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575b264-4b3b-4382-875d-694680974e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:22.070348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575b264-4b3b-4382-875d-694680974e3b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:22.076337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa9cfa811ed141bea1e00e4febd9a3f6', 'request_id': 'req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:22.088838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa9cfa811ed141bea1e00e4febd9a3f6', 'request_id': 'req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:22.092846 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 956/1898] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:22.095733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b264-4b3b-4382-875d-694680974e3b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:22.101406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa9cfa811ed141bea1e00e4febd9a3f6', 'request_id': 'req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:22.121838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b264-4b3b-4382-875d-694680974e3b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:22.121968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] The token cache is being invalidate because project fa9cfa811ed141bea1e00e4febd9a3f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:22.121968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:22.121968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:22.121968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 943/1899] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:21 2022] DELETE /identity/v3/projects/fa9cfa811ed141bea1e00e4febd9a3f6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:22.125254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:22.126726 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:22.206530 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6acb0-dc7f-41ce-8ff4-a865791d63ff admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:22.211952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9051c-1870-447d-8819-52621cc68340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:22.213740 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9051c-1870-447d-8819-52621cc68340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:22.214025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9051c-1870-447d-8819-52621cc68340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:22.214315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9051c-1870-447d-8819-52621cc68340 admin admin] PATH_INFO: `/v3/users/4156c88f3dfb4f15bc4e07c4026e0803` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:22.215984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9051c-1870-447d-8819-52621cc68340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4156c88f3dfb4f15bc4e07c4026e0803)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:22.218301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9051c-1870-447d-8819-52621cc68340 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:22.271445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17cc63-6293-4ab8-a2cf-ee4fcbc80105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:22.273046 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:22.273241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17cc63-6293-4ab8-a2cf-ee4fcbc80105 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:22.273527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17cc63-6293-4ab8-a2cf-ee4fcbc80105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:22.276189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17cc63-6293-4ab8-a2cf-ee4fcbc80105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:22.276924 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17cc63-6293-4ab8-a2cf-ee4fcbc80105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:22.279427 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17cc63-6293-4ab8-a2cf-ee4fcbc80105 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:22.281857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:22.303038 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 957/1900] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:22.307241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f0c9051c-1870-447d-8819-52621cc68340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4156c88f3dfb4f15bc4e07c4026e0803'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:22.307930 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17cc63-6293-4ab8-a2cf-ee4fcbc80105 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:22.310787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bf17cc63-6293-4ab8-a2cf-ee4fcbc80105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:22.317117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f0c9051c-1870-447d-8819-52621cc68340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4156c88f3dfb4f15bc4e07c4026e0803'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:22.327263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f0c9051c-1870-447d-8819-52621cc68340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4156c88f3dfb4f15bc4e07c4026e0803'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:22.328088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f0c9051c-1870-447d-8819-52621cc68340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4156c88f3dfb4f15bc4e07c4026e0803'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:22.328555 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17cc63-6293-4ab8-a2cf-ee4fcbc80105 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:22.335677 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3c992-4a32-4d46-aa01-e21cc8345512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:22.336556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c992-4a32-4d46-aa01-e21cc8345512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:22.336984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c992-4a32-4d46-aa01-e21cc8345512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:22.337405 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c992-4a32-4d46-aa01-e21cc8345512 admin admin] PATH_INFO: `/v3/projects/0d481a6520e74e0791cb07626d3c82e7/users/ffcf5a4d95c24475b93632569cd89584/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:22.351842 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f0c9051c-1870-447d-8819-52621cc68340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4156c88f3dfb4f15bc4e07c4026e0803'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:22.362627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 944/1901] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:22 2022] DELETE /identity/v3/users/4156c88f3dfb4f15bc4e07c4026e0803 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:22.368069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3c992-4a32-4d46-aa01-e21cc8345512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d481a6520e74e0791cb07626d3c82e7, user_id=ffcf5a4d95c24475b93632569cd89584, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:22.372404 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3c992-4a32-4d46-aa01-e21cc8345512 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:22.392112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 958/1902] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:22 2022] PUT /identity/v3/projects/0d481a6520e74e0791cb07626d3c82e7/users/ffcf5a4d95c24475b93632569cd89584/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:22.402226 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5a854-78ad-4618-81c6-cde7391c0785 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:22.402556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5a854-78ad-4618-81c6-cde7391c0785 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:22.402837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5a854-78ad-4618-81c6-cde7391c0785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:22.442541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-29e5a854-78ad-4618-81c6-cde7391c0785 None None] MFA Rules not processed for user `ffcf5a4d95c24475b93632569cd89584`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:22.443934 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-29e5a854-78ad-4618-81c6-cde7391c0785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:22.544718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 945/1903] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:22.545869 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3c992-4a32-4d46-aa01-e21cc8345512 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:22.548788 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-efb3c992-4a32-4d46-aa01-e21cc8345512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:22.653034 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3c992-4a32-4d46-aa01-e21cc8345512 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:22.659007 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b188c0-6f26-415a-87c8-b2165639261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:22.659825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b188c0-6f26-415a-87c8-b2165639261f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:22.660115 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b188c0-6f26-415a-87c8-b2165639261f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:22.660523 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b188c0-6f26-415a-87c8-b2165639261f admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:22.661408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b188c0-6f26-415a-87c8-b2165639261f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:22.663919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b188c0-6f26-415a-87c8-b2165639261f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:22.706667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 959/1904] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:22 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:22.712005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5a854-78ad-4618-81c6-cde7391c0785 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:22.727369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5a854-78ad-4618-81c6-cde7391c0785 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:22.805326 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b188c0-6f26-415a-87c8-b2165639261f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:22.808802 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a7b188c0-6f26-415a-87c8-b2165639261f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:22.832124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b35fb-50b1-41e9-be1f-956db399ef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:22.833222 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b35fb-50b1-41e9-be1f-956db399ef30 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:22.834027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b35fb-50b1-41e9-be1f-956db399ef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:22.834297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b35fb-50b1-41e9-be1f-956db399ef30 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:22.835053 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b35fb-50b1-41e9-be1f-956db399ef30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:22.840919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b35fb-50b1-41e9-be1f-956db399ef30 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:22.885423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 946/1905] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:22 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:22.889984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b35fb-50b1-41e9-be1f-956db399ef30 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:22.907019 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b35fb-50b1-41e9-be1f-956db399ef30 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:22.916176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2323d41-bf4a-47d4-a467-3e007f19bd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:22.917260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2323d41-bf4a-47d4-a467-3e007f19bd6b admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:22.917912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2323d41-bf4a-47d4-a467-3e007f19bd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:22.918530 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2323d41-bf4a-47d4-a467-3e007f19bd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:22.919631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2323d41-bf4a-47d4-a467-3e007f19bd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:22.922193 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b188c0-6f26-415a-87c8-b2165639261f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:22.924123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2323d41-bf4a-47d4-a467-3e007f19bd6b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:22.927525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d462469-174b-4d7f-ade1-f92dcab4100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:22.928278 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d462469-174b-4d7f-ade1-f92dcab4100e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:22.930760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d462469-174b-4d7f-ade1-f92dcab4100e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:22.931813 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d462469-174b-4d7f-ade1-f92dcab4100e admin admin] PATH_INFO: `/v3/projects/5ccf913c01d94171802ef1da69ab4c66` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:22.933565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d462469-174b-4d7f-ade1-f92dcab4100e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ccf913c01d94171802ef1da69ab4c66)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:22.936214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d462469-174b-4d7f-ade1-f92dcab4100e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:22.938293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 947/1906] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:22.942225 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2323d41-bf4a-47d4-a467-3e007f19bd6b admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:22.966533 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2323d41-bf4a-47d4-a467-3e007f19bd6b admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:22.980673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d384a-ad5c-411d-9918-ccfb5c373702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:22.980673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d384a-ad5c-411d-9918-ccfb5c373702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:22.980673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d384a-ad5c-411d-9918-ccfb5c373702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:22.980673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d384a-ad5c-411d-9918-ccfb5c373702 admin admin] PATH_INFO: `/v3/projects/a623dacbb6e04a19bf927e2ecf716baf/users/a2d4a20a051c49b69523f455cbf1ebd6/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:22.984668 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:23.001860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d384a-ad5c-411d-9918-ccfb5c373702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a623dacbb6e04a19bf927e2ecf716baf, user_id=a2d4a20a051c49b69523f455cbf1ebd6, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:23.012304 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d384a-ad5c-411d-9918-ccfb5c373702 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:23.014796 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9d462469-174b-4d7f-ade1-f92dcab4100e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ccf913c01d94171802ef1da69ab4c66', 'request_id': 'req-9d462469-174b-4d7f-ade1-f92dcab4100e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:23.022085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9d462469-174b-4d7f-ade1-f92dcab4100e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ccf913c01d94171802ef1da69ab4c66', 'request_id': 'req-9d462469-174b-4d7f-ade1-f92dcab4100e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:23.029555 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:23.033985 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9d462469-174b-4d7f-ade1-f92dcab4100e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ccf913c01d94171802ef1da69ab4c66', 'request_id': 'req-9d462469-174b-4d7f-ade1-f92dcab4100e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:23.045619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 948/1907] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:22 2022] PUT /identity/v3/projects/a623dacbb6e04a19bf927e2ecf716baf/users/a2d4a20a051c49b69523f455cbf1ebd6/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:23.049362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d384a-ad5c-411d-9918-ccfb5c373702 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:23.059773 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9d462469-174b-4d7f-ade1-f92dcab4100e admin admin] The token cache is being invalidate because project 5ccf913c01d94171802ef1da69ab4c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:23.060276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9d462469-174b-4d7f-ade1-f92dcab4100e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:23.062573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9d462469-174b-4d7f-ade1-f92dcab4100e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:23.064744 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 960/1908] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:22 2022] DELETE /identity/v3/projects/5ccf913c01d94171802ef1da69ab4c66 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:23.072787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d04ff-92d7-40da-a9c9-6e7dd5fa84dc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:23.073616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d04ff-92d7-40da-a9c9-6e7dd5fa84dc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:23.076154 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d04ff-92d7-40da-a9c9-6e7dd5fa84dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:23.116763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-320d04ff-92d7-40da-a9c9-6e7dd5fa84dc None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:23.116763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-320d04ff-92d7-40da-a9c9-6e7dd5fa84dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:23.209865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d384a-ad5c-411d-9918-ccfb5c373702 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:23.218891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134b5b0-13c7-4b90-8ed8-b844a524d170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:23.219543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134b5b0-13c7-4b90-8ed8-b844a524d170 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:23.219831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134b5b0-13c7-4b90-8ed8-b844a524d170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:23.220115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134b5b0-13c7-4b90-8ed8-b844a524d170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:23.221724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134b5b0-13c7-4b90-8ed8-b844a524d170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:23.223666 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134b5b0-13c7-4b90-8ed8-b844a524d170 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:23.254367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 949/1909] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:23.259076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134b5b0-13c7-4b90-8ed8-b844a524d170 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:23.261633 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3134b5b0-13c7-4b90-8ed8-b844a524d170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:23.270434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 961/1910] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:23.278393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f0109-50ee-46b4-b419-be6c5e573bde None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:23.278965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f0109-50ee-46b4-b419-be6c5e573bde None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:23.279400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f0109-50ee-46b4-b419-be6c5e573bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:23.288147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134b5b0-13c7-4b90-8ed8-b844a524d170 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:23.302366 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c45fb-4484-43a5-bbc6-f5e901b73566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:23.305407 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c45fb-4484-43a5-bbc6-f5e901b73566 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:23.306074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c45fb-4484-43a5-bbc6-f5e901b73566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:23.306707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c45fb-4484-43a5-bbc6-f5e901b73566 admin admin] PATH_INFO: `/v3/projects/a623dacbb6e04a19bf927e2ecf716baf/users/a2d4a20a051c49b69523f455cbf1ebd6/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:23.313277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c45fb-4484-43a5-bbc6-f5e901b73566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a623dacbb6e04a19bf927e2ecf716baf, user_id=a2d4a20a051c49b69523f455cbf1ebd6, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:23.316640 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-527f0109-50ee-46b4-b419-be6c5e573bde None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:23.318211 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c45fb-4484-43a5-bbc6-f5e901b73566 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:23.319770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-527f0109-50ee-46b4-b419-be6c5e573bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:23.333645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 962/1911] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:23.338239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f0109-50ee-46b4-b419-be6c5e573bde None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:23.354050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 950/1912] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:23 2022] PUT /identity/v3/projects/a623dacbb6e04a19bf927e2ecf716baf/users/a2d4a20a051c49b69523f455cbf1ebd6/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:23.356444 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c5ddf-be64-4395-b913-73cfdc90dd8f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:23.357387 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c5ddf-be64-4395-b913-73cfdc90dd8f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:23.357387 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c5ddf-be64-4395-b913-73cfdc90dd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:23.360955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f0109-50ee-46b4-b419-be6c5e573bde None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:23.428306 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-687c5ddf-be64-4395-b913-73cfdc90dd8f None None] MFA Rules not processed for user `a2d4a20a051c49b69523f455cbf1ebd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:23.429536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-687c5ddf-be64-4395-b913-73cfdc90dd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:23.496745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb58826-b067-40c5-9b36-0e7be017fbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:23.497388 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb58826-b067-40c5-9b36-0e7be017fbcc admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:23.497668 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb58826-b067-40c5-9b36-0e7be017fbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:23.498081 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb58826-b067-40c5-9b36-0e7be017fbcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:23.498835 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb58826-b067-40c5-9b36-0e7be017fbcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:23.499291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb58826-b067-40c5-9b36-0e7be017fbcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:23.500888 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb58826-b067-40c5-9b36-0e7be017fbcc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:23.518268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 951/1913] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:23.520347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 963/1914] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:26:23.527421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c5ddf-be64-4395-b913-73cfdc90dd8f None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:23.531922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb58826-b067-40c5-9b36-0e7be017fbcc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:23.534162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ebb58826-b067-40c5-9b36-0e7be017fbcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:23.539535 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c5ddf-be64-4395-b913-73cfdc90dd8f None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:23.545101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4087e-f07f-4f1a-ab24-bf66f5f100aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:23.545807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4087e-f07f-4f1a-ab24-bf66f5f100aa admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:23.546187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4087e-f07f-4f1a-ab24-bf66f5f100aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:23.546511 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4087e-f07f-4f1a-ab24-bf66f5f100aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:23.547556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4087e-f07f-4f1a-ab24-bf66f5f100aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:23.549274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4087e-f07f-4f1a-ab24-bf66f5f100aa admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:23.591266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 952/1915] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:23 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:23.597613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4087e-f07f-4f1a-ab24-bf66f5f100aa admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:23.626052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb58826-b067-40c5-9b36-0e7be017fbcc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:23.662058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:23.667805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:23.694641 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732807b-8e0e-4516-b6dd-3c8e8f0140b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:23.695267 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732807b-8e0e-4516-b6dd-3c8e8f0140b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:23.695548 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732807b-8e0e-4516-b6dd-3c8e8f0140b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:23.695820 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732807b-8e0e-4516-b6dd-3c8e8f0140b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:23.706099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4087e-f07f-4f1a-ab24-bf66f5f100aa admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:23.711605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3edb2-7379-4363-9057-34de746dcc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:23.712498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3edb2-7379-4363-9057-34de746dcc3d admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:23.712943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3edb2-7379-4363-9057-34de746dcc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:23.713377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3edb2-7379-4363-9057-34de746dcc3d admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:23.714227 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3edb2-7379-4363-9057-34de746dcc3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:23.716369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3edb2-7379-4363-9057-34de746dcc3d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:23.739919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 953/1916] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:23 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:23.744606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3edb2-7379-4363-9057-34de746dcc3d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:23.756014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3edb2-7379-4363-9057-34de746dcc3d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:23.762093 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45c89c-26ec-4341-98f5-9401adf15f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:23.762872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c89c-26ec-4341-98f5-9401adf15f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:23.763236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c89c-26ec-4341-98f5-9401adf15f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:23.763797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c89c-26ec-4341-98f5-9401adf15f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:23.764627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45c89c-26ec-4341-98f5-9401adf15f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:23.766588 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45c89c-26ec-4341-98f5-9401adf15f5c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:23.767824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732807b-8e0e-4516-b6dd-3c8e8f0140b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:23.769284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732807b-8e0e-4516-b6dd-3c8e8f0140b4 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:23.782449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 954/1917] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:23.782674 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 964/1918] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:23.785099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45c89c-26ec-4341-98f5-9401adf15f5c admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:23.807082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45c89c-26ec-4341-98f5-9401adf15f5c admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:23.812892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dda578-af6a-4ec8-a1bb-90e1d31b1364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:23.813520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dda578-af6a-4ec8-a1bb-90e1d31b1364 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:23.813796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dda578-af6a-4ec8-a1bb-90e1d31b1364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:23.814546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dda578-af6a-4ec8-a1bb-90e1d31b1364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:23.814795 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dda578-af6a-4ec8-a1bb-90e1d31b1364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:23.816358 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dda578-af6a-4ec8-a1bb-90e1d31b1364 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:23.829374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 955/1919] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:23.834103 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732807b-8e0e-4516-b6dd-3c8e8f0140b4 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:23.840166 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dda578-af6a-4ec8-a1bb-90e1d31b1364 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:23.842948 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-39dda578-af6a-4ec8-a1bb-90e1d31b1364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:23.847885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732807b-8e0e-4516-b6dd-3c8e8f0140b4 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:23.855238 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b02985-f5f7-433d-bad8-48914d539769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:23.856377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b02985-f5f7-433d-bad8-48914d539769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:23.856377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b02985-f5f7-433d-bad8-48914d539769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:23.856600 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b02985-f5f7-433d-bad8-48914d539769 admin admin] PATH_INFO: `/v3/projects/26b5be19c4ec40caa7033b27ff5e2b13/users/94925552736a477da6bb704d76bc3f91/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:23.866500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dda578-af6a-4ec8-a1bb-90e1d31b1364 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:23.874768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b02985-f5f7-433d-bad8-48914d539769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b5be19c4ec40caa7033b27ff5e2b13, user_id=94925552736a477da6bb704d76bc3f91, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:23.875923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdd4e2-50d1-4141-9fa8-a1b6629d273b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:23.876590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdd4e2-50d1-4141-9fa8-a1b6629d273b service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:23.876872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdd4e2-50d1-4141-9fa8-a1b6629d273b service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:23.877145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdd4e2-50d1-4141-9fa8-a1b6629d273b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:23.877446 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b02985-f5f7-433d-bad8-48914d539769 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:23.879010 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-32cdd4e2-50d1-4141-9fa8-a1b6629d273b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:23.891214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 965/1920] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:23 2022] PUT /identity/v3/projects/26b5be19c4ec40caa7033b27ff5e2b13/users/94925552736a477da6bb704d76bc3f91/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:23.901774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659ec35-372a-4e07-8f1d-3f437362b74e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:23.902082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659ec35-372a-4e07-8f1d-3f437362b74e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:23.902343 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659ec35-372a-4e07-8f1d-3f437362b74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:23.931899 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2659ec35-372a-4e07-8f1d-3f437362b74e None None] MFA Rules not processed for user `94925552736a477da6bb704d76bc3f91`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:23.933164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2659ec35-372a-4e07-8f1d-3f437362b74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:23.942121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdd4e2-50d1-4141-9fa8-a1b6629d273b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:23.943600 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdd4e2-50d1-4141-9fa8-a1b6629d273b service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:23.957798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 956/1921] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:24.025369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 966/1922] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:24.026622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdd4e2-50d1-4141-9fa8-a1b6629d273b service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:24.039106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdd4e2-50d1-4141-9fa8-a1b6629d273b service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:24.123553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce1cdf-f78c-4315-9135-b214a1401c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:24.123553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1cdf-f78c-4315-9135-b214a1401c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:24.123553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1cdf-f78c-4315-9135-b214a1401c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:24.123984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1cdf-f78c-4315-9135-b214a1401c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:24.125032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce1cdf-f78c-4315-9135-b214a1401c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:24.126993 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce1cdf-f78c-4315-9135-b214a1401c38 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:24.174033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 957/1923] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:24 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:26:24.179133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659ec35-372a-4e07-8f1d-3f437362b74e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:24.191226 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659ec35-372a-4e07-8f1d-3f437362b74e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:24.241023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:24.264729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab4461-13fc-44a4-997a-68b9165b3109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:24.265370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab4461-13fc-44a4-997a-68b9165b3109 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:24.265643 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab4461-13fc-44a4-997a-68b9165b3109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:24.265915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab4461-13fc-44a4-997a-68b9165b3109 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:24.266622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab4461-13fc-44a4-997a-68b9165b3109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:24.268659 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab4461-13fc-44a4-997a-68b9165b3109 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:24.319940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 967/1924] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:24 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:24.321718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce1cdf-f78c-4315-9135-b214a1401c38 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:24.336773 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce1cdf-f78c-4315-9135-b214a1401c38 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:24.350576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4be3a-9d2c-4e95-abbf-016be038c8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:24.351276 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4be3a-9d2c-4e95-abbf-016be038c8bc admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:24.351580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4be3a-9d2c-4e95-abbf-016be038c8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:24.351856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4be3a-9d2c-4e95-abbf-016be038c8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:24.352563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4be3a-9d2c-4e95-abbf-016be038c8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:24.367563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4be3a-9d2c-4e95-abbf-016be038c8bc admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:24.381176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 958/1925] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:24.386008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab4461-13fc-44a4-997a-68b9165b3109 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:24.397394 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab4461-13fc-44a4-997a-68b9165b3109 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:24.402191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bef39-6e16-495d-9a22-1342de1572fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:24.402891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bef39-6e16-495d-9a22-1342de1572fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:24.403176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bef39-6e16-495d-9a22-1342de1572fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:24.403452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bef39-6e16-495d-9a22-1342de1572fe admin admin] PATH_INFO: `/v3/projects/0e6e670d8def42759534a8a2da093894/users/390a72cbbb354e15a53ffce093979c08/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:24.421518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bef39-6e16-495d-9a22-1342de1572fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6e670d8def42759534a8a2da093894, user_id=390a72cbbb354e15a53ffce093979c08, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:24.424250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bef39-6e16-495d-9a22-1342de1572fe admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:24.442437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 968/1926] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:24 2022] PUT /identity/v3/projects/0e6e670d8def42759534a8a2da093894/users/390a72cbbb354e15a53ffce093979c08/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:24.444258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4be3a-9d2c-4e95-abbf-016be038c8bc admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:24.474142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4be3a-9d2c-4e95-abbf-016be038c8bc admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:24.484932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:24.542269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d726e6-e78f-4a34-8bbb-8041f10a4190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:24.543002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d726e6-e78f-4a34-8bbb-8041f10a4190 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:24.543264 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d726e6-e78f-4a34-8bbb-8041f10a4190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:24.543551 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d726e6-e78f-4a34-8bbb-8041f10a4190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:24.544384 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d726e6-e78f-4a34-8bbb-8041f10a4190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:24.546309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d726e6-e78f-4a34-8bbb-8041f10a4190 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:24.557994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 959/1927] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:24.562262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bef39-6e16-495d-9a22-1342de1572fe admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:24.589141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bef39-6e16-495d-9a22-1342de1572fe admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:24.594158 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a8d6f-c66e-4654-86c6-05da65e71168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:24.594941 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a8d6f-c66e-4654-86c6-05da65e71168 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:24.595291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a8d6f-c66e-4654-86c6-05da65e71168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:24.595785 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a8d6f-c66e-4654-86c6-05da65e71168 admin admin] PATH_INFO: `/v3/projects/0e6e670d8def42759534a8a2da093894/users/390a72cbbb354e15a53ffce093979c08/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:24.597740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a8d6f-c66e-4654-86c6-05da65e71168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6e670d8def42759534a8a2da093894, user_id=390a72cbbb354e15a53ffce093979c08, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:24.600522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a8d6f-c66e-4654-86c6-05da65e71168 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:24.612385 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 969/1928] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:24 2022] PUT /identity/v3/projects/0e6e670d8def42759534a8a2da093894/users/390a72cbbb354e15a53ffce093979c08/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:24.624183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd046f0-3f9b-420e-926b-c0c85f6482f0 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:24.624424 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd046f0-3f9b-420e-926b-c0c85f6482f0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:24.624710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd046f0-3f9b-420e-926b-c0c85f6482f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:24.659545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-0cd046f0-3f9b-420e-926b-c0c85f6482f0 None None] MFA Rules not processed for user `390a72cbbb354e15a53ffce093979c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:24.660916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0cd046f0-3f9b-420e-926b-c0c85f6482f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:24.667195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a8d6f-c66e-4654-86c6-05da65e71168 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:24.738672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a8d6f-c66e-4654-86c6-05da65e71168 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:24.739169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 960/1929] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:24.752606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa753180-0200-4f5d-8482-72d12512abff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:24.753241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa753180-0200-4f5d-8482-72d12512abff service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:24.753709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa753180-0200-4f5d-8482-72d12512abff service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:24.753977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa753180-0200-4f5d-8482-72d12512abff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:24.755471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd046f0-3f9b-420e-926b-c0c85f6482f0 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:24.755958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fa753180-0200-4f5d-8482-72d12512abff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:24.767162 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd046f0-3f9b-420e-926b-c0c85f6482f0 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:24.770884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88862b17-150c-4d15-ac0e-7563ef15fabf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:24.771586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88862b17-150c-4d15-ac0e-7563ef15fabf service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:24.771868 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88862b17-150c-4d15-ac0e-7563ef15fabf service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:24.772144 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88862b17-150c-4d15-ac0e-7563ef15fabf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:24.823260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa753180-0200-4f5d-8482-72d12512abff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:24.824963 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa753180-0200-4f5d-8482-72d12512abff service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:24.834691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 970/1930] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:26:24.837745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88862b17-150c-4d15-ac0e-7563ef15fabf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:24.839867 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88862b17-150c-4d15-ac0e-7563ef15fabf service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:24.850717 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 961/1931] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:27.299853 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa753180-0200-4f5d-8482-72d12512abff service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:27.301288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fa753180-0200-4f5d-8482-72d12512abff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:27.360180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:27.374944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa753180-0200-4f5d-8482-72d12512abff service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:27.380656 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afa999-a2f9-40bc-ae6a-949c17635c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:27.381561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afa999-a2f9-40bc-ae6a-949c17635c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:27.381997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afa999-a2f9-40bc-ae6a-949c17635c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:27.382456 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afa999-a2f9-40bc-ae6a-949c17635c99 admin admin] PATH_INFO: `/v3/users/54f3e43ae6bc4b6690d3d4fce137ce75` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:27.383845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afa999-a2f9-40bc-ae6a-949c17635c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f3e43ae6bc4b6690d3d4fce137ce75)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:27.385883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afa999-a2f9-40bc-ae6a-949c17635c99 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:27.415097 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88862b17-150c-4d15-ac0e-7563ef15fabf service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:27.428748 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88862b17-150c-4d15-ac0e-7563ef15fabf service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:27.435034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f15fbb-90e0-4279-911f-a14b31d68c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:27.435847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f15fbb-90e0-4279-911f-a14b31d68c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:27.436238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f15fbb-90e0-4279-911f-a14b31d68c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:27.436617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f15fbb-90e0-4279-911f-a14b31d68c48 admin admin] PATH_INFO: `/v3/users/94925552736a477da6bb704d76bc3f91` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:27.438628 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f15fbb-90e0-4279-911f-a14b31d68c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94925552736a477da6bb704d76bc3f91)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:27.441058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f15fbb-90e0-4279-911f-a14b31d68c48 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:27.453581 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-68afa999-a2f9-40bc-ae6a-949c17635c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f3e43ae6bc4b6690d3d4fce137ce75'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:27.460262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-68afa999-a2f9-40bc-ae6a-949c17635c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f3e43ae6bc4b6690d3d4fce137ce75'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:27.478170 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-68afa999-a2f9-40bc-ae6a-949c17635c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f3e43ae6bc4b6690d3d4fce137ce75'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:27.479562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-68afa999-a2f9-40bc-ae6a-949c17635c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f3e43ae6bc4b6690d3d4fce137ce75'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:27.488533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-68afa999-a2f9-40bc-ae6a-949c17635c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f3e43ae6bc4b6690d3d4fce137ce75'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:27.495832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:27.496590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 971/1932] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:27 2022] DELETE /identity/v3/users/54f3e43ae6bc4b6690d3d4fce137ce75 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:27.502122 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a67fc-6c40-4f31-b249-7206653c285d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:27.502814 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a67fc-6c40-4f31-b249-7206653c285d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:27.503164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a67fc-6c40-4f31-b249-7206653c285d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:27.519679 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-a9f15fbb-90e0-4279-911f-a14b31d68c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94925552736a477da6bb704d76bc3f91'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:27.525909 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-800a67fc-6c40-4f31-b249-7206653c285d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:27.527218 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-800a67fc-6c40-4f31-b249-7206653c285d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:27.530042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-a9f15fbb-90e0-4279-911f-a14b31d68c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94925552736a477da6bb704d76bc3f91'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:27.539888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-a9f15fbb-90e0-4279-911f-a14b31d68c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94925552736a477da6bb704d76bc3f91'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:27.541466 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-a9f15fbb-90e0-4279-911f-a14b31d68c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94925552736a477da6bb704d76bc3f91'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:27.562038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-a9f15fbb-90e0-4279-911f-a14b31d68c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94925552736a477da6bb704d76bc3f91'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:27.569511 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 962/1933] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:27 2022] DELETE /identity/v3/users/94925552736a477da6bb704d76bc3f91 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:27.574521 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38441092-7ead-4118-b4c9-52607232e7e7 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:27.575567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38441092-7ead-4118-b4c9-52607232e7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:27.576006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38441092-7ead-4118-b4c9-52607232e7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:27.598762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 972/1934] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:27.599927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-38441092-7ead-4118-b4c9-52607232e7e7 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:27.601243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-38441092-7ead-4118-b4c9-52607232e7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:27.612731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a67fc-6c40-4f31-b249-7206653c285d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:27.614812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-800a67fc-6c40-4f31-b249-7206653c285d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:27.690546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a67fc-6c40-4f31-b249-7206653c285d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:27.695090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 963/1935] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:27.706735 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38441092-7ead-4118-b4c9-52607232e7e7 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:27.708388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-38441092-7ead-4118-b4c9-52607232e7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:27.718865 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:27.743670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cfac8-4b97-43f4-a0ba-58f22356c296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:27.744466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cfac8-4b97-43f4-a0ba-58f22356c296 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:27.744770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cfac8-4b97-43f4-a0ba-58f22356c296 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:27.745134 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cfac8-4b97-43f4-a0ba-58f22356c296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:27.755325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cfac8-4b97-43f4-a0ba-58f22356c296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:27.756767 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cfac8-4b97-43f4-a0ba-58f22356c296 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:27.766718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38441092-7ead-4118-b4c9-52607232e7e7 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:27.768215 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 973/1936] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:27.772970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326859f4-e13b-4be9-ac24-0feb632223b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:27.773603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326859f4-e13b-4be9-ac24-0feb632223b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:27.773888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326859f4-e13b-4be9-ac24-0feb632223b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:27.774293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326859f4-e13b-4be9-ac24-0feb632223b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:27.784207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326859f4-e13b-4be9-ac24-0feb632223b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:27.785632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326859f4-e13b-4be9-ac24-0feb632223b2 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:27.795610 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 964/1937] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:26:28.181704 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326859f4-e13b-4be9-ac24-0feb632223b2 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:28.182592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cfac8-4b97-43f4-a0ba-58f22356c296 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:28.184018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-326859f4-e13b-4be9-ac24-0feb632223b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:28.184180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-435cfac8-4b97-43f4-a0ba-58f22356c296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:28.199918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326859f4-e13b-4be9-ac24-0feb632223b2 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:28.200467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cfac8-4b97-43f4-a0ba-58f22356c296 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:28.205614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777810ef-6e12-4e2a-8807-0a69e0a7f0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:28.206386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777810ef-6e12-4e2a-8807-0a69e0a7f0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:28.206614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777810ef-6e12-4e2a-8807-0a69e0a7f0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:28.206911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777810ef-6e12-4e2a-8807-0a69e0a7f0f5 admin admin] PATH_INFO: `/v3/users/dd4f588c3e524072be9bf4a631f83140` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:28.207864 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:28.208406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777810ef-6e12-4e2a-8807-0a69e0a7f0f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4f588c3e524072be9bf4a631f83140)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:28.209910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:28.210548 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777810ef-6e12-4e2a-8807-0a69e0a7f0f5 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:28.217554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:28.230965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1 admin admin] PATH_INFO: `/v3/projects/365ff6ba10074407876363f4a48fbc81` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:28.233143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=365ff6ba10074407876363f4a48fbc81)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:28.235129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:28.297319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:28.301354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-777810ef-6e12-4e2a-8807-0a69e0a7f0f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4f588c3e524072be9bf4a631f83140'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.314590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-777810ef-6e12-4e2a-8807-0a69e0a7f0f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4f588c3e524072be9bf4a631f83140'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.327870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-777810ef-6e12-4e2a-8807-0a69e0a7f0f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4f588c3e524072be9bf4a631f83140'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.328760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-777810ef-6e12-4e2a-8807-0a69e0a7f0f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4f588c3e524072be9bf4a631f83140'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.333896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365ff6ba10074407876363f4a48fbc81', 'request_id': 'req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.344131 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365ff6ba10074407876363f4a48fbc81', 'request_id': 'req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.347248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-777810ef-6e12-4e2a-8807-0a69e0a7f0f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4f588c3e524072be9bf4a631f83140'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.356639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 965/1938] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:28 2022] DELETE /identity/v3/users/dd4f588c3e524072be9bf4a631f83140 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:28.357411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777810ef-6e12-4e2a-8807-0a69e0a7f0f5 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:28.359034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-777810ef-6e12-4e2a-8807-0a69e0a7f0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:28.369229 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365ff6ba10074407876363f4a48fbc81', 'request_id': 'req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.384989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1 admin admin] The token cache is being invalidate because project 365ff6ba10074407876363f4a48fbc81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:28.385871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.386903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e1e35830-ebc1-48ac-b5c6-d13b05cfc7c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.388894 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 974/1939] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:28 2022] DELETE /identity/v3/projects/365ff6ba10074407876363f4a48fbc81 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:28.390596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a3edd-dbdf-4e85-86d8-548885dedeb3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:28.391039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a3edd-dbdf-4e85-86d8-548885dedeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:28.391534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a3edd-dbdf-4e85-86d8-548885dedeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:28.420697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-061a3edd-dbdf-4e85-86d8-548885dedeb3 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:28.422451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-061a3edd-dbdf-4e85-86d8-548885dedeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:28.471206 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777810ef-6e12-4e2a-8807-0a69e0a7f0f5 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:28.476842 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:28.477609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:28.477774 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:28.478223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] PATH_INFO: `/v3/projects/26b5be19c4ec40caa7033b27ff5e2b13` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:28.481040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b5be19c4ec40caa7033b27ff5e2b13)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:28.482361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:28.530470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 975/1940] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:28.531426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a3edd-dbdf-4e85-86d8-548885dedeb3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:28.533724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-061a3edd-dbdf-4e85-86d8-548885dedeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:28.553395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b5be19c4ec40caa7033b27ff5e2b13', 'request_id': 'req-2dd51890-fc58-4b53-800f-a6a607d09694'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.566280 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b5be19c4ec40caa7033b27ff5e2b13', 'request_id': 'req-2dd51890-fc58-4b53-800f-a6a607d09694'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.575062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b5be19c4ec40caa7033b27ff5e2b13', 'request_id': 'req-2dd51890-fc58-4b53-800f-a6a607d09694'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.576966 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a3edd-dbdf-4e85-86d8-548885dedeb3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:28.590999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] The token cache is being invalidate because project 26b5be19c4ec40caa7033b27ff5e2b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:28.591283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.592442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.594723 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 966/1941] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:28 2022] DELETE /identity/v3/projects/26b5be19c4ec40caa7033b27ff5e2b13 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:28.598855 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:28.600229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:28.645128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:28.655585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff3f9d-86b5-4ba4-af6a-e1119211be1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:28.656450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff3f9d-86b5-4ba4-af6a-e1119211be1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:28.656761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff3f9d-86b5-4ba4-af6a-e1119211be1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:28.657018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff3f9d-86b5-4ba4-af6a-e1119211be1f admin admin] PATH_INFO: `/v3/users/ff6ece82d1b541f0aaec1438d7f58813` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:28.658522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff3f9d-86b5-4ba4-af6a-e1119211be1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6ece82d1b541f0aaec1438d7f58813)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:28.660945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff3f9d-86b5-4ba4-af6a-e1119211be1f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:28.674890 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd51890-fc58-4b53-800f-a6a607d09694 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:28.680076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b146d-bf7b-480f-92fd-fc0e2287f3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:28.680712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b146d-bf7b-480f-92fd-fc0e2287f3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:28.680999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b146d-bf7b-480f-92fd-fc0e2287f3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:28.681342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b146d-bf7b-480f-92fd-fc0e2287f3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:28.683750 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e50b146d-bf7b-480f-92fd-fc0e2287f3b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:28.695435 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:28.702910 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b146d-bf7b-480f-92fd-fc0e2287f3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:28.704464 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b146d-bf7b-480f-92fd-fc0e2287f3b8 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:28.715703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fdff3f9d-86b5-4ba4-af6a-e1119211be1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6ece82d1b541f0aaec1438d7f58813'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.723575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fdff3f9d-86b5-4ba4-af6a-e1119211be1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6ece82d1b541f0aaec1438d7f58813'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.731279 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 967/1942] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:28.732133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b146d-bf7b-480f-92fd-fc0e2287f3b8 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:28.733496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e50b146d-bf7b-480f-92fd-fc0e2287f3b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:28.737392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fdff3f9d-86b5-4ba4-af6a-e1119211be1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6ece82d1b541f0aaec1438d7f58813'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.738146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fdff3f9d-86b5-4ba4-af6a-e1119211be1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6ece82d1b541f0aaec1438d7f58813'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.746479 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b146d-bf7b-480f-92fd-fc0e2287f3b8 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:28.748517 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fdff3f9d-86b5-4ba4-af6a-e1119211be1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6ece82d1b541f0aaec1438d7f58813'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.751762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4b8d7-ff35-472f-9f86-94bee2fa72ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:28.752465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4b8d7-ff35-472f-9f86-94bee2fa72ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:28.752754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4b8d7-ff35-472f-9f86-94bee2fa72ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:28.753032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4b8d7-ff35-472f-9f86-94bee2fa72ee admin admin] PATH_INFO: `/v3/users/390a72cbbb354e15a53ffce093979c08` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:28.754246 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4b8d7-ff35-472f-9f86-94bee2fa72ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=390a72cbbb354e15a53ffce093979c08)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:28.756228 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4b8d7-ff35-472f-9f86-94bee2fa72ee admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:28.760397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 976/1943] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:28 2022] DELETE /identity/v3/users/ff6ece82d1b541f0aaec1438d7f58813 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:28.836481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4ca4b8d7-ff35-472f-9f86-94bee2fa72ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390a72cbbb354e15a53ffce093979c08'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.850602 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4ca4b8d7-ff35-472f-9f86-94bee2fa72ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390a72cbbb354e15a53ffce093979c08'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.863752 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4ca4b8d7-ff35-472f-9f86-94bee2fa72ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390a72cbbb354e15a53ffce093979c08'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.865713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4ca4b8d7-ff35-472f-9f86-94bee2fa72ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390a72cbbb354e15a53ffce093979c08'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.884805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4ca4b8d7-ff35-472f-9f86-94bee2fa72ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390a72cbbb354e15a53ffce093979c08'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:28.894689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 968/1944] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:28 2022] DELETE /identity/v3/users/390a72cbbb354e15a53ffce093979c08 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:29.221124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff3f9d-86b5-4ba4-af6a-e1119211be1f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:29.222708 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fdff3f9d-86b5-4ba4-af6a-e1119211be1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:29.270027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4b8d7-ff35-472f-9f86-94bee2fa72ee admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:29.271634 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4ca4b8d7-ff35-472f-9f86-94bee2fa72ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:29.338601 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff3f9d-86b5-4ba4-af6a-e1119211be1f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:29.348820 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:29.349476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:29.349762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:29.350041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] PATH_INFO: `/v3/projects/2e93c65e19a04b29aa5576b92035daf8` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:29.352716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e93c65e19a04b29aa5576b92035daf8)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:29.355345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:29.377596 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4b8d7-ff35-472f-9f86-94bee2fa72ee admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:29.384044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:29.385808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:29.386727 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:29.387089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] PATH_INFO: `/v3/projects/a44ffe5d6970438babe53755951a84b0` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:29.388913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a44ffe5d6970438babe53755951a84b0)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:29.391312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:29.471258 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e93c65e19a04b29aa5576b92035daf8', 'request_id': 'req-afbc9902-f4b2-4576-a0f9-24f94e5f8355'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.486854 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e93c65e19a04b29aa5576b92035daf8', 'request_id': 'req-afbc9902-f4b2-4576-a0f9-24f94e5f8355'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.503404 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e93c65e19a04b29aa5576b92035daf8', 'request_id': 'req-afbc9902-f4b2-4576-a0f9-24f94e5f8355'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.503609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a44ffe5d6970438babe53755951a84b0', 'request_id': 'req-0209a44c-8768-43c2-8f49-266dde9c84fc'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.514989 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a44ffe5d6970438babe53755951a84b0', 'request_id': 'req-0209a44c-8768-43c2-8f49-266dde9c84fc'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.528137 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] The token cache is being invalidate because project 2e93c65e19a04b29aa5576b92035daf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:29.528514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.529779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.529995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a44ffe5d6970438babe53755951a84b0', 'request_id': 'req-0209a44c-8768-43c2-8f49-266dde9c84fc'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.531952 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 977/1945] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:29 2022] DELETE /identity/v3/projects/2e93c65e19a04b29aa5576b92035daf8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:29.532704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:29.534032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:29.535825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:29.548024 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] The token cache is being invalidate because project a44ffe5d6970438babe53755951a84b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:29.548234 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:29.548461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.549102 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.551180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 969/1946] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:29 2022] DELETE /identity/v3/projects/a44ffe5d6970438babe53755951a84b0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:29.552394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:29.554188 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:29.636980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc9902-f4b2-4576-a0f9-24f94e5f8355 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:29.656968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209a44c-8768-43c2-8f49-266dde9c84fc admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:29.665160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f1917-a826-4d88-97ab-fe9ed0787dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:29.666674 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f1917-a826-4d88-97ab-fe9ed0787dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:29.666959 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f1917-a826-4d88-97ab-fe9ed0787dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:29.668233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f1917-a826-4d88-97ab-fe9ed0787dd7 admin admin] PATH_INFO: `/v3/users/ffcf5a4d95c24475b93632569cd89584` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:29.669504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f1917-a826-4d88-97ab-fe9ed0787dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffcf5a4d95c24475b93632569cd89584)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:29.672126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f1917-a826-4d88-97ab-fe9ed0787dd7 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:29.742443 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5b5f1917-a826-4d88-97ab-fe9ed0787dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffcf5a4d95c24475b93632569cd89584'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.757308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:29.757991 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:29.758343 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:29.758624 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1 admin admin] PATH_INFO: `/v3/projects/0e6e670d8def42759534a8a2da093894` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:29.761546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5b5f1917-a826-4d88-97ab-fe9ed0787dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffcf5a4d95c24475b93632569cd89584'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.762434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6e670d8def42759534a8a2da093894)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:29.764732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:29.779937 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5b5f1917-a826-4d88-97ab-fe9ed0787dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffcf5a4d95c24475b93632569cd89584'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.780739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5b5f1917-a826-4d88-97ab-fe9ed0787dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffcf5a4d95c24475b93632569cd89584'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.804398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5b5f1917-a826-4d88-97ab-fe9ed0787dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffcf5a4d95c24475b93632569cd89584'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.813034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 970/1947] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:29 2022] DELETE /identity/v3/users/ffcf5a4d95c24475b93632569cd89584 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:29.816500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f1917-a826-4d88-97ab-fe9ed0787dd7 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:29.816500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5b5f1917-a826-4d88-97ab-fe9ed0787dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:29.846929 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6e670d8def42759534a8a2da093894', 'request_id': 'req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.858155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6e670d8def42759534a8a2da093894', 'request_id': 'req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.870177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6e670d8def42759534a8a2da093894', 'request_id': 'req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.887581 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1 admin admin] The token cache is being invalidate because project 0e6e670d8def42759534a8a2da093894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:29.887869 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.891965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7e0181f5-5706-4da7-84bd-3cf0c9f5f7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:29.894970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 978/1948] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:29 2022] DELETE /identity/v3/projects/0e6e670d8def42759534a8a2da093894 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:29.900037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c5bf7-c056-48f4-bb1a-8c23c944a36b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:29.900827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c5bf7-c056-48f4-bb1a-8c23c944a36b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:29.900827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c5bf7-c056-48f4-bb1a-8c23c944a36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:29.906351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f1917-a826-4d88-97ab-fe9ed0787dd7 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:29.926594 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-da2c5bf7-c056-48f4-bb1a-8c23c944a36b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:29.927938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-da2c5bf7-c056-48f4-bb1a-8c23c944a36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:29.936192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:29.980755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:29.995127 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa361bd-0427-482b-baf9-a8b396bfc8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:29.996058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa361bd-0427-482b-baf9-a8b396bfc8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:29.996394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa361bd-0427-482b-baf9-a8b396bfc8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:29.996751 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa361bd-0427-482b-baf9-a8b396bfc8dc admin admin] PATH_INFO: `/v3/users/1b8c62464ce14ecdb0856ec84f86e03e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:29.999441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa361bd-0427-482b-baf9-a8b396bfc8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8c62464ce14ecdb0856ec84f86e03e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:30.002244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa361bd-0427-482b-baf9-a8b396bfc8dc admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:30.014882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 979/1949] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:30.023893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a3b96-9d4d-4632-9cad-b8195f54ad06 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:30.024568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a3b96-9d4d-4632-9cad-b8195f54ad06 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:30.024824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a3b96-9d4d-4632-9cad-b8195f54ad06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:30.051459 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-473a3b96-9d4d-4632-9cad-b8195f54ad06 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:30.052702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-473a3b96-9d4d-4632-9cad-b8195f54ad06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:30.060879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8fa361bd-0427-482b-baf9-a8b396bfc8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8c62464ce14ecdb0856ec84f86e03e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.062991 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 980/1950] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:30.067067 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a3b96-9d4d-4632-9cad-b8195f54ad06 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:30.073611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8fa361bd-0427-482b-baf9-a8b396bfc8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8c62464ce14ecdb0856ec84f86e03e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.077569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a3b96-9d4d-4632-9cad-b8195f54ad06 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:30.082558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a0ad6-157a-4d89-9eb8-6b6905c427f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:30.082719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8fa361bd-0427-482b-baf9-a8b396bfc8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8c62464ce14ecdb0856ec84f86e03e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.083573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8fa361bd-0427-482b-baf9-a8b396bfc8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8c62464ce14ecdb0856ec84f86e03e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.083679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a0ad6-157a-4d89-9eb8-6b6905c427f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:30.083938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a0ad6-157a-4d89-9eb8-6b6905c427f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:30.084279 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a0ad6-157a-4d89-9eb8-6b6905c427f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:30.085140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a0ad6-157a-4d89-9eb8-6b6905c427f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:30.085546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a0ad6-157a-4d89-9eb8-6b6905c427f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:30.087255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a0ad6-157a-4d89-9eb8-6b6905c427f5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:30.098741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8fa361bd-0427-482b-baf9-a8b396bfc8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8c62464ce14ecdb0856ec84f86e03e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.101872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 981/1951] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:26:30.104979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 971/1952] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:29 2022] DELETE /identity/v3/users/1b8c62464ce14ecdb0856ec84f86e03e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:30.106357 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a0ad6-157a-4d89-9eb8-6b6905c427f5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:30.108361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5e0a0ad6-157a-4d89-9eb8-6b6905c427f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:30.121582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a0ad6-157a-4d89-9eb8-6b6905c427f5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:30.148329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa361bd-0427-482b-baf9-a8b396bfc8dc admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:30.150459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8fa361bd-0427-482b-baf9-a8b396bfc8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:30.197467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f707b3-4a06-4dba-a1b2-37db5a305f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:30.198378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f707b3-4a06-4dba-a1b2-37db5a305f37 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:30.198766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f707b3-4a06-4dba-a1b2-37db5a305f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:30.199120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f707b3-4a06-4dba-a1b2-37db5a305f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:30.200166 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f707b3-4a06-4dba-a1b2-37db5a305f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:30.203913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f707b3-4a06-4dba-a1b2-37db5a305f37 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:30.241672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 982/1953] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:30 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:30.246593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f707b3-4a06-4dba-a1b2-37db5a305f37 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:30.260533 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa361bd-0427-482b-baf9-a8b396bfc8dc admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:30.329839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:30.340065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f707b3-4a06-4dba-a1b2-37db5a305f37 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:30.347411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faa953-d992-43bf-84e1-f00f070da49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:30.348125 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faa953-d992-43bf-84e1-f00f070da49b admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:30.348396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faa953-d992-43bf-84e1-f00f070da49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:30.349490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faa953-d992-43bf-84e1-f00f070da49b admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:30.350288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23faa953-d992-43bf-84e1-f00f070da49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:30.352846 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23faa953-d992-43bf-84e1-f00f070da49b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:30.356245 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:30.357887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:30.358132 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:30.358936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] PATH_INFO: `/v3/projects/0d481a6520e74e0791cb07626d3c82e7` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:30.360532 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d481a6520e74e0791cb07626d3c82e7)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:30.364350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:30.388464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 983/1954] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:30 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:26:30.392410 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faa953-d992-43bf-84e1-f00f070da49b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:30.406666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faa953-d992-43bf-84e1-f00f070da49b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:30.414464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d7285-9da2-43f3-b864-30632025bca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:30.416353 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7285-9da2-43f3-b864-30632025bca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:30.416645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7285-9da2-43f3-b864-30632025bca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:30.416920 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7285-9da2-43f3-b864-30632025bca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:30.418003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d7285-9da2-43f3-b864-30632025bca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:30.419885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d7285-9da2-43f3-b864-30632025bca4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:30.441081 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 984/1955] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:30.446727 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d7285-9da2-43f3-b864-30632025bca4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:30.459427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d481a6520e74e0791cb07626d3c82e7', 'request_id': 'req-7aee3a28-2973-49c1-a05d-a2711a8d03fb'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.477861 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d481a6520e74e0791cb07626d3c82e7', 'request_id': 'req-7aee3a28-2973-49c1-a05d-a2711a8d03fb'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.485131 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d7285-9da2-43f3-b864-30632025bca4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:30.488337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d481a6520e74e0791cb07626d3c82e7', 'request_id': 'req-7aee3a28-2973-49c1-a05d-a2711a8d03fb'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.505249 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] The token cache is being invalidate because project 0d481a6520e74e0791cb07626d3c82e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:30.505249 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.506850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.513124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 972/1956] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:30 2022] DELETE /identity/v3/projects/0d481a6520e74e0791cb07626d3c82e7 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:30.515417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:30.517381 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:30.556836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:30.621298 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db69c3-9180-43e2-b016-16ff6550b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:30.622051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db69c3-9180-43e2-b016-16ff6550b8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:30.622421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db69c3-9180-43e2-b016-16ff6550b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:30.622783 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db69c3-9180-43e2-b016-16ff6550b8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:30.624220 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db69c3-9180-43e2-b016-16ff6550b8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:30.626361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db69c3-9180-43e2-b016-16ff6550b8a5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:30.642888 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 985/1957] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:30.645594 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db69c3-9180-43e2-b016-16ff6550b8a5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:30.648260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-07db69c3-9180-43e2-b016-16ff6550b8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:30.680675 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db69c3-9180-43e2-b016-16ff6550b8a5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:30.685962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:30.686802 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:30.687159 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:30.687510 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] PATH_INFO: `/v3/projects/ddb8e1ca60634f8ea482e93acb7e25d6` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:30.688787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee3a28-2973-49c1-a05d-a2711a8d03fb admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:30.688927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb8e1ca60634f8ea482e93acb7e25d6)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:30.690941 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:30.693823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbacdd-d233-4c49-a166-147f3f79bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:30.694630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbacdd-d233-4c49-a166-147f3f79bf83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:30.694975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbacdd-d233-4c49-a166-147f3f79bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:30.695264 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbacdd-d233-4c49-a166-147f3f79bf83 admin admin] PATH_INFO: `/v3/users/a2d4a20a051c49b69523f455cbf1ebd6` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:30.697733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbacdd-d233-4c49-a166-147f3f79bf83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d4a20a051c49b69523f455cbf1ebd6)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:30.699095 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbacdd-d233-4c49-a166-147f3f79bf83 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:30.749260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb8e1ca60634f8ea482e93acb7e25d6', 'request_id': 'req-bcabe7a9-80f9-4372-9697-a471b570accf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.755495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2dbbacdd-d233-4c49-a166-147f3f79bf83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d4a20a051c49b69523f455cbf1ebd6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.758572 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb8e1ca60634f8ea482e93acb7e25d6', 'request_id': 'req-bcabe7a9-80f9-4372-9697-a471b570accf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.764586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2dbbacdd-d233-4c49-a166-147f3f79bf83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d4a20a051c49b69523f455cbf1ebd6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.768140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb8e1ca60634f8ea482e93acb7e25d6', 'request_id': 'req-bcabe7a9-80f9-4372-9697-a471b570accf'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.773368 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2dbbacdd-d233-4c49-a166-147f3f79bf83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d4a20a051c49b69523f455cbf1ebd6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.774089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2dbbacdd-d233-4c49-a166-147f3f79bf83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d4a20a051c49b69523f455cbf1ebd6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.784088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] The token cache is being invalidate because project ddb8e1ca60634f8ea482e93acb7e25d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:30.784386 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.785112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.786690 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 986/1958] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:30 2022] DELETE /identity/v3/projects/ddb8e1ca60634f8ea482e93acb7e25d6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:30.787435 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:30.788732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:30.801825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2dbbacdd-d233-4c49-a166-147f3f79bf83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d4a20a051c49b69523f455cbf1ebd6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:30.803808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:30.809789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 973/1959] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:30 2022] DELETE /identity/v3/users/a2d4a20a051c49b69523f455cbf1ebd6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:30.816696 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d3157-fa4b-42e0-84e3-53e44f966cb1 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:30.817169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d3157-fa4b-42e0-84e3-53e44f966cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:30.817512 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d3157-fa4b-42e0-84e3-53e44f966cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:30.874397 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-915d3157-fa4b-42e0-84e3-53e44f966cb1 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:30.876446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-915d3157-fa4b-42e0-84e3-53e44f966cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:30.927593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabe7a9-80f9-4372-9697-a471b570accf admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:31.019975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 974/1960] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:31.029242 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba8c32-e7a1-49cf-bd2c-f925aa5f82bf None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.029805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba8c32-e7a1-49cf-bd2c-f925aa5f82bf None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.030193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba8c32-e7a1-49cf-bd2c-f925aa5f82bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.053789 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:31.059881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-33ba8c32-e7a1-49cf-bd2c-f925aa5f82bf None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:31.061944 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-33ba8c32-e7a1-49cf-bd2c-f925aa5f82bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:31.071486 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b2f9e-990c-4d80-99ef-84c3ac7e4a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:31.072241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 975/1961] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:31.075945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b2f9e-990c-4d80-99ef-84c3ac7e4a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.076764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b2f9e-990c-4d80-99ef-84c3ac7e4a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.077140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b2f9e-990c-4d80-99ef-84c3ac7e4a41 admin admin] PATH_INFO: `/v3/projects/faaaf76b3c9c4f03b736c192af1f39fc/users/f472babdb245473ba004e901bf04a7ca/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.077595 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba8c32-e7a1-49cf-bd2c-f925aa5f82bf None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:31.093030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba8c32-e7a1-49cf-bd2c-f925aa5f82bf None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:31.108154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfda345-4db1-43ae-9e51-0d67de137d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:31.108803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda345-4db1-43ae-9e51-0d67de137d56 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.109163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda345-4db1-43ae-9e51-0d67de137d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.109362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda345-4db1-43ae-9e51-0d67de137d56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.110074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfda345-4db1-43ae-9e51-0d67de137d56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:31.110527 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfda345-4db1-43ae-9e51-0d67de137d56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:31.111806 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b2f9e-990c-4d80-99ef-84c3ac7e4a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faaaf76b3c9c4f03b736c192af1f39fc, user_id=f472babdb245473ba004e901bf04a7ca, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:31.113530 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfda345-4db1-43ae-9e51-0d67de137d56 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:31.114839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b2f9e-990c-4d80-99ef-84c3ac7e4a41 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:31.141371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 976/1962] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:26:31.143271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfda345-4db1-43ae-9e51-0d67de137d56 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:31.146464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 987/1963] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:30 2022] PUT /identity/v3/projects/faaaf76b3c9c4f03b736c192af1f39fc/users/f472babdb245473ba004e901bf04a7ca/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:31.161155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb935143-49ea-439a-9bd9-73a194dcb0c4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.161499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb935143-49ea-439a-9bd9-73a194dcb0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.161738 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb935143-49ea-439a-9bd9-73a194dcb0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.178809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfda345-4db1-43ae-9e51-0d67de137d56 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:31.227426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-eb935143-49ea-439a-9bd9-73a194dcb0c4 None None] MFA Rules not processed for user `f472babdb245473ba004e901bf04a7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:31.229230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-eb935143-49ea-439a-9bd9-73a194dcb0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:31.300115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563c286-a502-4bd7-9f54-4211b6536fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:31.300829 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563c286-a502-4bd7-9f54-4211b6536fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.301034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563c286-a502-4bd7-9f54-4211b6536fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.301312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563c286-a502-4bd7-9f54-4211b6536fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.302172 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563c286-a502-4bd7-9f54-4211b6536fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:31.304114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563c286-a502-4bd7-9f54-4211b6536fd9 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:31.341254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 988/1964] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:31.342064 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb935143-49ea-439a-9bd9-73a194dcb0c4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:31.346328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-eb935143-49ea-439a-9bd9-73a194dcb0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:31.359514 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 977/1965] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:31 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:31.360411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563c286-a502-4bd7-9f54-4211b6536fd9 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:31.362267 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8563c286-a502-4bd7-9f54-4211b6536fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:31.368962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb935143-49ea-439a-9bd9-73a194dcb0c4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:31.427139 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563c286-a502-4bd7-9f54-4211b6536fd9 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:31.430977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d98fb-d9c6-4738-a22e-851581cd1d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:31.431639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d98fb-d9c6-4738-a22e-851581cd1d37 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.431923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d98fb-d9c6-4738-a22e-851581cd1d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.432201 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d98fb-d9c6-4738-a22e-851581cd1d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.433818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a107b-6907-42ee-9cce-8c19ae2c856e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:31.434615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a107b-6907-42ee-9cce-8c19ae2c856e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.435794 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a107b-6907-42ee-9cce-8c19ae2c856e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.436146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a107b-6907-42ee-9cce-8c19ae2c856e admin admin] PATH_INFO: `/v3/projects/a623dacbb6e04a19bf927e2ecf716baf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.437392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a107b-6907-42ee-9cce-8c19ae2c856e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a623dacbb6e04a19bf927e2ecf716baf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:31.439746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a107b-6907-42ee-9cce-8c19ae2c856e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:31.455432 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:31.499971 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d98fb-d9c6-4738-a22e-851581cd1d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:31.501238 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a33a107b-6907-42ee-9cce-8c19ae2c856e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a623dacbb6e04a19bf927e2ecf716baf', 'request_id': 'req-a33a107b-6907-42ee-9cce-8c19ae2c856e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:31.501418 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d98fb-d9c6-4738-a22e-851581cd1d37 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:31.507859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a33a107b-6907-42ee-9cce-8c19ae2c856e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a623dacbb6e04a19bf927e2ecf716baf', 'request_id': 'req-a33a107b-6907-42ee-9cce-8c19ae2c856e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:31.511721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 978/1966] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:31.512414 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d98fb-d9c6-4738-a22e-851581cd1d37 service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:31.518037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a33a107b-6907-42ee-9cce-8c19ae2c856e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a623dacbb6e04a19bf927e2ecf716baf', 'request_id': 'req-a33a107b-6907-42ee-9cce-8c19ae2c856e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:31.524752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:31.524905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d98fb-d9c6-4738-a22e-851581cd1d37 service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:31.533689 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a33a107b-6907-42ee-9cce-8c19ae2c856e admin admin] The token cache is being invalidate because project a623dacbb6e04a19bf927e2ecf716baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:31.534348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a33a107b-6907-42ee-9cce-8c19ae2c856e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:31.535225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a33a107b-6907-42ee-9cce-8c19ae2c856e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:31.537322 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 989/1967] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:31 2022] DELETE /identity/v3/projects/a623dacbb6e04a19bf927e2ecf716baf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:31.538701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41f7e-dadc-40f8-b9df-0c33a9c821b1 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.538990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41f7e-dadc-40f8-b9df-0c33a9c821b1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.539268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe41f7e-dadc-40f8-b9df-0c33a9c821b1 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.541360 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 990/1968] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 4 22:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:26:31.543530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989570d-f3c6-4da6-8e7e-4cc2f2f23462 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.544126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989570d-f3c6-4da6-8e7e-4cc2f2f23462 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.544470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989570d-f3c6-4da6-8e7e-4cc2f2f23462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.565894 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f989570d-f3c6-4da6-8e7e-4cc2f2f23462 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:31.567240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f989570d-f3c6-4da6-8e7e-4cc2f2f23462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:31.598165 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f5c45-5e0f-4971-bfb2-b1400e5c4fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:31.598952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f5c45-5e0f-4971-bfb2-b1400e5c4fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.599148 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f5c45-5e0f-4971-bfb2-b1400e5c4fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.599392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f5c45-5e0f-4971-bfb2-b1400e5c4fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.600065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f5c45-5e0f-4971-bfb2-b1400e5c4fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:31.601981 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f5c45-5e0f-4971-bfb2-b1400e5c4fe3 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:31.629888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 979/1969] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:31 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:31.631281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddfbb4-9823-464d-81d7-70a550f42e8c None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.631575 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddfbb4-9823-464d-81d7-70a550f42e8c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.632722 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddfbb4-9823-464d-81d7-70a550f42e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.657679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 991/1970] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:31.658062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-edddfbb4-9823-464d-81d7-70a550f42e8c None None] MFA Rules not processed for user `04899781f67746e193a05bdc004804cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:31.659368 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-edddfbb4-9823-464d-81d7-70a550f42e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:31.665159 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989570d-f3c6-4da6-8e7e-4cc2f2f23462 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:31.668332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f989570d-f3c6-4da6-8e7e-4cc2f2f23462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:31.690067 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989570d-f3c6-4da6-8e7e-4cc2f2f23462 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:31.695871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5a2c3-2791-4182-a666-40edb14db8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:31.696749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a2c3-2791-4182-a666-40edb14db8fd admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.697134 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a2c3-2791-4182-a666-40edb14db8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.697602 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a2c3-2791-4182-a666-40edb14db8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.698716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5a2c3-2791-4182-a666-40edb14db8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:31.700960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5a2c3-2791-4182-a666-40edb14db8fd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:31.718382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 992/1971] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:31.720064 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7a37-7814-45f6-9d20-3f0c2bc4e3ec None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.720630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7a37-7814-45f6-9d20-3f0c2bc4e3ec None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.721015 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7a37-7814-45f6-9d20-3f0c2bc4e3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.750890 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 980/1972] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 4 22:26:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:31.751776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddfbb4-9823-464d-81d7-70a550f42e8c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:31.756065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-67de7a37-7814-45f6-9d20-3f0c2bc4e3ec None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:31.757380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-67de7a37-7814-45f6-9d20-3f0c2bc4e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:31.763310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddfbb4-9823-464d-81d7-70a550f42e8c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:31.766765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 993/1973] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:31.770496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dcbe8-9702-4966-b4dc-6de8179eae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:31.771089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7a37-7814-45f6-9d20-3f0c2bc4e3ec None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:31.771697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dcbe8-9702-4966-b4dc-6de8179eae50 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.772170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dcbe8-9702-4966-b4dc-6de8179eae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.772530 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dcbe8-9702-4966-b4dc-6de8179eae50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.772661 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-67de7a37-7814-45f6-9d20-3f0c2bc4e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:31.773169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6dcbe8-9702-4966-b4dc-6de8179eae50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:31.776202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6dcbe8-9702-4966-b4dc-6de8179eae50 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:31.789732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7a37-7814-45f6-9d20-3f0c2bc4e3ec None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:31.797981 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 981/1974] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:31.797981 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dcbe8-9702-4966-b4dc-6de8179eae50 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:31.802660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e6f4c-eb3d-4e62-8f8f-560328ea45bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:31.803403 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e6f4c-eb3d-4e62-8f8f-560328ea45bf service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.803752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e6f4c-eb3d-4e62-8f8f-560328ea45bf service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.804096 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e6f4c-eb3d-4e62-8f8f-560328ea45bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.809220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dcbe8-9702-4966-b4dc-6de8179eae50 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:31.816101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7685c-2af6-45a0-a43c-eff346d3fe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:31.817179 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7685c-2af6-45a0-a43c-eff346d3fe93 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.817407 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e6f4c-eb3d-4e62-8f8f-560328ea45bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:31.817775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7685c-2af6-45a0-a43c-eff346d3fe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.817991 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7685c-2af6-45a0-a43c-eff346d3fe93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.819049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7685c-2af6-45a0-a43c-eff346d3fe93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:31.819769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7685c-2af6-45a0-a43c-eff346d3fe93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:31.819885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e6f4c-eb3d-4e62-8f8f-560328ea45bf service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:31.821927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7685c-2af6-45a0-a43c-eff346d3fe93 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:31.838849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 982/1975] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:26:31.839840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7685c-2af6-45a0-a43c-eff346d3fe93 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:31.843543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 994/1976] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:31.844596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e6f4c-eb3d-4e62-8f8f-560328ea45bf service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:31.856839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7685c-2af6-45a0-a43c-eff346d3fe93 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:31.867501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e6f4c-eb3d-4e62-8f8f-560328ea45bf service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:31.871013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac4d13-e47d-4c7a-8401-a1e64d01b53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:31.872446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac4d13-e47d-4c7a-8401-a1e64d01b53b admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.873316 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac4d13-e47d-4c7a-8401-a1e64d01b53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.873853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac4d13-e47d-4c7a-8401-a1e64d01b53b admin admin] PATH_INFO: `/v3/projects/8d9e0f4802f54ca4870889e4d893e3c4/users/251d7a64faff4ac0a6ee78cbc5f11e70/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.880040 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b8498-e67d-4ceb-bf7f-4ec73ba35b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:31.880818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b8498-e67d-4ceb-bf7f-4ec73ba35b8b admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.881368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b8498-e67d-4ceb-bf7f-4ec73ba35b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.882681 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b8498-e67d-4ceb-bf7f-4ec73ba35b8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.883492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b8498-e67d-4ceb-bf7f-4ec73ba35b8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:31.886729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b8498-e67d-4ceb-bf7f-4ec73ba35b8b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:31.905935 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:31.911852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac4d13-e47d-4c7a-8401-a1e64d01b53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9e0f4802f54ca4870889e4d893e3c4, user_id=251d7a64faff4ac0a6ee78cbc5f11e70, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:31.915048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac4d13-e47d-4c7a-8401-a1e64d01b53b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:31.959563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 983/1977] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:31 2022] PUT /identity/v3/projects/8d9e0f4802f54ca4870889e4d893e3c4/users/251d7a64faff4ac0a6ee78cbc5f11e70/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:31.961400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7c2c8-d08e-46be-be55-24f9ca0d3e54 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:31.961812 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7c2c8-d08e-46be-be55-24f9ca0d3e54 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:31.962169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7c2c8-d08e-46be-be55-24f9ca0d3e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:31.975830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 995/1978] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:31 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:31.980121 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b8498-e67d-4ceb-bf7f-4ec73ba35b8b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:32.011441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-9ca7c2c8-d08e-46be-be55-24f9ca0d3e54 None None] MFA Rules not processed for user `251d7a64faff4ac0a6ee78cbc5f11e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:32.012717 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9ca7c2c8-d08e-46be-be55-24f9ca0d3e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:32.146447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 984/1979] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:32.151268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7c2c8-d08e-46be-be55-24f9ca0d3e54 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:32.178980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b8498-e67d-4ceb-bf7f-4ec73ba35b8b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:32.181855 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7c2c8-d08e-46be-be55-24f9ca0d3e54 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:32.191824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb90dc-41cc-40b5-85b8-cc05ff74bf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:32.192836 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc027eb5-023d-411c-9a61-97b46726315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:32.194282 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb90dc-41cc-40b5-85b8-cc05ff74bf65 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.194633 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc027eb5-023d-411c-9a61-97b46726315d admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.194915 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc027eb5-023d-411c-9a61-97b46726315d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.195559 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb90dc-41cc-40b5-85b8-cc05ff74bf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.195834 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb90dc-41cc-40b5-85b8-cc05ff74bf65 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.196980 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc027eb5-023d-411c-9a61-97b46726315d admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.197321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc027eb5-023d-411c-9a61-97b46726315d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:32.197735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb90dc-41cc-40b5-85b8-cc05ff74bf65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:32.200345 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc027eb5-023d-411c-9a61-97b46726315d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:32.201844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb90dc-41cc-40b5-85b8-cc05ff74bf65 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:32.245120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 996/1980] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:31 2022] POST /identity/v3/users => generated 283 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:32.249555 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb90dc-41cc-40b5-85b8-cc05ff74bf65 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:32.262889 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 985/1981] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:32 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:32.267640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc027eb5-023d-411c-9a61-97b46726315d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:32.275554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb90dc-41cc-40b5-85b8-cc05ff74bf65 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:32.347737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:32.400654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc027eb5-023d-411c-9a61-97b46726315d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:32.406293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f8757-fff0-4ae4-a2f5-317ff727d323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:32.406968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8757-fff0-4ae4-a2f5-317ff727d323 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.407982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8757-fff0-4ae4-a2f5-317ff727d323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.408182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8757-fff0-4ae4-a2f5-317ff727d323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.422843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f8757-fff0-4ae4-a2f5-317ff727d323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:32.422843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f8757-fff0-4ae4-a2f5-317ff727d323 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:32.425200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f291ba2-6deb-4e2d-8b04-e6f25f911d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:32.425200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f291ba2-6deb-4e2d-8b04-e6f25f911d74 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.425200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f291ba2-6deb-4e2d-8b04-e6f25f911d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.425529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f291ba2-6deb-4e2d-8b04-e6f25f911d74 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.426153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f291ba2-6deb-4e2d-8b04-e6f25f911d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:32.428237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f291ba2-6deb-4e2d-8b04-e6f25f911d74 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:32.434293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 997/1982] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:32.438390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f8757-fff0-4ae4-a2f5-317ff727d323 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:32.452810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f8757-fff0-4ae4-a2f5-317ff727d323 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:32.460361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dad731-44b5-417a-8b1b-6696b505c2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:32.461170 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dad731-44b5-417a-8b1b-6696b505c2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.461564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dad731-44b5-417a-8b1b-6696b505c2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.461959 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dad731-44b5-417a-8b1b-6696b505c2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.462736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 986/1983] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:32 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:32.462955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dad731-44b5-417a-8b1b-6696b505c2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:32.465503 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dad731-44b5-417a-8b1b-6696b505c2f1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:32.467275 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f291ba2-6deb-4e2d-8b04-e6f25f911d74 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:32.479164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 998/1984] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:32.481044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f291ba2-6deb-4e2d-8b04-e6f25f911d74 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:32.483423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dad731-44b5-417a-8b1b-6696b505c2f1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:32.486186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d68b8f-f3d3-479f-9c80-e7a566d6fb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:32.486849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d68b8f-f3d3-479f-9c80-e7a566d6fb99 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.487133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d68b8f-f3d3-479f-9c80-e7a566d6fb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.487410 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d68b8f-f3d3-479f-9c80-e7a566d6fb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.488112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d68b8f-f3d3-479f-9c80-e7a566d6fb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:32.489728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d68b8f-f3d3-479f-9c80-e7a566d6fb99 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:32.496122 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dad731-44b5-417a-8b1b-6696b505c2f1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:32.503592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1f62a-9fd3-44f5-a9b1-ef3aa997d3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:32.504045 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1f62a-9fd3-44f5-a9b1-ef3aa997d3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.504333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1f62a-9fd3-44f5-a9b1-ef3aa997d3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.504612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1f62a-9fd3-44f5-a9b1-ef3aa997d3d7 admin admin] PATH_INFO: `/v3/projects/d1117a7fc76848c98432637f0e0a7b0a/users/851a334433914677a01622ed3461dff1/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.513739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 987/1985] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:32.520315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d68b8f-f3d3-479f-9c80-e7a566d6fb99 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:32.526787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1f62a-9fd3-44f5-a9b1-ef3aa997d3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1117a7fc76848c98432637f0e0a7b0a, user_id=851a334433914677a01622ed3461dff1, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:32.529502 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1f62a-9fd3-44f5-a9b1-ef3aa997d3d7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:32.539963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d68b8f-f3d3-479f-9c80-e7a566d6fb99 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:32.544584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 999/1986] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:32 2022] PUT /identity/v3/projects/d1117a7fc76848c98432637f0e0a7b0a/users/851a334433914677a01622ed3461dff1/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:32.556583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6dd41-a5e8-445e-88f6-cacc2e77ac3c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.556875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6dd41-a5e8-445e-88f6-cacc2e77ac3c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.557156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6dd41-a5e8-445e-88f6-cacc2e77ac3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.581453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:32.590052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-aee6dd41-a5e8-445e-88f6-cacc2e77ac3c None None] MFA Rules not processed for user `851a334433914677a01622ed3461dff1`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:32.591361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-aee6dd41-a5e8-445e-88f6-cacc2e77ac3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:32.613830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40ba6e-a5f1-440d-aeac-5584404e522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:32.614889 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40ba6e-a5f1-440d-aeac-5584404e522e admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.615107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40ba6e-a5f1-440d-aeac-5584404e522e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.615392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40ba6e-a5f1-440d-aeac-5584404e522e admin admin] PATH_INFO: `/v3/projects/694fa52d71e74625b8dfeeb912e81bb1/users/53f880a39ece42f89be0ef3286d383b3/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.630531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40ba6e-a5f1-440d-aeac-5584404e522e admin admin] RBAC: Authorizing `identity:create_grant(project_id=694fa52d71e74625b8dfeeb912e81bb1, user_id=53f880a39ece42f89be0ef3286d383b3, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:32.633234 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40ba6e-a5f1-440d-aeac-5584404e522e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:32.648879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 988/1987] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:32 2022] PUT /identity/v3/projects/694fa52d71e74625b8dfeeb912e81bb1/users/53f880a39ece42f89be0ef3286d383b3/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:32.653659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40ba6e-a5f1-440d-aeac-5584404e522e admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:32.667005 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1000/1988] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:32.671392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6dd41-a5e8-445e-88f6-cacc2e77ac3c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:32.682439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6dd41-a5e8-445e-88f6-cacc2e77ac3c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:32.726557 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40ba6e-a5f1-440d-aeac-5584404e522e admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:32.732209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcbf62-f53c-4016-952d-2c01ecb6aa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:32.732838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcbf62-f53c-4016-952d-2c01ecb6aa28 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.734162 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcbf62-f53c-4016-952d-2c01ecb6aa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.734162 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcbf62-f53c-4016-952d-2c01ecb6aa28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.734162 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcbf62-f53c-4016-952d-2c01ecb6aa28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:32.735720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcbf62-f53c-4016-952d-2c01ecb6aa28 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:32.743877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b04726-ef8d-496b-83cc-c3c43f49682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:32.744530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b04726-ef8d-496b-83cc-c3c43f49682f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.744820 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b04726-ef8d-496b-83cc-c3c43f49682f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.745099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b04726-ef8d-496b-83cc-c3c43f49682f admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.745763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b04726-ef8d-496b-83cc-c3c43f49682f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:32.746339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 989/1989] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:32.748718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b04726-ef8d-496b-83cc-c3c43f49682f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:32.751195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcbf62-f53c-4016-952d-2c01ecb6aa28 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:32.761385 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcbf62-f53c-4016-952d-2c01ecb6aa28 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:32.766056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a002ee6-b2ce-4fd5-99ef-831a84c03108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:32.766761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a002ee6-b2ce-4fd5-99ef-831a84c03108 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.767050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a002ee6-b2ce-4fd5-99ef-831a84c03108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.767339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a002ee6-b2ce-4fd5-99ef-831a84c03108 admin admin] PATH_INFO: `/v3/projects/694fa52d71e74625b8dfeeb912e81bb1/users/53f880a39ece42f89be0ef3286d383b3/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.769447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a002ee6-b2ce-4fd5-99ef-831a84c03108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=694fa52d71e74625b8dfeeb912e81bb1, user_id=53f880a39ece42f89be0ef3286d383b3, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:32.772089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a002ee6-b2ce-4fd5-99ef-831a84c03108 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:32.783256 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 990/1990] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:32 2022] PUT /identity/v3/projects/694fa52d71e74625b8dfeeb912e81bb1/users/53f880a39ece42f89be0ef3286d383b3/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:32.786456 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1001/1991] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:32 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:26:32.790572 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a002ee6-b2ce-4fd5-99ef-831a84c03108 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:32.793499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916bf01-1349-46ad-a0bf-69c68625723e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.793792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916bf01-1349-46ad-a0bf-69c68625723e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.794072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916bf01-1349-46ad-a0bf-69c68625723e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.814618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:32.824905 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e916bf01-1349-46ad-a0bf-69c68625723e None None] MFA Rules not processed for user `53f880a39ece42f89be0ef3286d383b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:32.826710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e916bf01-1349-46ad-a0bf-69c68625723e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:32.860141 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a002ee6-b2ce-4fd5-99ef-831a84c03108 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:32.906556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1002/1992] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:32.913933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:32.923685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916bf01-1349-46ad-a0bf-69c68625723e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:32.925087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e916bf01-1349-46ad-a0bf-69c68625723e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:32.926465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce99db0-d227-4819-aa12-ebd13433900a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:32.927105 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce99db0-d227-4819-aa12-ebd13433900a admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.927390 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce99db0-d227-4819-aa12-ebd13433900a admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.927673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce99db0-d227-4819-aa12-ebd13433900a admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.928345 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce99db0-d227-4819-aa12-ebd13433900a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:32.930291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce99db0-d227-4819-aa12-ebd13433900a admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:32.952602 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 991/1993] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:32 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:26:32.956676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce99db0-d227-4819-aa12-ebd13433900a admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:32.967685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce99db0-d227-4819-aa12-ebd13433900a admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:32.972696 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ff52d-e671-4e96-b698-4582aef96c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:32.973011 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ff52d-e671-4e96-b698-4582aef96c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:32.973297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ff52d-e671-4e96-b698-4582aef96c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:32.973577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ff52d-e671-4e96-b698-4582aef96c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:32.974278 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ff52d-e671-4e96-b698-4582aef96c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:32.975948 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ff52d-e671-4e96-b698-4582aef96c02 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:32.986878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 992/1994] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:32.991015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ff52d-e671-4e96-b698-4582aef96c02 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:33.001853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ff52d-e671-4e96-b698-4582aef96c02 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:33.002307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916bf01-1349-46ad-a0bf-69c68625723e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:33.006625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfa46c-14dd-42a2-8b73-61eaef3d60bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:33.007222 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1d9b5-023c-477e-be21-d054627e1bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:33.007576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfa46c-14dd-42a2-8b73-61eaef3d60bc service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:33.007898 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1d9b5-023c-477e-be21-d054627e1bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:33.008069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfa46c-14dd-42a2-8b73-61eaef3d60bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:33.008256 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1d9b5-023c-477e-be21-d054627e1bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:33.008462 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1d9b5-023c-477e-be21-d054627e1bf5 admin admin] PATH_INFO: `/v3/projects/7ba0fa44e49e4993b5038ffae31b108e/users/0a3f709dcc95495e8002f588cbb9381e/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:33.008563 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfa46c-14dd-42a2-8b73-61eaef3d60bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:33.019212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddfa46c-14dd-42a2-8b73-61eaef3d60bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:33.020649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddfa46c-14dd-42a2-8b73-61eaef3d60bc service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:33.029854 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1d9b5-023c-477e-be21-d054627e1bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba0fa44e49e4993b5038ffae31b108e, user_id=0a3f709dcc95495e8002f588cbb9381e, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:33.030757 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1003/1995] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:26:33.032638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1d9b5-023c-477e-be21-d054627e1bf5 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:33.051845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 993/1996] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:32 2022] PUT /identity/v3/projects/7ba0fa44e49e4993b5038ffae31b108e/users/0a3f709dcc95495e8002f588cbb9381e/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:33.053291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfa46c-14dd-42a2-8b73-61eaef3d60bc service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:33.071627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfa46c-14dd-42a2-8b73-61eaef3d60bc service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:33.162332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4fd6-87fd-4205-987e-e9cf171663ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:33.163004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4fd6-87fd-4205-987e-e9cf171663ce admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:33.163288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4fd6-87fd-4205-987e-e9cf171663ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:33.163394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1d9b5-023c-477e-be21-d054627e1bf5 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:33.163566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac4fd6-87fd-4205-987e-e9cf171663ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:33.164525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac4fd6-87fd-4205-987e-e9cf171663ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:33.167496 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac4fd6-87fd-4205-987e-e9cf171663ce admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:33.183083 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1004/1997] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:33.194651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4fd6-87fd-4205-987e-e9cf171663ce admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:33.214388 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac4fd6-87fd-4205-987e-e9cf171663ce admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:33.220534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c2b65-846b-473c-a3f5-f2fe2637bfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:33.221299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2b65-846b-473c-a3f5-f2fe2637bfb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:33.221586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2b65-846b-473c-a3f5-f2fe2637bfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:33.221872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2b65-846b-473c-a3f5-f2fe2637bfb8 admin admin] PATH_INFO: `/v3/projects/7ba0fa44e49e4993b5038ffae31b108e/users/0a3f709dcc95495e8002f588cbb9381e/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:33.224366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c2b65-846b-473c-a3f5-f2fe2637bfb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba0fa44e49e4993b5038ffae31b108e, user_id=0a3f709dcc95495e8002f588cbb9381e, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:33.227703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c2b65-846b-473c-a3f5-f2fe2637bfb8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:33.241367 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1005/1998] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:33 2022] PUT /identity/v3/projects/7ba0fa44e49e4993b5038ffae31b108e/users/0a3f709dcc95495e8002f588cbb9381e/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:33.253643 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3c29f-533b-4a0c-98fb-2ac5f611eb26 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:33.254659 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3c29f-533b-4a0c-98fb-2ac5f611eb26 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:33.254659 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3c29f-533b-4a0c-98fb-2ac5f611eb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:33.284074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1d9b5-023c-477e-be21-d054627e1bf5 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:33.304141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3ad3c29f-533b-4a0c-98fb-2ac5f611eb26 None None] MFA Rules not processed for user `0a3f709dcc95495e8002f588cbb9381e`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:33.305422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3ad3c29f-533b-4a0c-98fb-2ac5f611eb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:33.318703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:33.420811 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1006/1999] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:33.429857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7befa-0164-4ab5-a19f-01ffbbf07d28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:33.430562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7befa-0164-4ab5-a19f-01ffbbf07d28 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:33.430850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7befa-0164-4ab5-a19f-01ffbbf07d28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:33.431672 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7befa-0164-4ab5-a19f-01ffbbf07d28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:33.440417 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3c29f-533b-4a0c-98fb-2ac5f611eb26 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:33.441839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3ad3c29f-533b-4a0c-98fb-2ac5f611eb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:33.459635 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3c29f-533b-4a0c-98fb-2ac5f611eb26 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:33.463977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244f9b3-6a5d-4f36-8528-0440b4289973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:33.464754 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244f9b3-6a5d-4f36-8528-0440b4289973 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:33.465034 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244f9b3-6a5d-4f36-8528-0440b4289973 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:33.465315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244f9b3-6a5d-4f36-8528-0440b4289973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:33.488995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244f9b3-6a5d-4f36-8528-0440b4289973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:33.490605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244f9b3-6a5d-4f36-8528-0440b4289973 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:33.508334 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1007/2000] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:26:33.551818 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7befa-0164-4ab5-a19f-01ffbbf07d28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:33.553361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7befa-0164-4ab5-a19f-01ffbbf07d28 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:33.585224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 994/2001] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:33.972907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244f9b3-6a5d-4f36-8528-0440b4289973 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:33.983170 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244f9b3-6a5d-4f36-8528-0440b4289973 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:33.987292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe77f5-5c6d-439f-89f1-b41f00770e43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:33.987892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe77f5-5c6d-439f-89f1-b41f00770e43 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:33.988257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe77f5-5c6d-439f-89f1-b41f00770e43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:33.988475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe77f5-5c6d-439f-89f1-b41f00770e43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:34.058391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe77f5-5c6d-439f-89f1-b41f00770e43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:34.059861 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe77f5-5c6d-439f-89f1-b41f00770e43 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:34.068986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1008/2002] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:35.482907 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7befa-0164-4ab5-a19f-01ffbbf07d28 service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:35.484909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-81e7befa-0164-4ab5-a19f-01ffbbf07d28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:35.505467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:35.580728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7befa-0164-4ab5-a19f-01ffbbf07d28 service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:35.587713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cfaad-6eee-4474-9fc7-8a5e95fc4c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:35.590079 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cfaad-6eee-4474-9fc7-8a5e95fc4c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:35.590494 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cfaad-6eee-4474-9fc7-8a5e95fc4c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:35.590808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cfaad-6eee-4474-9fc7-8a5e95fc4c72 admin admin] PATH_INFO: `/v3/users/f472babdb245473ba004e901bf04a7ca` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:35.592039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cfaad-6eee-4474-9fc7-8a5e95fc4c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f472babdb245473ba004e901bf04a7ca)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:35.594646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cfaad-6eee-4474-9fc7-8a5e95fc4c72 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:35.667322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5b3cfaad-6eee-4474-9fc7-8a5e95fc4c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f472babdb245473ba004e901bf04a7ca'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:35.680722 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5b3cfaad-6eee-4474-9fc7-8a5e95fc4c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f472babdb245473ba004e901bf04a7ca'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:35.697915 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5b3cfaad-6eee-4474-9fc7-8a5e95fc4c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f472babdb245473ba004e901bf04a7ca'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:35.697915 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5b3cfaad-6eee-4474-9fc7-8a5e95fc4c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f472babdb245473ba004e901bf04a7ca'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:35.710394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5b3cfaad-6eee-4474-9fc7-8a5e95fc4c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f472babdb245473ba004e901bf04a7ca'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:35.720290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 995/2003] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:35 2022] DELETE /identity/v3/users/f472babdb245473ba004e901bf04a7ca => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:35.724833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b35cb-c249-4ab6-b043-d791e24c9e35 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:35.725275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b35cb-c249-4ab6-b043-d791e24c9e35 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:35.725381 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b35cb-c249-4ab6-b043-d791e24c9e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:35.758877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-205b35cb-c249-4ab6-b043-d791e24c9e35 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:35.760401 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-205b35cb-c249-4ab6-b043-d791e24c9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:35.855633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1009/2004] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:35.865239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cfaad-6eee-4474-9fc7-8a5e95fc4c72 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:35.866656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5b3cfaad-6eee-4474-9fc7-8a5e95fc4c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:35.995175 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cfaad-6eee-4474-9fc7-8a5e95fc4c72 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:36.006917 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c21f6e-5ef2-46f9-a1f1-7d78920bede6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:36.007579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c21f6e-5ef2-46f9-a1f1-7d78920bede6 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:36.007869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c21f6e-5ef2-46f9-a1f1-7d78920bede6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:36.008152 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c21f6e-5ef2-46f9-a1f1-7d78920bede6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:36.027700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c21f6e-5ef2-46f9-a1f1-7d78920bede6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:36.038504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c21f6e-5ef2-46f9-a1f1-7d78920bede6 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:36.079889 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 996/2005] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:37.191547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b35cb-c249-4ab6-b043-d791e24c9e35 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:37.193089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-205b35cb-c249-4ab6-b043-d791e24c9e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:37.207498 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b35cb-c249-4ab6-b043-d791e24c9e35 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:37.212856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:37.213548 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:37.213836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:37.214071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc admin admin] PATH_INFO: `/v3/projects/faaaf76b3c9c4f03b736c192af1f39fc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:37.215317 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=faaaf76b3c9c4f03b736c192af1f39fc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:37.217239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:37.253122 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:37.278648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faaaf76b3c9c4f03b736c192af1f39fc', 'request_id': 'req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:37.283446 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faaaf76b3c9c4f03b736c192af1f39fc', 'request_id': 'req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:37.295584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faaaf76b3c9c4f03b736c192af1f39fc', 'request_id': 'req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:37.306358 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc admin admin] The token cache is being invalidate because project faaaf76b3c9c4f03b736c192af1f39fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:37.307363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:37.308329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ee460b64-aa18-4f46-b8f6-ec6dd8aaf4bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:37.310537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1010/2006] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:37 2022] DELETE /identity/v3/projects/faaaf76b3c9c4f03b736c192af1f39fc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:37.315769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35f57-c026-4b8c-ba32-55a1b3dae383 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:37.316247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35f57-c026-4b8c-ba32-55a1b3dae383 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:37.316339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35f57-c026-4b8c-ba32-55a1b3dae383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:37.361388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-e9f35f57-c026-4b8c-ba32-55a1b3dae383 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:37.362781 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e9f35f57-c026-4b8c-ba32-55a1b3dae383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:37.417254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:37.463986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f2dc-f517-4744-a1a1-7e7c11ecca33 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:37.464185 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f2dc-f517-4744-a1a1-7e7c11ecca33 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:37.464498 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656f2dc-f517-4744-a1a1-7e7c11ecca33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:37.475361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 997/2007] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:37.504937 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2656f2dc-f517-4744-a1a1-7e7c11ecca33 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:37.506333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2656f2dc-f517-4744-a1a1-7e7c11ecca33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:37.515470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1011/2008] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:37.521000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f35f57-c026-4b8c-ba32-55a1b3dae383 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:37.534919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f35f57-c026-4b8c-ba32-55a1b3dae383 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:37.540556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075cdbf-a03e-4ab3-bb25-e30c10a2146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:37.542054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075cdbf-a03e-4ab3-bb25-e30c10a2146e admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:37.542340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075cdbf-a03e-4ab3-bb25-e30c10a2146e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:37.542640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075cdbf-a03e-4ab3-bb25-e30c10a2146e admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:37.543559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075cdbf-a03e-4ab3-bb25-e30c10a2146e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:37.543905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075cdbf-a03e-4ab3-bb25-e30c10a2146e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:37.545826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075cdbf-a03e-4ab3-bb25-e30c10a2146e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:37.561202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 998/2009] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:26:37.565702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656f2dc-f517-4744-a1a1-7e7c11ecca33 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:37.574711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656f2dc-f517-4744-a1a1-7e7c11ecca33 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:37.579576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0637fc1-6421-470f-b41a-a67c83cf7b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:37.580268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637fc1-6421-470f-b41a-a67c83cf7b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:37.580642 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637fc1-6421-470f-b41a-a67c83cf7b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:37.580991 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637fc1-6421-470f-b41a-a67c83cf7b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:37.581766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0637fc1-6421-470f-b41a-a67c83cf7b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:37.584065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0637fc1-6421-470f-b41a-a67c83cf7b9d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:37.608033 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075cdbf-a03e-4ab3-bb25-e30c10a2146e admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:37.610200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d075cdbf-a03e-4ab3-bb25-e30c10a2146e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:37.615811 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1012/2010] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:37 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:37.620347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0637fc1-6421-470f-b41a-a67c83cf7b9d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:37.625566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075cdbf-a03e-4ab3-bb25-e30c10a2146e admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:37.724572 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba8619-7116-41fc-8023-26c7458a609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:37.730011 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba8619-7116-41fc-8023-26c7458a609a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:37.731458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba8619-7116-41fc-8023-26c7458a609a admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:37.731847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba8619-7116-41fc-8023-26c7458a609a admin admin] PATH_INFO: `/v3/users/251d7a64faff4ac0a6ee78cbc5f11e70` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:37.734171 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0637fc1-6421-470f-b41a-a67c83cf7b9d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:37.735743 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba8619-7116-41fc-8023-26c7458a609a admin admin] RBAC: Authorizing `identity:delete_user(user_id=251d7a64faff4ac0a6ee78cbc5f11e70)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:37.740310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e1720-2e2e-47d6-a486-044f3bbc884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:37.740741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba8619-7116-41fc-8023-26c7458a609a admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:37.740945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1720-2e2e-47d6-a486-044f3bbc884e admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:37.741231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1720-2e2e-47d6-a486-044f3bbc884e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:37.741562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1720-2e2e-47d6-a486-044f3bbc884e admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:37.742439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e1720-2e2e-47d6-a486-044f3bbc884e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:37.744887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e1720-2e2e-47d6-a486-044f3bbc884e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:37.780298 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1013/2011] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:37 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:26:37.785292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e1720-2e2e-47d6-a486-044f3bbc884e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:37.803836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e1720-2e2e-47d6-a486-044f3bbc884e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:37.813691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022b44e-6503-47b2-bf36-93047cbd1be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:37.814841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022b44e-6503-47b2-bf36-93047cbd1be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:37.815088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022b44e-6503-47b2-bf36-93047cbd1be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:37.815511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022b44e-6503-47b2-bf36-93047cbd1be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:37.816372 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022b44e-6503-47b2-bf36-93047cbd1be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:37.819278 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022b44e-6503-47b2-bf36-93047cbd1be6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:37.847754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2cba8619-7116-41fc-8023-26c7458a609a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '251d7a64faff4ac0a6ee78cbc5f11e70'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:37.862669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1014/2012] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:37.866663 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022b44e-6503-47b2-bf36-93047cbd1be6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:37.871131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2cba8619-7116-41fc-8023-26c7458a609a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '251d7a64faff4ac0a6ee78cbc5f11e70'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:37.892475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2cba8619-7116-41fc-8023-26c7458a609a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '251d7a64faff4ac0a6ee78cbc5f11e70'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:37.892475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2cba8619-7116-41fc-8023-26c7458a609a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '251d7a64faff4ac0a6ee78cbc5f11e70'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:37.895003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022b44e-6503-47b2-bf36-93047cbd1be6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:37.902155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b031c-ef4c-463e-a26f-ae2f735c8c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:37.903998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b031c-ef4c-463e-a26f-ae2f735c8c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:37.904860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b031c-ef4c-463e-a26f-ae2f735c8c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:37.905254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b031c-ef4c-463e-a26f-ae2f735c8c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:37.906281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b031c-ef4c-463e-a26f-ae2f735c8c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:37.909210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b031c-ef4c-463e-a26f-ae2f735c8c45 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:37.919792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2cba8619-7116-41fc-8023-26c7458a609a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '251d7a64faff4ac0a6ee78cbc5f11e70'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:37.928868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1015/2013] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:37.933980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b031c-ef4c-463e-a26f-ae2f735c8c45 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:37.935075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 999/2014] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:37 2022] DELETE /identity/v3/users/251d7a64faff4ac0a6ee78cbc5f11e70 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:37.936212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-185b031c-ef4c-463e-a26f-ae2f735c8c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:37.939971 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638db07a-8b01-48ce-aef2-7322b5a96751 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:37.940344 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638db07a-8b01-48ce-aef2-7322b5a96751 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:37.940692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638db07a-8b01-48ce-aef2-7322b5a96751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:37.954013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b031c-ef4c-463e-a26f-ae2f735c8c45 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:37.971982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-638db07a-8b01-48ce-aef2-7322b5a96751 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:37.974503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-638db07a-8b01-48ce-aef2-7322b5a96751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:38.042125 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:38.061465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:38.083394 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405931c0-0796-4fad-82d6-54f1071a7aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:38.085536 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405931c0-0796-4fad-82d6-54f1071a7aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:38.086940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405931c0-0796-4fad-82d6-54f1071a7aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:38.087649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1000/2015] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:38.088356 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405931c0-0796-4fad-82d6-54f1071a7aea admin admin] PATH_INFO: `/v3/projects/cd1f23c9d45f47aab803d6065ad79e11/users/d672ac73b2d845adbcd4711229f9d44c/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:38.102451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638db07a-8b01-48ce-aef2-7322b5a96751 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:38.105217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-638db07a-8b01-48ce-aef2-7322b5a96751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:38.134281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405931c0-0796-4fad-82d6-54f1071a7aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1f23c9d45f47aab803d6065ad79e11, user_id=d672ac73b2d845adbcd4711229f9d44c, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:38.138259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405931c0-0796-4fad-82d6-54f1071a7aea admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:38.190453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1016/2016] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:37 2022] PUT /identity/v3/projects/cd1f23c9d45f47aab803d6065ad79e11/users/d672ac73b2d845adbcd4711229f9d44c/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:38.196972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350c6c4-dc64-4b9e-bb2d-390cc1bb1c5e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:38.198623 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350c6c4-dc64-4b9e-bb2d-390cc1bb1c5e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:38.199152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350c6c4-dc64-4b9e-bb2d-390cc1bb1c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:38.240709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9350c6c4-dc64-4b9e-bb2d-390cc1bb1c5e None None] MFA Rules not processed for user `d672ac73b2d845adbcd4711229f9d44c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:38.244411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9350c6c4-dc64-4b9e-bb2d-390cc1bb1c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:38.316498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638db07a-8b01-48ce-aef2-7322b5a96751 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:38.416468 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1017/2017] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:38.424310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea17c9c-adb8-4d85-bb81-0bce83e64bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:38.424971 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea17c9c-adb8-4d85-bb81-0bce83e64bec service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:38.425329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea17c9c-adb8-4d85-bb81-0bce83e64bec service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:38.425681 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea17c9c-adb8-4d85-bb81-0bce83e64bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:38.428952 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350c6c4-dc64-4b9e-bb2d-390cc1bb1c5e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:38.429994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9350c6c4-dc64-4b9e-bb2d-390cc1bb1c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:38.504518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350c6c4-dc64-4b9e-bb2d-390cc1bb1c5e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:38.508871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad9910-7266-4830-b66d-b60e9f07d6f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:38.509564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad9910-7266-4830-b66d-b60e9f07d6f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:38.510368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad9910-7266-4830-b66d-b60e9f07d6f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:38.510669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad9910-7266-4830-b66d-b60e9f07d6f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:38.513913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea17c9c-adb8-4d85-bb81-0bce83e64bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:38.516072 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea17c9c-adb8-4d85-bb81-0bce83e64bec service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:38.520920 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad9910-7266-4830-b66d-b60e9f07d6f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:38.522994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad9910-7266-4830-b66d-b60e9f07d6f9 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:38.528193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1001/2018] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:38.533629 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1018/2019] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:26:38.936098 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea17c9c-adb8-4d85-bb81-0bce83e64bec service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:38.937738 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7ea17c9c-adb8-4d85-bb81-0bce83e64bec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:38.955629 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea17c9c-adb8-4d85-bb81-0bce83e64bec service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:38.961786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:38.962665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:38.962986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:38.963261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] PATH_INFO: `/v3/projects/8d9e0f4802f54ca4870889e4d893e3c4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:38.964592 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9e0f4802f54ca4870889e4d893e3c4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:38.966863 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:39.012090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:39.015614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9e0f4802f54ca4870889e4d893e3c4', 'request_id': 'req-394ce1b4-af0c-45de-a2af-ece080a0eb0c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.024504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9e0f4802f54ca4870889e4d893e3c4', 'request_id': 'req-394ce1b4-af0c-45de-a2af-ece080a0eb0c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.030131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9e0f4802f54ca4870889e4d893e3c4', 'request_id': 'req-394ce1b4-af0c-45de-a2af-ece080a0eb0c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.041534 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] The token cache is being invalidate because project 8d9e0f4802f54ca4870889e4d893e3c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:39.041819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.042495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.044043 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1002/2020] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:38 2022] DELETE /identity/v3/projects/8d9e0f4802f54ca4870889e4d893e3c4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:39.048081 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad9910-7266-4830-b66d-b60e9f07d6f9 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:39.059443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad9910-7266-4830-b66d-b60e9f07d6f9 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:39.115792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ed0b9-6c18-4e68-bec6-932402a3bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:39.116435 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ed0b9-6c18-4e68-bec6-932402a3bab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:39.116717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ed0b9-6c18-4e68-bec6-932402a3bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:39.116997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ed0b9-6c18-4e68-bec6-932402a3bab1 admin admin] PATH_INFO: `/v3/users/53f880a39ece42f89be0ef3286d383b3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:39.118159 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ed0b9-6c18-4e68-bec6-932402a3bab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f880a39ece42f89be0ef3286d383b3)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:39.120754 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ed0b9-6c18-4e68-bec6-932402a3bab1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:39.131169 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:39.167758 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-818ed0b9-6c18-4e68-bec6-932402a3bab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f880a39ece42f89be0ef3286d383b3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.174762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-818ed0b9-6c18-4e68-bec6-932402a3bab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f880a39ece42f89be0ef3286d383b3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.186951 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-818ed0b9-6c18-4e68-bec6-932402a3bab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f880a39ece42f89be0ef3286d383b3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.187575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-818ed0b9-6c18-4e68-bec6-932402a3bab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f880a39ece42f89be0ef3286d383b3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.194292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-818ed0b9-6c18-4e68-bec6-932402a3bab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f880a39ece42f89be0ef3286d383b3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.200298 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1019/2021] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:39 2022] DELETE /identity/v3/users/53f880a39ece42f89be0ef3286d383b3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:39.508540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:39.510331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:39.540307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ce1b4-af0c-45de-a2af-ece080a0eb0c admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:39.653706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a20da-68a4-43f6-9686-b8284e3dd6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:39.654442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a20da-68a4-43f6-9686-b8284e3dd6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:39.655244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a20da-68a4-43f6-9686-b8284e3dd6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:39.655244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a20da-68a4-43f6-9686-b8284e3dd6a0 admin admin] PATH_INFO: `/v3/users/851a334433914677a01622ed3461dff1` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:39.658693 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a20da-68a4-43f6-9686-b8284e3dd6a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851a334433914677a01622ed3461dff1)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:39.660766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a20da-68a4-43f6-9686-b8284e3dd6a0 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:39.746879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-580a20da-68a4-43f6-9686-b8284e3dd6a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851a334433914677a01622ed3461dff1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.771002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-580a20da-68a4-43f6-9686-b8284e3dd6a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851a334433914677a01622ed3461dff1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.782331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-580a20da-68a4-43f6-9686-b8284e3dd6a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851a334433914677a01622ed3461dff1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.784740 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-580a20da-68a4-43f6-9686-b8284e3dd6a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851a334433914677a01622ed3461dff1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.812800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-580a20da-68a4-43f6-9686-b8284e3dd6a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851a334433914677a01622ed3461dff1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:39.829303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1003/2022] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:39 2022] DELETE /identity/v3/users/851a334433914677a01622ed3461dff1 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:39.831016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8ad45-ff59-4621-82fb-23edbf7a2752 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:39.831316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8ad45-ff59-4621-82fb-23edbf7a2752 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:39.831592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8ad45-ff59-4621-82fb-23edbf7a2752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:39.866376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0dc8ad45-ff59-4621-82fb-23edbf7a2752 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:39.867837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0dc8ad45-ff59-4621-82fb-23edbf7a2752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:39.951558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1020/2023] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:39.980849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a20da-68a4-43f6-9686-b8284e3dd6a0 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:39.982218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-580a20da-68a4-43f6-9686-b8284e3dd6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:40.036293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8ad45-ff59-4621-82fb-23edbf7a2752 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:40.038190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0dc8ad45-ff59-4621-82fb-23edbf7a2752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:40.056167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8ad45-ff59-4621-82fb-23edbf7a2752 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:40.064089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cb27b-9716-428b-92a9-9db4cef9fe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:40.065007 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cb27b-9716-428b-92a9-9db4cef9fe85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:40.065297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cb27b-9716-428b-92a9-9db4cef9fe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:40.065575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cb27b-9716-428b-92a9-9db4cef9fe85 admin admin] PATH_INFO: `/v3/users/d2d13eb4fa2b4a5586feae94349b4cf4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:40.066885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cb27b-9716-428b-92a9-9db4cef9fe85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d13eb4fa2b4a5586feae94349b4cf4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:40.070644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cb27b-9716-428b-92a9-9db4cef9fe85 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:40.100157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a20da-68a4-43f6-9686-b8284e3dd6a0 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:40.105281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f94e09-bb34-4ae2-9b62-73dc23f83781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:40.105838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f94e09-bb34-4ae2-9b62-73dc23f83781 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:40.106192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f94e09-bb34-4ae2-9b62-73dc23f83781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:40.106600 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f94e09-bb34-4ae2-9b62-73dc23f83781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:40.127905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:40.132823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f94e09-bb34-4ae2-9b62-73dc23f83781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:40.136145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f94e09-bb34-4ae2-9b62-73dc23f83781 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:40.157294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1004/2024] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:40.158286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f94e09-bb34-4ae2-9b62-73dc23f83781 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:40.161210 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a2f94e09-bb34-4ae2-9b62-73dc23f83781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:40.165543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a13cb27b-9716-428b-92a9-9db4cef9fe85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d13eb4fa2b4a5586feae94349b4cf4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:40.178622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f94e09-bb34-4ae2-9b62-73dc23f83781 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:40.179913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a13cb27b-9716-428b-92a9-9db4cef9fe85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d13eb4fa2b4a5586feae94349b4cf4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:40.185513 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebee138-f4f4-49ba-a173-42b2a91f769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:40.191287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebee138-f4f4-49ba-a173-42b2a91f769b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:40.191811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebee138-f4f4-49ba-a173-42b2a91f769b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:40.192263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebee138-f4f4-49ba-a173-42b2a91f769b admin admin] PATH_INFO: `/v3/projects/694fa52d71e74625b8dfeeb912e81bb1` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:40.194353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebee138-f4f4-49ba-a173-42b2a91f769b admin admin] RBAC: Authorizing `identity:delete_project(project_id=694fa52d71e74625b8dfeeb912e81bb1)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:40.196709 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebee138-f4f4-49ba-a173-42b2a91f769b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:40.201577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a13cb27b-9716-428b-92a9-9db4cef9fe85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d13eb4fa2b4a5586feae94349b4cf4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:40.202470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a13cb27b-9716-428b-92a9-9db4cef9fe85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d13eb4fa2b4a5586feae94349b4cf4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:40.215227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a13cb27b-9716-428b-92a9-9db4cef9fe85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d13eb4fa2b4a5586feae94349b4cf4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:40.219771 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:40.236518 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1021/2025] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:40 2022] DELETE /identity/v3/users/d2d13eb4fa2b4a5586feae94349b4cf4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:40.242316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39125f41-8d87-4914-9241-db0124e2c191 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:40.242641 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39125f41-8d87-4914-9241-db0124e2c191 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:40.242927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39125f41-8d87-4914-9241-db0124e2c191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:40.279481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-39125f41-8d87-4914-9241-db0124e2c191 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:40.280733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-39125f41-8d87-4914-9241-db0124e2c191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:40.284970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1ebee138-f4f4-49ba-a173-42b2a91f769b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '694fa52d71e74625b8dfeeb912e81bb1', 'request_id': 'req-1ebee138-f4f4-49ba-a173-42b2a91f769b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:40.298758 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1ebee138-f4f4-49ba-a173-42b2a91f769b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '694fa52d71e74625b8dfeeb912e81bb1', 'request_id': 'req-1ebee138-f4f4-49ba-a173-42b2a91f769b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:40.321072 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1ebee138-f4f4-49ba-a173-42b2a91f769b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '694fa52d71e74625b8dfeeb912e81bb1', 'request_id': 'req-1ebee138-f4f4-49ba-a173-42b2a91f769b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:40.338559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1ebee138-f4f4-49ba-a173-42b2a91f769b admin admin] The token cache is being invalidate because project 694fa52d71e74625b8dfeeb912e81bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:40.339049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1ebee138-f4f4-49ba-a173-42b2a91f769b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:40.339968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1ebee138-f4f4-49ba-a173-42b2a91f769b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:40.341941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1005/2026] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:40 2022] DELETE /identity/v3/projects/694fa52d71e74625b8dfeeb912e81bb1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:40.348495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a880ac2-46c8-457f-9dbe-274fe6e952bb None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:40.349395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a880ac2-46c8-457f-9dbe-274fe6e952bb None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:40.349916 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a880ac2-46c8-457f-9dbe-274fe6e952bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:40.352199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1022/2027] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:40.364461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39125f41-8d87-4914-9241-db0124e2c191 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:40.366285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-39125f41-8d87-4914-9241-db0124e2c191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:40.376184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-4a880ac2-46c8-457f-9dbe-274fe6e952bb None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:40.377540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4a880ac2-46c8-457f-9dbe-274fe6e952bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:40.395688 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1006/2028] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:40.397377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e34e0-5f1b-4ff2-a242-54f5d96ab66b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:40.397617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e34e0-5f1b-4ff2-a242-54f5d96ab66b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:40.397911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e34e0-5f1b-4ff2-a242-54f5d96ab66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:40.425179 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-4f5e34e0-5f1b-4ff2-a242-54f5d96ab66b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:40.428426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4f5e34e0-5f1b-4ff2-a242-54f5d96ab66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:40.452239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1007/2029] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:40.453274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e34e0-5f1b-4ff2-a242-54f5d96ab66b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:40.476224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e34e0-5f1b-4ff2-a242-54f5d96ab66b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:40.487821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c9202-6a46-428b-9f1d-c2d9736532de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:40.489485 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c9202-6a46-428b-9f1d-c2d9736532de admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:40.489485 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c9202-6a46-428b-9f1d-c2d9736532de admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:40.489688 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c9202-6a46-428b-9f1d-c2d9736532de admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:40.490356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c9202-6a46-428b-9f1d-c2d9736532de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:40.491699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c9202-6a46-428b-9f1d-c2d9736532de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:40.493417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c9202-6a46-428b-9f1d-c2d9736532de admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:40.509648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39125f41-8d87-4914-9241-db0124e2c191 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:40.520075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303fa66-fe2f-4b95-9af4-28a434b00273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:40.520996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303fa66-fe2f-4b95-9af4-28a434b00273 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:40.521425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303fa66-fe2f-4b95-9af4-28a434b00273 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:40.521902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303fa66-fe2f-4b95-9af4-28a434b00273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:40.524857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1008/2030] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:26:40.530202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c9202-6a46-428b-9f1d-c2d9736532de admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:40.551229 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303fa66-fe2f-4b95-9af4-28a434b00273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:40.552800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303fa66-fe2f-4b95-9af4-28a434b00273 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:40.555340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c9202-6a46-428b-9f1d-c2d9736532de admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:40.574726 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8052cd9-1abc-4d82-a0dd-440df97abe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:40.575283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8052cd9-1abc-4d82-a0dd-440df97abe98 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:40.575570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8052cd9-1abc-4d82-a0dd-440df97abe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:40.575849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8052cd9-1abc-4d82-a0dd-440df97abe98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:40.579755 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8052cd9-1abc-4d82-a0dd-440df97abe98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:40.585035 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8052cd9-1abc-4d82-a0dd-440df97abe98 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:40.585714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1023/2031] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:40.644058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1009/2032] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:40 2022] POST /identity/v3/projects => generated 409 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:40.648345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303fa66-fe2f-4b95-9af4-28a434b00273 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:40.678516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303fa66-fe2f-4b95-9af4-28a434b00273 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:40.707806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8052cd9-1abc-4d82-a0dd-440df97abe98 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:40.710932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c8052cd9-1abc-4d82-a0dd-440df97abe98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:40.840965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633523b-6a1b-4a2d-bb01-8505373df3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:40.841717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633523b-6a1b-4a2d-bb01-8505373df3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:40.842004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633523b-6a1b-4a2d-bb01-8505373df3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:40.842274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633523b-6a1b-4a2d-bb01-8505373df3d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:40.844898 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633523b-6a1b-4a2d-bb01-8505373df3d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:40.847894 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633523b-6a1b-4a2d-bb01-8505373df3d1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:40.867529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8052cd9-1abc-4d82-a0dd-440df97abe98 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:40.881389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:40.882091 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:40.882339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:40.882743 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] PATH_INFO: `/v3/projects/d1117a7fc76848c98432637f0e0a7b0a` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:40.884157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1117a7fc76848c98432637f0e0a7b0a)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:40.888418 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:40.892821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1024/2033] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:40 2022] POST /identity/v3/users => generated 305 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:40.896825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633523b-6a1b-4a2d-bb01-8505373df3d1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:40.917223 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633523b-6a1b-4a2d-bb01-8505373df3d1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:40.931191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b66bc9-6136-4b7d-a997-5aec059a7c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:40.932784 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b66bc9-6136-4b7d-a997-5aec059a7c2d admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:40.932989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b66bc9-6136-4b7d-a997-5aec059a7c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:40.934376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b66bc9-6136-4b7d-a997-5aec059a7c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:40.935141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b66bc9-6136-4b7d-a997-5aec059a7c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:40.939057 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b66bc9-6136-4b7d-a997-5aec059a7c2d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:40.942835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:40.961979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1025/2034] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:40.963922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b66bc9-6136-4b7d-a997-5aec059a7c2d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:40.977011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b66bc9-6136-4b7d-a997-5aec059a7c2d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:40.977968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1117a7fc76848c98432637f0e0a7b0a', 'request_id': 'req-4d2e4f2e-e26f-4592-a204-5687abf2689b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:40.999289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1117a7fc76848c98432637f0e0a7b0a', 'request_id': 'req-4d2e4f2e-e26f-4592-a204-5687abf2689b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.001856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:41.007435 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1117a7fc76848c98432637f0e0a7b0a', 'request_id': 'req-4d2e4f2e-e26f-4592-a204-5687abf2689b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.041763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] The token cache is being invalidate because project d1117a7fc76848c98432637f0e0a7b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:41.042111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.043115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.047261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc7733-1b9b-488b-9745-6eb2fdbaf1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:41.048437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc7733-1b9b-488b-9745-6eb2fdbaf1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:41.048437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc7733-1b9b-488b-9745-6eb2fdbaf1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:41.048634 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1010/2035] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:40 2022] DELETE /identity/v3/projects/d1117a7fc76848c98432637f0e0a7b0a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:41.048728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc7733-1b9b-488b-9745-6eb2fdbaf1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:41.053328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc7733-1b9b-488b-9745-6eb2fdbaf1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:41.053611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:41.054624 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc7733-1b9b-488b-9745-6eb2fdbaf1b5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:41.055260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:41.067494 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1026/2036] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:41.085773 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc7733-1b9b-488b-9745-6eb2fdbaf1b5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:41.087271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-31dc7733-1b9b-488b-9745-6eb2fdbaf1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:41.093972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e4f2e-e26f-4592-a204-5687abf2689b admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:41.102884 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc7733-1b9b-488b-9745-6eb2fdbaf1b5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:41.104154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad80d2-9e74-437c-9efb-acd339b0a3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:41.105742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad80d2-9e74-437c-9efb-acd339b0a3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:41.106153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad80d2-9e74-437c-9efb-acd339b0a3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:41.106655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad80d2-9e74-437c-9efb-acd339b0a3a7 admin admin] PATH_INFO: `/v3/users/0a3f709dcc95495e8002f588cbb9381e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:41.108130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad80d2-9e74-437c-9efb-acd339b0a3a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a3f709dcc95495e8002f588cbb9381e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:41.111028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d319568-3b83-437b-b0a3-527136c4dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:41.111903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319568-3b83-437b-b0a3-527136c4dd97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:41.112081 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad80d2-9e74-437c-9efb-acd339b0a3a7 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:41.112504 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319568-3b83-437b-b0a3-527136c4dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:41.112935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319568-3b83-437b-b0a3-527136c4dd97 admin admin] PATH_INFO: `/v3/projects/15210715020440d6aef19fd680f21166/users/2efd6ab34cb841ddbd9092c5d1486704/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:41.132966 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d319568-3b83-437b-b0a3-527136c4dd97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15210715020440d6aef19fd680f21166, user_id=2efd6ab34cb841ddbd9092c5d1486704, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:41.136464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d319568-3b83-437b-b0a3-527136c4dd97 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:41.161318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1027/2037] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:41 2022] PUT /identity/v3/projects/15210715020440d6aef19fd680f21166/users/2efd6ab34cb841ddbd9092c5d1486704/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:41.172698 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a0db7-17f1-4160-ac2a-4bde5e6700b1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:41.173214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a0db7-17f1-4160-ac2a-4bde5e6700b1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:41.173657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a0db7-17f1-4160-ac2a-4bde5e6700b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:41.196277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1bad80d2-9e74-437c-9efb-acd339b0a3a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a3f709dcc95495e8002f588cbb9381e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.216806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1bad80d2-9e74-437c-9efb-acd339b0a3a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a3f709dcc95495e8002f588cbb9381e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.240480 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1bad80d2-9e74-437c-9efb-acd339b0a3a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a3f709dcc95495e8002f588cbb9381e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.241025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1bad80d2-9e74-437c-9efb-acd339b0a3a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a3f709dcc95495e8002f588cbb9381e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.246503 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b84a0db7-17f1-4160-ac2a-4bde5e6700b1 None None] MFA Rules not processed for user `2efd6ab34cb841ddbd9092c5d1486704`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:41.248948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b84a0db7-17f1-4160-ac2a-4bde5e6700b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:41.258941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1bad80d2-9e74-437c-9efb-acd339b0a3a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a3f709dcc95495e8002f588cbb9381e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.269425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1011/2038] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:41 2022] DELETE /identity/v3/users/0a3f709dcc95495e8002f588cbb9381e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:41.357717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1028/2039] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:41 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:41.372038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad80d2-9e74-437c-9efb-acd339b0a3a7 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:41.373600 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1bad80d2-9e74-437c-9efb-acd339b0a3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:41.427059 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a0db7-17f1-4160-ac2a-4bde5e6700b1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:41.429471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b84a0db7-17f1-4160-ac2a-4bde5e6700b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:41.512838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad80d2-9e74-437c-9efb-acd339b0a3a7 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:41.519102 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c56e5-3d49-4eb6-8d6e-11a8eb3bb10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:41.520092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c56e5-3d49-4eb6-8d6e-11a8eb3bb10d admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:41.520559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c56e5-3d49-4eb6-8d6e-11a8eb3bb10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:41.520857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c56e5-3d49-4eb6-8d6e-11a8eb3bb10d admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:41.522205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c56e5-3d49-4eb6-8d6e-11a8eb3bb10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:41.524589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c56e5-3d49-4eb6-8d6e-11a8eb3bb10d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:41.548665 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a0db7-17f1-4160-ac2a-4bde5e6700b1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:41.559211 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:41.559918 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:41.560198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:41.560742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] PATH_INFO: `/v3/projects/baf7a42c3e84478ab8a36c629c7b57dc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:41.562022 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baf7a42c3e84478ab8a36c629c7b57dc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:41.563889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:41.568507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1012/2040] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:41 2022] POST /identity/v3/projects => generated 409 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:26:41.577928 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c56e5-3d49-4eb6-8d6e-11a8eb3bb10d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:41.611242 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:41.623389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:41.635596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baf7a42c3e84478ab8a36c629c7b57dc', 'request_id': 'req-d56f3651-cf60-41b7-bfc2-0505ad18b549'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.644397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baf7a42c3e84478ab8a36c629c7b57dc', 'request_id': 'req-d56f3651-cf60-41b7-bfc2-0505ad18b549'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.655890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baf7a42c3e84478ab8a36c629c7b57dc', 'request_id': 'req-d56f3651-cf60-41b7-bfc2-0505ad18b549'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.688998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] The token cache is being invalidate because project baf7a42c3e84478ab8a36c629c7b57dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:41.689417 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.690196 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.695846 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1029/2041] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:41 2022] DELETE /identity/v3/projects/baf7a42c3e84478ab8a36c629c7b57dc => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:41.701054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:41.705501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:41.730964 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c56e5-3d49-4eb6-8d6e-11a8eb3bb10d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:41.816822 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f3651-cf60-41b7-bfc2-0505ad18b549 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:41.823842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a5d33-0ac9-4ac2-acd9-c815d25aad9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:41.824559 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a5d33-0ac9-4ac2-acd9-c815d25aad9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:41.824896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a5d33-0ac9-4ac2-acd9-c815d25aad9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:41.825179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a5d33-0ac9-4ac2-acd9-c815d25aad9b admin admin] PATH_INFO: `/v3/users/7897a4d080534a5eb750653fe2230a3d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:41.826594 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a5d33-0ac9-4ac2-acd9-c815d25aad9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7897a4d080534a5eb750653fe2230a3d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:41.829207 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a5d33-0ac9-4ac2-acd9-c815d25aad9b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:41.854166 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b86b4-7191-462f-97d2-3776a7361534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:41.858458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b86b4-7191-462f-97d2-3776a7361534 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:41.858816 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b86b4-7191-462f-97d2-3776a7361534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:41.859102 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b86b4-7191-462f-97d2-3776a7361534 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:41.859799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b86b4-7191-462f-97d2-3776a7361534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:41.865696 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b86b4-7191-462f-97d2-3776a7361534 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:41.898272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1013/2042] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:41 2022] POST /identity/v3/users => generated 311 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:41.899835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b86b4-7191-462f-97d2-3776a7361534 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:41.902479 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9e5b86b4-7191-462f-97d2-3776a7361534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:41.917110 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b86b4-7191-462f-97d2-3776a7361534 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:41.921971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-369a5d33-0ac9-4ac2-acd9-c815d25aad9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7897a4d080534a5eb750653fe2230a3d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.924831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066747c-0d35-4b62-b4a1-cc649e4ffdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:41.925813 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066747c-0d35-4b62-b4a1-cc649e4ffdee admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:41.926188 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066747c-0d35-4b62-b4a1-cc649e4ffdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:41.926572 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066747c-0d35-4b62-b4a1-cc649e4ffdee admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:41.927390 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066747c-0d35-4b62-b4a1-cc649e4ffdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:41.929048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066747c-0d35-4b62-b4a1-cc649e4ffdee admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:41.934025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-369a5d33-0ac9-4ac2-acd9-c815d25aad9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7897a4d080534a5eb750653fe2230a3d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.943378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1014/2043] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:41.948576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066747c-0d35-4b62-b4a1-cc649e4ffdee admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:41.960117 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-369a5d33-0ac9-4ac2-acd9-c815d25aad9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7897a4d080534a5eb750653fe2230a3d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.960945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-369a5d33-0ac9-4ac2-acd9-c815d25aad9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7897a4d080534a5eb750653fe2230a3d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.970610 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066747c-0d35-4b62-b4a1-cc649e4ffdee admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:41.974597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-369a5d33-0ac9-4ac2-acd9-c815d25aad9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7897a4d080534a5eb750653fe2230a3d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:41.977731 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba103e-34c8-448b-bd93-a3fcfbc95bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:41.979668 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba103e-34c8-448b-bd93-a3fcfbc95bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:41.980122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba103e-34c8-448b-bd93-a3fcfbc95bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:41.980555 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba103e-34c8-448b-bd93-a3fcfbc95bc4 admin admin] PATH_INFO: `/v3/projects/2d1230e5e1f8457da98a81b49c40be7e/users/0337231cc15a45efab563cba933d949c/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:41.989660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1030/2044] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:41 2022] DELETE /identity/v3/users/7897a4d080534a5eb750653fe2230a3d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:42.009426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba103e-34c8-448b-bd93-a3fcfbc95bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1230e5e1f8457da98a81b49c40be7e, user_id=0337231cc15a45efab563cba933d949c, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:42.012170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba103e-34c8-448b-bd93-a3fcfbc95bc4 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:42.029566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1015/2045] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:41 2022] PUT /identity/v3/projects/2d1230e5e1f8457da98a81b49c40be7e/users/0337231cc15a45efab563cba933d949c/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:42.033582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a5d33-0ac9-4ac2-acd9-c815d25aad9b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:42.035112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-369a5d33-0ac9-4ac2-acd9-c815d25aad9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:42.073753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba103e-34c8-448b-bd93-a3fcfbc95bc4 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:42.075673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-33ba103e-34c8-448b-bd93-a3fcfbc95bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:42.081526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:42.142867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a5d33-0ac9-4ac2-acd9-c815d25aad9b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:42.180566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba103e-34c8-448b-bd93-a3fcfbc95bc4 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:42.190535 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb4557-2d90-44f8-828f-63e78c0c25c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:42.191209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb4557-2d90-44f8-828f-63e78c0c25c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:42.191498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb4557-2d90-44f8-828f-63e78c0c25c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:42.192155 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb4557-2d90-44f8-828f-63e78c0c25c6 admin admin] PATH_INFO: `/v3/projects/7ba0fa44e49e4993b5038ffae31b108e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:42.193825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb4557-2d90-44f8-828f-63e78c0c25c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba0fa44e49e4993b5038ffae31b108e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:42.196349 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb4557-2d90-44f8-828f-63e78c0c25c6 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:42.208561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a272f2-74fe-4d0e-99af-38bd4eaa8857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:42.209193 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a272f2-74fe-4d0e-99af-38bd4eaa8857 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:42.209477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a272f2-74fe-4d0e-99af-38bd4eaa8857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:42.209752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a272f2-74fe-4d0e-99af-38bd4eaa8857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:42.210475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a272f2-74fe-4d0e-99af-38bd4eaa8857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:42.212115 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a272f2-74fe-4d0e-99af-38bd4eaa8857 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:42.223071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1031/2046] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:42.227498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:42.227761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a272f2-74fe-4d0e-99af-38bd4eaa8857 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:42.249023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a272f2-74fe-4d0e-99af-38bd4eaa8857 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:42.266892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e1cb4557-2d90-44f8-828f-63e78c0c25c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba0fa44e49e4993b5038ffae31b108e', 'request_id': 'req-e1cb4557-2d90-44f8-828f-63e78c0c25c6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:42.279985 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e1cb4557-2d90-44f8-828f-63e78c0c25c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba0fa44e49e4993b5038ffae31b108e', 'request_id': 'req-e1cb4557-2d90-44f8-828f-63e78c0c25c6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:42.286888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e1cb4557-2d90-44f8-828f-63e78c0c25c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba0fa44e49e4993b5038ffae31b108e', 'request_id': 'req-e1cb4557-2d90-44f8-828f-63e78c0c25c6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:42.304369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e1cb4557-2d90-44f8-828f-63e78c0c25c6 admin admin] The token cache is being invalidate because project 7ba0fa44e49e4993b5038ffae31b108e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:42.304668 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e1cb4557-2d90-44f8-828f-63e78c0c25c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:42.305359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e1cb4557-2d90-44f8-828f-63e78c0c25c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:42.310464 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1016/2047] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:42 2022] DELETE /identity/v3/projects/7ba0fa44e49e4993b5038ffae31b108e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:42.314252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a805b-ca1d-4de7-8ad8-65fc169bd542 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:42.315140 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a805b-ca1d-4de7-8ad8-65fc169bd542 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:42.316632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a805b-ca1d-4de7-8ad8-65fc169bd542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:42.356833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-1e4a805b-ca1d-4de7-8ad8-65fc169bd542 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:42.358611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1e4a805b-ca1d-4de7-8ad8-65fc169bd542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:42.379069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2ef22-8fba-458d-a48f-b00af7a61436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:42.379760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ef22-8fba-458d-a48f-b00af7a61436 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:42.380183 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ef22-8fba-458d-a48f-b00af7a61436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:42.380516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ef22-8fba-458d-a48f-b00af7a61436 admin admin] PATH_INFO: `/v3/projects/2d1230e5e1f8457da98a81b49c40be7e/users/0337231cc15a45efab563cba933d949c/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:42.383415 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2ef22-8fba-458d-a48f-b00af7a61436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1230e5e1f8457da98a81b49c40be7e, user_id=0337231cc15a45efab563cba933d949c, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:42.387038 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2ef22-8fba-458d-a48f-b00af7a61436 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:42.399983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1032/2048] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:42 2022] PUT /identity/v3/projects/2d1230e5e1f8457da98a81b49c40be7e/users/0337231cc15a45efab563cba933d949c/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:42.412900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929821b3-9823-416e-b818-68252ba2e5c9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:42.413239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929821b3-9823-416e-b818-68252ba2e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:42.413521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929821b3-9823-416e-b818-68252ba2e5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:42.471205 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-929821b3-9823-416e-b818-68252ba2e5c9 None None] MFA Rules not processed for user `0337231cc15a45efab563cba933d949c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:42.472685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-929821b3-9823-416e-b818-68252ba2e5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:42.514299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1017/2049] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:42.516818 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9c602-5135-4fd9-b6be-4ea0848227b7 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:42.517065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9c602-5135-4fd9-b6be-4ea0848227b7 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:42.517360 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9c602-5135-4fd9-b6be-4ea0848227b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:42.545832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-7ac9c602-5135-4fd9-b6be-4ea0848227b7 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:42.547165 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7ac9c602-5135-4fd9-b6be-4ea0848227b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:42.572180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:42.597063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1033/2050] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:42 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:42.612135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929821b3-9823-416e-b818-68252ba2e5c9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:42.613945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-929821b3-9823-416e-b818-68252ba2e5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:42.622741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1018/2051] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:42.627739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9c602-5135-4fd9-b6be-4ea0848227b7 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:42.642581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9c602-5135-4fd9-b6be-4ea0848227b7 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:42.657741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f9dea-140b-4d26-a613-aea0923ea984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:42.660531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f9dea-140b-4d26-a613-aea0923ea984 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:42.660531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f9dea-140b-4d26-a613-aea0923ea984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:42.660531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f9dea-140b-4d26-a613-aea0923ea984 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:42.662252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f9dea-140b-4d26-a613-aea0923ea984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:42.663576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f9dea-140b-4d26-a613-aea0923ea984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:42.667763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f9dea-140b-4d26-a613-aea0923ea984 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:42.694677 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1019/2052] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:26:42.702807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f9dea-140b-4d26-a613-aea0923ea984 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:42.708042 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929821b3-9823-416e-b818-68252ba2e5c9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:42.714841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2049848-fc35-4b78-879b-8d62abf3c524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:42.715478 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2049848-fc35-4b78-879b-8d62abf3c524 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:42.715759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2049848-fc35-4b78-879b-8d62abf3c524 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:42.716701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2049848-fc35-4b78-879b-8d62abf3c524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:42.716822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f9dea-140b-4d26-a613-aea0923ea984 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:42.723265 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce893ea3-5c42-4d8c-9e4e-db48db2eb769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:42.723891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893ea3-5c42-4d8c-9e4e-db48db2eb769 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:42.724318 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893ea3-5c42-4d8c-9e4e-db48db2eb769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:42.724598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce893ea3-5c42-4d8c-9e4e-db48db2eb769 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:42.725584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce893ea3-5c42-4d8c-9e4e-db48db2eb769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:42.728540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce893ea3-5c42-4d8c-9e4e-db48db2eb769 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:42.729347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2049848-fc35-4b78-879b-8d62abf3c524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:42.730911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2049848-fc35-4b78-879b-8d62abf3c524 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:42.759180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1034/2053] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:42 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:42.768989 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1020/2054] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:42 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:42.773037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2049848-fc35-4b78-879b-8d62abf3c524 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:42.789333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2049848-fc35-4b78-879b-8d62abf3c524 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:42.907186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91f619-4b05-40db-afda-c3cf5b616cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:42.908446 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91f619-4b05-40db-afda-c3cf5b616cce admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:42.909215 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91f619-4b05-40db-afda-c3cf5b616cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:42.909760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91f619-4b05-40db-afda-c3cf5b616cce admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:42.910690 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91f619-4b05-40db-afda-c3cf5b616cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:42.913790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91f619-4b05-40db-afda-c3cf5b616cce admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:42.966508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1035/2055] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:42 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:42.972245 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce893ea3-5c42-4d8c-9e4e-db48db2eb769 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:42.997285 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce893ea3-5c42-4d8c-9e4e-db48db2eb769 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:43.014800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b5316-760a-440a-a052-5b4358a04d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:43.015589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b5316-760a-440a-a052-5b4358a04d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:43.015898 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b5316-760a-440a-a052-5b4358a04d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:43.016151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b5316-760a-440a-a052-5b4358a04d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:43.016859 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b5316-760a-440a-a052-5b4358a04d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:43.018513 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b5316-760a-440a-a052-5b4358a04d83 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:43.039176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1021/2056] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:43.040881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91f619-4b05-40db-afda-c3cf5b616cce admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:43.046104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b5316-760a-440a-a052-5b4358a04d83 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:43.051668 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91f619-4b05-40db-afda-c3cf5b616cce admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:43.053188 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:43.058334 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee671a-66eb-42a7-a2db-7cecc0c40d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:43.058994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee671a-66eb-42a7-a2db-7cecc0c40d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:43.059277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee671a-66eb-42a7-a2db-7cecc0c40d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:43.059846 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee671a-66eb-42a7-a2db-7cecc0c40d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:43.060498 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee671a-66eb-42a7-a2db-7cecc0c40d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:43.063506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee671a-66eb-42a7-a2db-7cecc0c40d35 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:43.081341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1036/2057] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:43.082640 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee671a-66eb-42a7-a2db-7cecc0c40d35 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:43.096152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee671a-66eb-42a7-a2db-7cecc0c40d35 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:43.103748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1d815-4d94-495a-8970-46dcee8dc374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:43.104628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1d815-4d94-495a-8970-46dcee8dc374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:43.105603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1d815-4d94-495a-8970-46dcee8dc374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:43.106310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1d815-4d94-495a-8970-46dcee8dc374 admin admin] PATH_INFO: `/v3/projects/c0badb51a27d49069aec5f50b0d14aee/users/0f7c80211ad849d0b88738619c382a0c/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:43.137616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1d815-4d94-495a-8970-46dcee8dc374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0badb51a27d49069aec5f50b0d14aee, user_id=0f7c80211ad849d0b88738619c382a0c, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:43.138693 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b5316-760a-440a-a052-5b4358a04d83 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:43.140533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1d815-4d94-495a-8970-46dcee8dc374 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:43.142802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062a613-0784-413a-9bcf-884bc809bc30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:43.143452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062a613-0784-413a-9bcf-884bc809bc30 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:43.143739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062a613-0784-413a-9bcf-884bc809bc30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:43.144018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062a613-0784-413a-9bcf-884bc809bc30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:43.145870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5062a613-0784-413a-9bcf-884bc809bc30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:43.157705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1037/2058] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:43 2022] PUT /identity/v3/projects/c0badb51a27d49069aec5f50b0d14aee/users/0f7c80211ad849d0b88738619c382a0c/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:43.171596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d3ed0-ba38-49b0-88ec-d3c242a26a74 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:43.172008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d3ed0-ba38-49b0-88ec-d3c242a26a74 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:43.172127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d3ed0-ba38-49b0-88ec-d3c242a26a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:43.206454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a73d3ed0-ba38-49b0-88ec-d3c242a26a74 None None] MFA Rules not processed for user `0f7c80211ad849d0b88738619c382a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:43.207714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a73d3ed0-ba38-49b0-88ec-d3c242a26a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:43.229796 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062a613-0784-413a-9bcf-884bc809bc30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:43.231502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062a613-0784-413a-9bcf-884bc809bc30 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:43.242017 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1022/2059] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:43 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:26:43.258887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:43.297642 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1038/2060] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:43.302166 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062a613-0784-413a-9bcf-884bc809bc30 service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:43.321019 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062a613-0784-413a-9bcf-884bc809bc30 service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:43.395692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f9123-4aba-44dd-ab37-57748ac4fd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:43.396582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f9123-4aba-44dd-ab37-57748ac4fd90 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:43.396777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f9123-4aba-44dd-ab37-57748ac4fd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:43.397190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f9123-4aba-44dd-ab37-57748ac4fd90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:43.398074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f9123-4aba-44dd-ab37-57748ac4fd90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:43.400056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f9123-4aba-44dd-ab37-57748ac4fd90 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:43.438296 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1023/2061] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:43 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:43.439459 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d3ed0-ba38-49b0-88ec-d3c242a26a74 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:43.456524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d3ed0-ba38-49b0-88ec-d3c242a26a74 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:43.548693 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb39eff-7989-450f-8e2c-957f65df9c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:43.550399 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb39eff-7989-450f-8e2c-957f65df9c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:43.553477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb39eff-7989-450f-8e2c-957f65df9c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:43.553477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb39eff-7989-450f-8e2c-957f65df9c09 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:43.553477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb39eff-7989-450f-8e2c-957f65df9c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:43.555952 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb39eff-7989-450f-8e2c-957f65df9c09 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:43.558477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f9123-4aba-44dd-ab37-57748ac4fd90 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:43.560379 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-052f9123-4aba-44dd-ab37-57748ac4fd90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:43.579287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f9123-4aba-44dd-ab37-57748ac4fd90 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:43.596083 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1039/2062] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:43 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:43.596607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb39eff-7989-450f-8e2c-957f65df9c09 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:43.597402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab786a-b1e2-400a-ae22-88048bd9e817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:43.598084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab786a-b1e2-400a-ae22-88048bd9e817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:43.598373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab786a-b1e2-400a-ae22-88048bd9e817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:43.609082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab786a-b1e2-400a-ae22-88048bd9e817 admin admin] PATH_INFO: `/v3/projects/c31d5e9d774a4f12b0679b06fec712c8` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:43.611154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab786a-b1e2-400a-ae22-88048bd9e817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31d5e9d774a4f12b0679b06fec712c8)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:43.613250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab786a-b1e2-400a-ae22-88048bd9e817 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:43.618327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb39eff-7989-450f-8e2c-957f65df9c09 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:43.631514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acaed1-3993-42c4-a039-1c26d5177008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:43.633779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acaed1-3993-42c4-a039-1c26d5177008 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:43.634069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acaed1-3993-42c4-a039-1c26d5177008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:43.634342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acaed1-3993-42c4-a039-1c26d5177008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:43.640006 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acaed1-3993-42c4-a039-1c26d5177008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:43.644005 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acaed1-3993-42c4-a039-1c26d5177008 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:43.664832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1040/2063] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:43.668630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acaed1-3993-42c4-a039-1c26d5177008 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:43.688068 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acaed1-3993-42c4-a039-1c26d5177008 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:43.696983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1faea9-5b6f-4382-8750-2ccc5fc1236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:43.698636 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1faea9-5b6f-4382-8750-2ccc5fc1236f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:43.701225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1faea9-5b6f-4382-8750-2ccc5fc1236f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:43.701225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1faea9-5b6f-4382-8750-2ccc5fc1236f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:43.701225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1faea9-5b6f-4382-8750-2ccc5fc1236f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:43.703746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1faea9-5b6f-4382-8750-2ccc5fc1236f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:43.730913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:43.733390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1041/2064] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:43.742331 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1faea9-5b6f-4382-8750-2ccc5fc1236f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:43.757094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d7ab786a-b1e2-400a-ae22-88048bd9e817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31d5e9d774a4f12b0679b06fec712c8', 'request_id': 'req-d7ab786a-b1e2-400a-ae22-88048bd9e817'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:43.759088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1faea9-5b6f-4382-8750-2ccc5fc1236f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:43.781386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d7ab786a-b1e2-400a-ae22-88048bd9e817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31d5e9d774a4f12b0679b06fec712c8', 'request_id': 'req-d7ab786a-b1e2-400a-ae22-88048bd9e817'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:43.789884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d7ab786a-b1e2-400a-ae22-88048bd9e817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31d5e9d774a4f12b0679b06fec712c8', 'request_id': 'req-d7ab786a-b1e2-400a-ae22-88048bd9e817'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:43.826603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d7ab786a-b1e2-400a-ae22-88048bd9e817 admin admin] The token cache is being invalidate because project c31d5e9d774a4f12b0679b06fec712c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:43.826902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d7ab786a-b1e2-400a-ae22-88048bd9e817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:43.827901 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d7ab786a-b1e2-400a-ae22-88048bd9e817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:43.830962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1024/2065] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:43 2022] DELETE /identity/v3/projects/c31d5e9d774a4f12b0679b06fec712c8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:43.838191 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abf68f-1745-4496-a86d-6dc7e574e014 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:43.838598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abf68f-1745-4496-a86d-6dc7e574e014 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:43.838879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abf68f-1745-4496-a86d-6dc7e574e014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:43.861614 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80609639-daf1-4d0f-b9aa-98889ea3ff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:43.862294 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80609639-daf1-4d0f-b9aa-98889ea3ff3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:43.862615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80609639-daf1-4d0f-b9aa-98889ea3ff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:43.862895 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80609639-daf1-4d0f-b9aa-98889ea3ff3c admin admin] PATH_INFO: `/v3/projects/5631c5ad7da24302a9eee5fd71682c84/users/593c3e0a49be4cc5bbccd71d6cf55af8/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:43.864244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c3abf68f-1745-4496-a86d-6dc7e574e014 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:43.866046 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c3abf68f-1745-4496-a86d-6dc7e574e014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:43.890212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1025/2066] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:43.892674 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80609639-daf1-4d0f-b9aa-98889ea3ff3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5631c5ad7da24302a9eee5fd71682c84, user_id=593c3e0a49be4cc5bbccd71d6cf55af8, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:43.896907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80609639-daf1-4d0f-b9aa-98889ea3ff3c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:43.900743 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf4a4a-9fde-44ae-a4a2-b4eae729da09 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:43.901151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf4a4a-9fde-44ae-a4a2-b4eae729da09 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:43.901713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf4a4a-9fde-44ae-a4a2-b4eae729da09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:43.919622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1042/2067] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:43 2022] PUT /identity/v3/projects/5631c5ad7da24302a9eee5fd71682c84/users/593c3e0a49be4cc5bbccd71d6cf55af8/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:43.933865 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66983df-b2af-48dd-9368-314cecde448a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:43.934442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66983df-b2af-48dd-9368-314cecde448a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:43.934874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66983df-b2af-48dd-9368-314cecde448a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:43.937267 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-04bf4a4a-9fde-44ae-a4a2-b4eae729da09 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:43.938550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-04bf4a4a-9fde-44ae-a4a2-b4eae729da09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:44.000471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f66983df-b2af-48dd-9368-314cecde448a None None] MFA Rules not processed for user `593c3e0a49be4cc5bbccd71d6cf55af8`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:44.001867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f66983df-b2af-48dd-9368-314cecde448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:44.024342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1026/2068] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:44.028750 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf4a4a-9fde-44ae-a4a2-b4eae729da09 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.034656 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:44.048858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf4a4a-9fde-44ae-a4a2-b4eae729da09 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.062394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9785ca-e44a-4417-83da-dc2b24f0ba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.063485 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9785ca-e44a-4417-83da-dc2b24f0ba2b admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.065845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9785ca-e44a-4417-83da-dc2b24f0ba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.066766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9785ca-e44a-4417-83da-dc2b24f0ba2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.067526 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9785ca-e44a-4417-83da-dc2b24f0ba2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:44.067844 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9785ca-e44a-4417-83da-dc2b24f0ba2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.069482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9785ca-e44a-4417-83da-dc2b24f0ba2b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:44.092525 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1027/2069] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:26:44.093834 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9785ca-e44a-4417-83da-dc2b24f0ba2b admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.107330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9785ca-e44a-4417-83da-dc2b24f0ba2b admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.112320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77941cfd-4179-4585-b166-13a156afb974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.113758 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77941cfd-4179-4585-b166-13a156afb974 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.114045 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77941cfd-4179-4585-b166-13a156afb974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.114325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77941cfd-4179-4585-b166-13a156afb974 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.115043 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77941cfd-4179-4585-b166-13a156afb974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.116958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77941cfd-4179-4585-b166-13a156afb974 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:44.121629 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1043/2070] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:44.122993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66983df-b2af-48dd-9368-314cecde448a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.124685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f66983df-b2af-48dd-9368-314cecde448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:44.143527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66983df-b2af-48dd-9368-314cecde448a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.148528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ca971-b91b-451e-9a4d-976c16d4f887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.149464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca971-b91b-451e-9a4d-976c16d4f887 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.149464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca971-b91b-451e-9a4d-976c16d4f887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.149746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ca971-b91b-451e-9a4d-976c16d4f887 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.150506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ca971-b91b-451e-9a4d-976c16d4f887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.152770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ca971-b91b-451e-9a4d-976c16d4f887 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:44.157258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1028/2071] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:44 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:44.161254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77941cfd-4179-4585-b166-13a156afb974 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.203475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1044/2072] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:44 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:44.208410 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ca971-b91b-451e-9a4d-976c16d4f887 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.258088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77941cfd-4179-4585-b166-13a156afb974 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.275536 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ca971-b91b-451e-9a4d-976c16d4f887 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.282530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74eb482-6237-4beb-8c78-5601bf8aa4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.283171 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74eb482-6237-4beb-8c78-5601bf8aa4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.283456 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74eb482-6237-4beb-8c78-5601bf8aa4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.283733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74eb482-6237-4beb-8c78-5601bf8aa4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.284406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74eb482-6237-4beb-8c78-5601bf8aa4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.286394 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74eb482-6237-4beb-8c78-5601bf8aa4c8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:44.296943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:44.311090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1045/2073] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:44 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:26:44.315332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74eb482-6237-4beb-8c78-5601bf8aa4c8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.328785 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74eb482-6237-4beb-8c78-5601bf8aa4c8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.331576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d3f82-cfd2-4166-bc4c-efa57813d94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.332437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d3f82-cfd2-4166-bc4c-efa57813d94b admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.332918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d3f82-cfd2-4166-bc4c-efa57813d94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.333633 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d3f82-cfd2-4166-bc4c-efa57813d94b admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.333913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59903962-00d9-43ef-bc5d-ecb619524887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.334570 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59903962-00d9-43ef-bc5d-ecb619524887 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.334716 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d3f82-cfd2-4166-bc4c-efa57813d94b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.334898 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59903962-00d9-43ef-bc5d-ecb619524887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.335262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59903962-00d9-43ef-bc5d-ecb619524887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.335965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59903962-00d9-43ef-bc5d-ecb619524887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.336668 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d3f82-cfd2-4166-bc4c-efa57813d94b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:44.337567 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59903962-00d9-43ef-bc5d-ecb619524887 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:44.348297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1046/2074] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:44.353950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59903962-00d9-43ef-bc5d-ecb619524887 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.366839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1029/2075] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:44 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:44.370312 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59903962-00d9-43ef-bc5d-ecb619524887 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.376514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadc588-4a1a-4ac9-8cad-e359a44e747c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.377226 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc588-4a1a-4ac9-8cad-e359a44e747c admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.377513 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc588-4a1a-4ac9-8cad-e359a44e747c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.377790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc588-4a1a-4ac9-8cad-e359a44e747c admin admin] PATH_INFO: `/v3/projects/162aade9e1534c49946f6c4a0fde2348/users/0a70ee15474646da813f17937db7437f/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.377906 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d3f82-cfd2-4166-bc4c-efa57813d94b admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.391980 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d3f82-cfd2-4166-bc4c-efa57813d94b admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.395925 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadc588-4a1a-4ac9-8cad-e359a44e747c admin admin] RBAC: Authorizing `identity:create_grant(project_id=162aade9e1534c49946f6c4a0fde2348, user_id=0a70ee15474646da813f17937db7437f, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.398383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f42f7f-3473-48aa-b8bf-bcc0ed21f557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.398645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadc588-4a1a-4ac9-8cad-e359a44e747c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:44.399461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42f7f-3473-48aa-b8bf-bcc0ed21f557 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.399929 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42f7f-3473-48aa-b8bf-bcc0ed21f557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.400960 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42f7f-3473-48aa-b8bf-bcc0ed21f557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.401871 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f42f7f-3473-48aa-b8bf-bcc0ed21f557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.403824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f42f7f-3473-48aa-b8bf-bcc0ed21f557 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:44.414622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1047/2076] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:44 2022] PUT /identity/v3/projects/162aade9e1534c49946f6c4a0fde2348/users/0a70ee15474646da813f17937db7437f/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:44.418796 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadc588-4a1a-4ac9-8cad-e359a44e747c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.423032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1030/2077] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:44.424782 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f42f7f-3473-48aa-b8bf-bcc0ed21f557 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.439840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f42f7f-3473-48aa-b8bf-bcc0ed21f557 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.493225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:44.503632 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadc588-4a1a-4ac9-8cad-e359a44e747c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.509336 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae8231-7672-4a73-b159-74ba51641be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.511999 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae8231-7672-4a73-b159-74ba51641be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.512696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae8231-7672-4a73-b159-74ba51641be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.513148 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae8231-7672-4a73-b159-74ba51641be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.513954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae8231-7672-4a73-b159-74ba51641be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.516431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae8231-7672-4a73-b159-74ba51641be3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:44.519227 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9004780-3a11-4b00-894e-04a690a5feae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.520321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9004780-3a11-4b00-894e-04a690a5feae admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.520606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9004780-3a11-4b00-894e-04a690a5feae admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.520888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9004780-3a11-4b00-894e-04a690a5feae admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.521598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9004780-3a11-4b00-894e-04a690a5feae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.523581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9004780-3a11-4b00-894e-04a690a5feae admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:44.535434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1048/2078] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:44.535621 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1031/2079] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:44.539300 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9004780-3a11-4b00-894e-04a690a5feae admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.547065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae8231-7672-4a73-b159-74ba51641be3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.557476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9004780-3a11-4b00-894e-04a690a5feae admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.562242 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae8231-7672-4a73-b159-74ba51641be3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.566623 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61eee6-0a34-4533-b4ba-2b1c03762e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.567309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61eee6-0a34-4533-b4ba-2b1c03762e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.567594 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61eee6-0a34-4533-b4ba-2b1c03762e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.567872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61eee6-0a34-4533-b4ba-2b1c03762e05 admin admin] PATH_INFO: `/v3/projects/162aade9e1534c49946f6c4a0fde2348/users/0a70ee15474646da813f17937db7437f/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.569291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8061d0-342a-4f74-b511-15aeaa92f9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.569949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61eee6-0a34-4533-b4ba-2b1c03762e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162aade9e1534c49946f6c4a0fde2348, user_id=0a70ee15474646da813f17937db7437f, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.570454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8061d0-342a-4f74-b511-15aeaa92f9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.570976 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8061d0-342a-4f74-b511-15aeaa92f9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.571513 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8061d0-342a-4f74-b511-15aeaa92f9e4 admin admin] PATH_INFO: `/v3/projects/0c503056e71d4d12b2c83aa179dc241e/users/33a27015066a416ea755262f9d3abd18/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.573409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61eee6-0a34-4533-b4ba-2b1c03762e05 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:44.585623 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1032/2080] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:44 2022] PUT /identity/v3/projects/162aade9e1534c49946f6c4a0fde2348/users/0a70ee15474646da813f17937db7437f/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:44.596853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30837126-ff5b-4938-a25d-2d12e73fa689 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.597252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30837126-ff5b-4938-a25d-2d12e73fa689 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.597424 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30837126-ff5b-4938-a25d-2d12e73fa689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.606880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8061d0-342a-4f74-b511-15aeaa92f9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c503056e71d4d12b2c83aa179dc241e, user_id=33a27015066a416ea755262f9d3abd18, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.610168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8061d0-342a-4f74-b511-15aeaa92f9e4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:44.638483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1049/2081] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:44 2022] PUT /identity/v3/projects/0c503056e71d4d12b2c83aa179dc241e/users/33a27015066a416ea755262f9d3abd18/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:44.640409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-30837126-ff5b-4938-a25d-2d12e73fa689 None None] MFA Rules not processed for user `0a70ee15474646da813f17937db7437f`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:44.641897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-30837126-ff5b-4938-a25d-2d12e73fa689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:44.642035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c510-3c25-43e7-9b21-2b9a73accc18 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.642241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c510-3c25-43e7-9b21-2b9a73accc18 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.642555 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c510-3c25-43e7-9b21-2b9a73accc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.683080 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f1e1c510-3c25-43e7-9b21-2b9a73accc18 None None] MFA Rules not processed for user `33a27015066a416ea755262f9d3abd18`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:44.684788 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f1e1c510-3c25-43e7-9b21-2b9a73accc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:44.738778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1033/2082] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:44.748211 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30837126-ff5b-4938-a25d-2d12e73fa689 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.749765 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-30837126-ff5b-4938-a25d-2d12e73fa689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:44.787496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:44.807247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1050/2083] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:44.818969 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1c510-3c25-43e7-9b21-2b9a73accc18 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.821354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f1e1c510-3c25-43e7-9b21-2b9a73accc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:44.835751 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30837126-ff5b-4938-a25d-2d12e73fa689 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.837565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1c510-3c25-43e7-9b21-2b9a73accc18 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.840106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63817d8d-ad1d-4a87-8896-821d5b9c746b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.840911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63817d8d-ad1d-4a87-8896-821d5b9c746b service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.841349 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63817d8d-ad1d-4a87-8896-821d5b9c746b service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.841468 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e716ff9-0c81-4983-9225-793385d7ab61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.841902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63817d8d-ad1d-4a87-8896-821d5b9c746b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.842022 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e716ff9-0c81-4983-9225-793385d7ab61 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.842308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e716ff9-0c81-4983-9225-793385d7ab61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.842612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e716ff9-0c81-4983-9225-793385d7ab61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.844511 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-63817d8d-ad1d-4a87-8896-821d5b9c746b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:44.855085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e716ff9-0c81-4983-9225-793385d7ab61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.856748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e716ff9-0c81-4983-9225-793385d7ab61 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:44.867688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1051/2084] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:26:44.889836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e716ff9-0c81-4983-9225-793385d7ab61 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:44.931115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63817d8d-ad1d-4a87-8896-821d5b9c746b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.933512 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63817d8d-ad1d-4a87-8896-821d5b9c746b service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:44.945246 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1034/2085] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:26:44.980513 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e716ff9-0c81-4983-9225-793385d7ab61 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:44.988510 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70684c24-5384-4e52-a5bb-95f5259c04ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:44.989227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70684c24-5384-4e52-a5bb-95f5259c04ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:44.989440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70684c24-5384-4e52-a5bb-95f5259c04ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:44.989705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70684c24-5384-4e52-a5bb-95f5259c04ee admin admin] PATH_INFO: `/v3/users/33a27015066a416ea755262f9d3abd18` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:44.991148 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70684c24-5384-4e52-a5bb-95f5259c04ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a27015066a416ea755262f9d3abd18)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:44.993226 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70684c24-5384-4e52-a5bb-95f5259c04ee admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:45.055231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:45.058105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70684c24-5384-4e52-a5bb-95f5259c04ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a27015066a416ea755262f9d3abd18'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:45.069452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70684c24-5384-4e52-a5bb-95f5259c04ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a27015066a416ea755262f9d3abd18'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:45.089650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70684c24-5384-4e52-a5bb-95f5259c04ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a27015066a416ea755262f9d3abd18'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:45.090919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70684c24-5384-4e52-a5bb-95f5259c04ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a27015066a416ea755262f9d3abd18'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:45.100773 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-70684c24-5384-4e52-a5bb-95f5259c04ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a27015066a416ea755262f9d3abd18'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:45.112647 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1052/2086] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:44 2022] DELETE /identity/v3/users/33a27015066a416ea755262f9d3abd18 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:45.117517 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15515-cd5c-4397-8d11-7a02f3573251 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:45.117912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15515-cd5c-4397-8d11-7a02f3573251 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:45.118114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15515-cd5c-4397-8d11-7a02f3573251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:45.141955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-30a15515-cd5c-4397-8d11-7a02f3573251 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:45.143963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-30a15515-cd5c-4397-8d11-7a02f3573251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:45.239692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1035/2087] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:45.247759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70684c24-5384-4e52-a5bb-95f5259c04ee admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:45.249794 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-70684c24-5384-4e52-a5bb-95f5259c04ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:45.420676 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70684c24-5384-4e52-a5bb-95f5259c04ee admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:45.445750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97adc0-557f-47f6-8603-29c94e60b002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:45.446442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97adc0-557f-47f6-8603-29c94e60b002 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:45.446726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97adc0-557f-47f6-8603-29c94e60b002 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:45.453726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97adc0-557f-47f6-8603-29c94e60b002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:45.464987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97adc0-557f-47f6-8603-29c94e60b002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:45.466575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97adc0-557f-47f6-8603-29c94e60b002 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:45.477955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1053/2088] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:26:45.795049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a15515-cd5c-4397-8d11-7a02f3573251 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:45.796584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-30a15515-cd5c-4397-8d11-7a02f3573251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:45.829521 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a15515-cd5c-4397-8d11-7a02f3573251 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:45.841835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:45.842674 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:45.843025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:45.843368 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d admin admin] PATH_INFO: `/v3/projects/0c503056e71d4d12b2c83aa179dc241e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:45.844649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c503056e71d4d12b2c83aa179dc241e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:45.846891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:45.923621 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c503056e71d4d12b2c83aa179dc241e', 'request_id': 'req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:45.935868 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c503056e71d4d12b2c83aa179dc241e', 'request_id': 'req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:45.943556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c503056e71d4d12b2c83aa179dc241e', 'request_id': 'req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:45.955090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:45.960849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d admin admin] The token cache is being invalidate because project 0c503056e71d4d12b2c83aa179dc241e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:45.961148 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:45.962125 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ce583a8d-1cc2-4f2d-9c5c-0ccd5a95024d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:45.970632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1036/2089] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:45 2022] DELETE /identity/v3/projects/0c503056e71d4d12b2c83aa179dc241e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:45.972494 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97a287-3005-430b-87b2-6b2b809bc285 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:45.972799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97a287-3005-430b-87b2-6b2b809bc285 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:45.973138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97a287-3005-430b-87b2-6b2b809bc285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:45.996109 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8e97a287-3005-430b-87b2-6b2b809bc285 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:45.997404 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8e97a287-3005-430b-87b2-6b2b809bc285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:46.082477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1054/2090] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:46.091108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb5e54-112d-49f7-bb77-9dcd77196951 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:46.091440 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb5e54-112d-49f7-bb77-9dcd77196951 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:46.091717 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb5e54-112d-49f7-bb77-9dcd77196951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:46.118400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-09eb5e54-112d-49f7-bb77-9dcd77196951 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:46.120195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-09eb5e54-112d-49f7-bb77-9dcd77196951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:46.128862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1037/2091] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:46.133230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97a287-3005-430b-87b2-6b2b809bc285 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:46.144512 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97a287-3005-430b-87b2-6b2b809bc285 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:46.149232 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f80430-c531-4947-89bc-080e3f60c87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:46.149849 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f80430-c531-4947-89bc-080e3f60c87e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:46.150208 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f80430-c531-4947-89bc-080e3f60c87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:46.150514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f80430-c531-4947-89bc-080e3f60c87e admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:46.151328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f80430-c531-4947-89bc-080e3f60c87e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:46.151637 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f80430-c531-4947-89bc-080e3f60c87e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:46.153391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f80430-c531-4947-89bc-080e3f60c87e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:46.165606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1055/2092] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:26:46.170190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb5e54-112d-49f7-bb77-9dcd77196951 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:46.180695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb5e54-112d-49f7-bb77-9dcd77196951 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:46.186167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5e5f1-baac-4a4d-9015-c28521070e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:46.186874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e5f1-baac-4a4d-9015-c28521070e9e admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:46.187161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e5f1-baac-4a4d-9015-c28521070e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:46.187457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5e5f1-baac-4a4d-9015-c28521070e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:46.188299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5e5f1-baac-4a4d-9015-c28521070e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:46.190202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5e5f1-baac-4a4d-9015-c28521070e9e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:46.220556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1038/2093] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:46 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:46.224990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f80430-c531-4947-89bc-080e3f60c87e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:46.235987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f80430-c531-4947-89bc-080e3f60c87e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:46.286980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:46.297909 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278620c7-6eab-4873-9fa2-9e64e0c6f63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:46.298571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278620c7-6eab-4873-9fa2-9e64e0c6f63f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:46.298857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278620c7-6eab-4873-9fa2-9e64e0c6f63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:46.299139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278620c7-6eab-4873-9fa2-9e64e0c6f63f admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:46.299830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278620c7-6eab-4873-9fa2-9e64e0c6f63f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:46.301875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278620c7-6eab-4873-9fa2-9e64e0c6f63f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:46.325966 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1056/2094] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:46 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:46.330336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5e5f1-baac-4a4d-9015-c28521070e9e admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:46.341413 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5e5f1-baac-4a4d-9015-c28521070e9e admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:46.346124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40197c02-ec19-4111-aac0-a291792438ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:46.346768 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40197c02-ec19-4111-aac0-a291792438ea admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:46.347050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40197c02-ec19-4111-aac0-a291792438ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:46.347322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40197c02-ec19-4111-aac0-a291792438ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:46.348017 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40197c02-ec19-4111-aac0-a291792438ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:46.349643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40197c02-ec19-4111-aac0-a291792438ea admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:46.360790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1039/2095] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:46.364805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278620c7-6eab-4873-9fa2-9e64e0c6f63f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:46.375810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278620c7-6eab-4873-9fa2-9e64e0c6f63f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:46.383426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8816c44-8dae-4d66-a635-57eb0acf9699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:46.384058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8816c44-8dae-4d66-a635-57eb0acf9699 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:46.384485 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8816c44-8dae-4d66-a635-57eb0acf9699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:46.384579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8816c44-8dae-4d66-a635-57eb0acf9699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:46.385284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8816c44-8dae-4d66-a635-57eb0acf9699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:46.387059 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8816c44-8dae-4d66-a635-57eb0acf9699 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:46.402971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1057/2096] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:46.408036 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40197c02-ec19-4111-aac0-a291792438ea admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:46.428599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40197c02-ec19-4111-aac0-a291792438ea admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:46.440798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233256d-dc5c-464a-bd07-1a7b7a5ccda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:46.441563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233256d-dc5c-464a-bd07-1a7b7a5ccda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:46.441849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233256d-dc5c-464a-bd07-1a7b7a5ccda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:46.442125 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233256d-dc5c-464a-bd07-1a7b7a5ccda3 admin admin] PATH_INFO: `/v3/projects/5c0a6de4055c4dc5b6b9b43c4d11c3e6/users/18a5697842d14376bb5b8c969da6cd28/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:46.493254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233256d-dc5c-464a-bd07-1a7b7a5ccda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0a6de4055c4dc5b6b9b43c4d11c3e6, user_id=18a5697842d14376bb5b8c969da6cd28, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:46.496532 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233256d-dc5c-464a-bd07-1a7b7a5ccda3 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:46.521449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1040/2097] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:46 2022] PUT /identity/v3/projects/5c0a6de4055c4dc5b6b9b43c4d11c3e6/users/18a5697842d14376bb5b8c969da6cd28/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:46.532802 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b749-d376-44f8-a834-491bb7a09437 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:46.533372 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b749-d376-44f8-a834-491bb7a09437 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:46.533372 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b749-d376-44f8-a834-491bb7a09437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:46.585699 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6b33b749-d376-44f8-a834-491bb7a09437 None None] MFA Rules not processed for user `18a5697842d14376bb5b8c969da6cd28`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:46.586983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6b33b749-d376-44f8-a834-491bb7a09437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:46.663798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1058/2098] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:46.675565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233256d-dc5c-464a-bd07-1a7b7a5ccda3 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:46.677515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7233256d-dc5c-464a-bd07-1a7b7a5ccda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:46.758471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233256d-dc5c-464a-bd07-1a7b7a5ccda3 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:46.758471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5aa77-b3d9-4c4a-8493-d3a5580e781a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:46.758471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5aa77-b3d9-4c4a-8493-d3a5580e781a service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:46.758471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5aa77-b3d9-4c4a-8493-d3a5580e781a service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:46.758933 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5aa77-b3d9-4c4a-8493-d3a5580e781a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:46.764450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5aa77-b3d9-4c4a-8493-d3a5580e781a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:46.765892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5aa77-b3d9-4c4a-8493-d3a5580e781a service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:46.775644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1041/2099] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:46.797113 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33b749-d376-44f8-a834-491bb7a09437 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:46.862715 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33b749-d376-44f8-a834-491bb7a09437 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:46.867389 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15d798-d71b-4965-af98-7c6894ffad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:46.868031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d798-d71b-4965-af98-7c6894ffad62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:46.868313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d798-d71b-4965-af98-7c6894ffad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:46.868595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d798-d71b-4965-af98-7c6894ffad62 admin admin] PATH_INFO: `/v3/users/18a5697842d14376bb5b8c969da6cd28` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:46.870308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15d798-d71b-4965-af98-7c6894ffad62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a5697842d14376bb5b8c969da6cd28)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:46.872267 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15d798-d71b-4965-af98-7c6894ffad62 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:46.917760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1e15d798-d71b-4965-af98-7c6894ffad62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a5697842d14376bb5b8c969da6cd28'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:46.925489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1e15d798-d71b-4965-af98-7c6894ffad62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a5697842d14376bb5b8c969da6cd28'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:46.933204 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:46.939742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1e15d798-d71b-4965-af98-7c6894ffad62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a5697842d14376bb5b8c969da6cd28'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:46.940977 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1e15d798-d71b-4965-af98-7c6894ffad62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a5697842d14376bb5b8c969da6cd28'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:46.948957 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1e15d798-d71b-4965-af98-7c6894ffad62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a5697842d14376bb5b8c969da6cd28'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:46.954764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1059/2100] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:46 2022] DELETE /identity/v3/users/18a5697842d14376bb5b8c969da6cd28 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:46.959486 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff997c2-7d6f-4793-9fbb-fba817b3eef4 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:46.959936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff997c2-7d6f-4793-9fbb-fba817b3eef4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:46.960047 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff997c2-7d6f-4793-9fbb-fba817b3eef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:46.980853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-dff997c2-7d6f-4793-9fbb-fba817b3eef4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:46.982075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-dff997c2-7d6f-4793-9fbb-fba817b3eef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:47.043657 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1042/2101] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:47.055007 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15d798-d71b-4965-af98-7c6894ffad62 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:47.056939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1e15d798-d71b-4965-af98-7c6894ffad62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:47.120439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15d798-d71b-4965-af98-7c6894ffad62 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:47.127273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6102a6-3316-4b34-94d0-9e3461e0fdf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:47.127803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6102a6-3316-4b34-94d0-9e3461e0fdf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:47.128294 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6102a6-3316-4b34-94d0-9e3461e0fdf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:47.128491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6102a6-3316-4b34-94d0-9e3461e0fdf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:47.138980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6102a6-3316-4b34-94d0-9e3461e0fdf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:47.140425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6102a6-3316-4b34-94d0-9e3461e0fdf4 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:47.150604 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1060/2102] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:47.426993 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff997c2-7d6f-4793-9fbb-fba817b3eef4 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:47.428538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-dff997c2-7d6f-4793-9fbb-fba817b3eef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:47.442444 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff997c2-7d6f-4793-9fbb-fba817b3eef4 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:47.459335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c853f-1b71-43ef-845f-359a1f8235d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:47.460040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c853f-1b71-43ef-845f-359a1f8235d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:47.460329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c853f-1b71-43ef-845f-359a1f8235d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:47.460634 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c853f-1b71-43ef-845f-359a1f8235d3 admin admin] PATH_INFO: `/v3/projects/5c0a6de4055c4dc5b6b9b43c4d11c3e6` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:47.466808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c853f-1b71-43ef-845f-359a1f8235d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c0a6de4055c4dc5b6b9b43c4d11c3e6)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:47.469003 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c853f-1b71-43ef-845f-359a1f8235d3 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:47.513825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:47.534088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ab2c853f-1b71-43ef-845f-359a1f8235d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c0a6de4055c4dc5b6b9b43c4d11c3e6', 'request_id': 'req-ab2c853f-1b71-43ef-845f-359a1f8235d3'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:47.543716 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ab2c853f-1b71-43ef-845f-359a1f8235d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c0a6de4055c4dc5b6b9b43c4d11c3e6', 'request_id': 'req-ab2c853f-1b71-43ef-845f-359a1f8235d3'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:47.551407 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ab2c853f-1b71-43ef-845f-359a1f8235d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c0a6de4055c4dc5b6b9b43c4d11c3e6', 'request_id': 'req-ab2c853f-1b71-43ef-845f-359a1f8235d3'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:47.564408 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ab2c853f-1b71-43ef-845f-359a1f8235d3 admin admin] The token cache is being invalidate because project 5c0a6de4055c4dc5b6b9b43c4d11c3e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:47.564801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ab2c853f-1b71-43ef-845f-359a1f8235d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:47.565708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ab2c853f-1b71-43ef-845f-359a1f8235d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:47.567608 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1043/2103] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:47 2022] DELETE /identity/v3/projects/5c0a6de4055c4dc5b6b9b43c4d11c3e6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:47.573049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af5804-18ae-4e58-a944-00f5cc09909b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:47.573542 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af5804-18ae-4e58-a944-00f5cc09909b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:47.573656 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af5804-18ae-4e58-a944-00f5cc09909b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:47.596554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-23af5804-18ae-4e58-a944-00f5cc09909b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:47.598058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-23af5804-18ae-4e58-a944-00f5cc09909b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:47.694431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1061/2104] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:47.703232 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffebc9-7992-4bad-998a-603722b30216 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:47.703598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffebc9-7992-4bad-998a-603722b30216 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:47.703944 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffebc9-7992-4bad-998a-603722b30216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:47.738343 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-ecffebc9-7992-4bad-998a-603722b30216 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:47.738343 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ecffebc9-7992-4bad-998a-603722b30216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:47.754921 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1044/2105] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:47.756425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af5804-18ae-4e58-a944-00f5cc09909b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:47.769468 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af5804-18ae-4e58-a944-00f5cc09909b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:47.780709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add2290-6d20-4989-ac16-e156712c61a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:47.781355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add2290-6d20-4989-ac16-e156712c61a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:47.781640 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add2290-6d20-4989-ac16-e156712c61a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:47.782054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add2290-6d20-4989-ac16-e156712c61a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:47.782798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add2290-6d20-4989-ac16-e156712c61a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:47.783125 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add2290-6d20-4989-ac16-e156712c61a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:47.785285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add2290-6d20-4989-ac16-e156712c61a0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:47.808529 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1062/2106] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:26:47.811282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffebc9-7992-4bad-998a-603722b30216 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:47.840115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffebc9-7992-4bad-998a-603722b30216 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:47.852195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030d86c-2730-4073-8d5f-ea9098188556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:47.853762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030d86c-2730-4073-8d5f-ea9098188556 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:47.854128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030d86c-2730-4073-8d5f-ea9098188556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:47.854428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030d86c-2730-4073-8d5f-ea9098188556 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:47.855498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030d86c-2730-4073-8d5f-ea9098188556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:47.864298 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030d86c-2730-4073-8d5f-ea9098188556 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:47.892991 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add2290-6d20-4989-ac16-e156712c61a0 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:47.895025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9add2290-6d20-4989-ac16-e156712c61a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:47.945560 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1045/2107] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:47 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:47.950398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030d86c-2730-4073-8d5f-ea9098188556 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:48.060487 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add2290-6d20-4989-ac16-e156712c61a0 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:48.068163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030d86c-2730-4073-8d5f-ea9098188556 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:48.080832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3cb6b-bcfc-48cb-8a74-861571a96f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:48.081663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3cb6b-bcfc-48cb-8a74-861571a96f13 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:48.082100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3cb6b-bcfc-48cb-8a74-861571a96f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:48.082505 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3cb6b-bcfc-48cb-8a74-861571a96f13 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:48.083561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3cb6b-bcfc-48cb-8a74-861571a96f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:48.088712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3cb6b-bcfc-48cb-8a74-861571a96f13 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:48.092113 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:48.118446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1046/2108] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:47 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:26:48.121172 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3cb6b-bcfc-48cb-8a74-861571a96f13 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:48.124208 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c2067-3836-4abe-914a-cfb31eacd554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:48.124830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c2067-3836-4abe-914a-cfb31eacd554 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:48.125139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c2067-3836-4abe-914a-cfb31eacd554 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:48.125414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c2067-3836-4abe-914a-cfb31eacd554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:48.127347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7d1c2067-3836-4abe-914a-cfb31eacd554 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:48.131062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3cb6b-bcfc-48cb-8a74-861571a96f13 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:48.135643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add39aa-9e46-4b67-89cb-ac449f240ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:48.136375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add39aa-9e46-4b67-89cb-ac449f240ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:48.136670 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add39aa-9e46-4b67-89cb-ac449f240ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:48.136948 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add39aa-9e46-4b67-89cb-ac449f240ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:48.137643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add39aa-9e46-4b67-89cb-ac449f240ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:48.139302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add39aa-9e46-4b67-89cb-ac449f240ed5 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:48.153965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1047/2109] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:48.155476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add39aa-9e46-4b67-89cb-ac449f240ed5 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:48.165420 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add39aa-9e46-4b67-89cb-ac449f240ed5 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:48.171170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae7c6d-740b-423e-bc99-6e85bbe2814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:48.171904 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae7c6d-740b-423e-bc99-6e85bbe2814b admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:48.172169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae7c6d-740b-423e-bc99-6e85bbe2814b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:48.172450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae7c6d-740b-423e-bc99-6e85bbe2814b admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:48.173161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae7c6d-740b-423e-bc99-6e85bbe2814b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:48.174829 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae7c6d-740b-423e-bc99-6e85bbe2814b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:48.186547 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1048/2110] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:48.190810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae7c6d-740b-423e-bc99-6e85bbe2814b admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:48.200088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c2067-3836-4abe-914a-cfb31eacd554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:48.200751 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae7c6d-740b-423e-bc99-6e85bbe2814b admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:48.202028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c2067-3836-4abe-914a-cfb31eacd554 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:48.205814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc14f1-e74c-4fda-b7ad-7b9038b0e4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:48.206243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc14f1-e74c-4fda-b7ad-7b9038b0e4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:48.206566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc14f1-e74c-4fda-b7ad-7b9038b0e4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:48.206847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc14f1-e74c-4fda-b7ad-7b9038b0e4ff admin admin] PATH_INFO: `/v3/projects/d1cdc361bba2472398e88f99550a2798/users/481c82a05f86471da6961a95d8198a9f/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:48.213886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1063/2111] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:48.225417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc14f1-e74c-4fda-b7ad-7b9038b0e4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cdc361bba2472398e88f99550a2798, user_id=481c82a05f86471da6961a95d8198a9f, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:48.229120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc14f1-e74c-4fda-b7ad-7b9038b0e4ff admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:48.251602 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1049/2112] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:48 2022] PUT /identity/v3/projects/d1cdc361bba2472398e88f99550a2798/users/481c82a05f86471da6961a95d8198a9f/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:48.264445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8b0df-1377-4dc4-afe1-52db94d5fb07 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:48.264745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8b0df-1377-4dc4-afe1-52db94d5fb07 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:48.265029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8b0df-1377-4dc4-afe1-52db94d5fb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:48.302388 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-09e8b0df-1377-4dc4-afe1-52db94d5fb07 None None] MFA Rules not processed for user `481c82a05f86471da6961a95d8198a9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:48.303837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-09e8b0df-1377-4dc4-afe1-52db94d5fb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:48.414981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1064/2113] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:48.427388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc14f1-e74c-4fda-b7ad-7b9038b0e4ff admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:48.429203 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0efc14f1-e74c-4fda-b7ad-7b9038b0e4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:48.495553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:48.577903 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc14f1-e74c-4fda-b7ad-7b9038b0e4ff admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:48.582399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb325b5-fc43-4b55-9394-9f8ffdc95c4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce7db16c4904fb1b75ac7910f4470f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:48.582806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb325b5-fc43-4b55-9394-9f8ffdc95c4a service glance] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:48.583069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb325b5-fc43-4b55-9394-9f8ffdc95c4a service glance] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:48.583612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb325b5-fc43-4b55-9394-9f8ffdc95c4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:48.593313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb325b5-fc43-4b55-9394-9f8ffdc95c4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:48.594909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb325b5-fc43-4b55-9394-9f8ffdc95c4a service glance] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:48.604142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1050/2114] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:49.142095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8b0df-1377-4dc4-afe1-52db94d5fb07 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:49.143931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-09e8b0df-1377-4dc4-afe1-52db94d5fb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:49.242341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8b0df-1377-4dc4-afe1-52db94d5fb07 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:49.246154 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6dd44-f087-431e-8fab-be0d8c39b8e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:49.246792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6dd44-f087-431e-8fab-be0d8c39b8e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:49.247065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6dd44-f087-431e-8fab-be0d8c39b8e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:49.247332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6dd44-f087-431e-8fab-be0d8c39b8e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:49.249091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f8f6dd44-f087-431e-8fab-be0d8c39b8e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:49.276645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:49.316874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6dd44-f087-431e-8fab-be0d8c39b8e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:49.318300 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6dd44-f087-431e-8fab-be0d8c39b8e2 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:49.328955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1065/2115] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:51.360182 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb325b5-fc43-4b55-9394-9f8ffdc95c4a service glance] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:51.361783 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2bb325b5-fc43-4b55-9394-9f8ffdc95c4a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:51.442762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb325b5-fc43-4b55-9394-9f8ffdc95c4a service glance] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:51.454979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29832229-c0fd-49cd-983b-55ce739476a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:51.455626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29832229-c0fd-49cd-983b-55ce739476a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:51.455972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29832229-c0fd-49cd-983b-55ce739476a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:51.456294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29832229-c0fd-49cd-983b-55ce739476a9 admin admin] PATH_INFO: `/v3/users/2efd6ab34cb841ddbd9092c5d1486704` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:51.457509 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29832229-c0fd-49cd-983b-55ce739476a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2efd6ab34cb841ddbd9092c5d1486704)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:51.459760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29832229-c0fd-49cd-983b-55ce739476a9 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:51.552874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-29832229-c0fd-49cd-983b-55ce739476a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2efd6ab34cb841ddbd9092c5d1486704'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:51.562453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-29832229-c0fd-49cd-983b-55ce739476a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2efd6ab34cb841ddbd9092c5d1486704'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:51.569752 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-29832229-c0fd-49cd-983b-55ce739476a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2efd6ab34cb841ddbd9092c5d1486704'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:51.570419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-29832229-c0fd-49cd-983b-55ce739476a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2efd6ab34cb841ddbd9092c5d1486704'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:51.583092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-29832229-c0fd-49cd-983b-55ce739476a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2efd6ab34cb841ddbd9092c5d1486704'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:51.590942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1051/2116] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:51 2022] DELETE /identity/v3/users/2efd6ab34cb841ddbd9092c5d1486704 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:51.595334 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8e8d9-719b-4a4b-a791-5998e7da6423 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:51.595862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8e8d9-719b-4a4b-a791-5998e7da6423 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:51.595956 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8e8d9-719b-4a4b-a791-5998e7da6423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:51.615489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-39e8e8d9-719b-4a4b-a791-5998e7da6423 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:51.616717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-39e8e8d9-719b-4a4b-a791-5998e7da6423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:51.689887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1066/2117] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:51.697779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29832229-c0fd-49cd-983b-55ce739476a9 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:51.699523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-29832229-c0fd-49cd-983b-55ce739476a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:51.756784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:51.799900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29832229-c0fd-49cd-983b-55ce739476a9 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:51.811188 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f52d2-d126-4c14-8eb0-598c6f150909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:51.812258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f52d2-d126-4c14-8eb0-598c6f150909 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:51.812642 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f52d2-d126-4c14-8eb0-598c6f150909 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:51.813127 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f52d2-d126-4c14-8eb0-598c6f150909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:51.832675 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f52d2-d126-4c14-8eb0-598c6f150909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:51.834852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f52d2-d126-4c14-8eb0-598c6f150909 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:51.854634 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1052/2118] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:52.182335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8e8d9-719b-4a4b-a791-5998e7da6423 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:52.183919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-39e8e8d9-719b-4a4b-a791-5998e7da6423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:52.196067 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8e8d9-719b-4a4b-a791-5998e7da6423 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:52.201366 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:52.202011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:52.202293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:52.202608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] PATH_INFO: `/v3/projects/15210715020440d6aef19fd680f21166` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:52.203783 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15210715020440d6aef19fd680f21166)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:52.205707 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:52.252222 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15210715020440d6aef19fd680f21166', 'request_id': 'req-f8f85fad-d0cb-4455-81bf-137601d88255'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:52.258184 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15210715020440d6aef19fd680f21166', 'request_id': 'req-f8f85fad-d0cb-4455-81bf-137601d88255'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:52.267696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15210715020440d6aef19fd680f21166', 'request_id': 'req-f8f85fad-d0cb-4455-81bf-137601d88255'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:52.279679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] The token cache is being invalidate because project 15210715020440d6aef19fd680f21166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:52.279965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:52.281128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:52.283403 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1067/2119] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:52 2022] DELETE /identity/v3/projects/15210715020440d6aef19fd680f21166 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:52.288619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f52d2-d126-4c14-8eb0-598c6f150909 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:52.298983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f52d2-d126-4c14-8eb0-598c6f150909 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:52.363821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d5725-a318-4b27-8d99-a597a0ec014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:52.364459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d5725-a318-4b27-8d99-a597a0ec014f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:52.364736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d5725-a318-4b27-8d99-a597a0ec014f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:52.365010 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d5725-a318-4b27-8d99-a597a0ec014f admin admin] PATH_INFO: `/v3/users/0337231cc15a45efab563cba933d949c` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:52.366331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d5725-a318-4b27-8d99-a597a0ec014f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0337231cc15a45efab563cba933d949c)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:52.368397 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d5725-a318-4b27-8d99-a597a0ec014f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:52.415014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-437d5725-a318-4b27-8d99-a597a0ec014f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0337231cc15a45efab563cba933d949c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:52.423537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-437d5725-a318-4b27-8d99-a597a0ec014f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0337231cc15a45efab563cba933d949c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:52.430593 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-437d5725-a318-4b27-8d99-a597a0ec014f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0337231cc15a45efab563cba933d949c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:52.431251 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-437d5725-a318-4b27-8d99-a597a0ec014f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0337231cc15a45efab563cba933d949c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:52.443569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-437d5725-a318-4b27-8d99-a597a0ec014f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0337231cc15a45efab563cba933d949c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:52.449601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1053/2120] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:52 2022] DELETE /identity/v3/users/0337231cc15a45efab563cba933d949c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:52.898947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:52.902904 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:52.921885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f85fad-d0cb-4455-81bf-137601d88255 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:53.012332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:53.032454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1da55-481a-45ca-91f8-3f220b4312ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:53.033183 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1da55-481a-45ca-91f8-3f220b4312ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:53.033538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1da55-481a-45ca-91f8-3f220b4312ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:53.033886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1da55-481a-45ca-91f8-3f220b4312ce admin admin] PATH_INFO: `/v3/projects/2d1230e5e1f8457da98a81b49c40be7e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:53.035145 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1da55-481a-45ca-91f8-3f220b4312ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d1230e5e1f8457da98a81b49c40be7e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:53.037256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1da55-481a-45ca-91f8-3f220b4312ce admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:53.085708 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-12c1da55-481a-45ca-91f8-3f220b4312ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1230e5e1f8457da98a81b49c40be7e', 'request_id': 'req-12c1da55-481a-45ca-91f8-3f220b4312ce'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:53.092666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-12c1da55-481a-45ca-91f8-3f220b4312ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1230e5e1f8457da98a81b49c40be7e', 'request_id': 'req-12c1da55-481a-45ca-91f8-3f220b4312ce'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:53.100835 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-12c1da55-481a-45ca-91f8-3f220b4312ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1230e5e1f8457da98a81b49c40be7e', 'request_id': 'req-12c1da55-481a-45ca-91f8-3f220b4312ce'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:53.112210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-12c1da55-481a-45ca-91f8-3f220b4312ce admin admin] The token cache is being invalidate because project 2d1230e5e1f8457da98a81b49c40be7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:53.112432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-12c1da55-481a-45ca-91f8-3f220b4312ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:53.113260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-12c1da55-481a-45ca-91f8-3f220b4312ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:53.114812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1068/2121] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:52 2022] DELETE /identity/v3/projects/2d1230e5e1f8457da98a81b49c40be7e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:53.119728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0448342-d77e-4c9a-990d-26b359a8b2ec None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:53.120021 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0448342-d77e-4c9a-990d-26b359a8b2ec None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:53.120302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0448342-d77e-4c9a-990d-26b359a8b2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:53.141969 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a0448342-d77e-4c9a-990d-26b359a8b2ec None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:53.143194 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a0448342-d77e-4c9a-990d-26b359a8b2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:53.199751 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:53.214711 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1054/2122] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:53.219966 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8636b-a2ab-462c-94b1-58cb11fb2d45 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:53.220569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8636b-a2ab-462c-94b1-58cb11fb2d45 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:53.221055 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8636b-a2ab-462c-94b1-58cb11fb2d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:53.241579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d9a8636b-a2ab-462c-94b1-58cb11fb2d45 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:53.242911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d9a8636b-a2ab-462c-94b1-58cb11fb2d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:53.251176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1069/2123] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:53.255621 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0448342-d77e-4c9a-990d-26b359a8b2ec None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:53.266518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0448342-d77e-4c9a-990d-26b359a8b2ec None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:53.271137 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff51592-297f-46df-8b33-216d29c1424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:53.271803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff51592-297f-46df-8b33-216d29c1424d admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:53.272087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff51592-297f-46df-8b33-216d29c1424d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:53.272360 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff51592-297f-46df-8b33-216d29c1424d admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:53.273055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff51592-297f-46df-8b33-216d29c1424d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:53.273363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff51592-297f-46df-8b33-216d29c1424d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:53.275592 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff51592-297f-46df-8b33-216d29c1424d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:53.288778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1055/2124] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:26:53.293147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8636b-a2ab-462c-94b1-58cb11fb2d45 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:53.303262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8636b-a2ab-462c-94b1-58cb11fb2d45 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:53.308528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950b8a8-0c26-4bc0-90fe-7c2403f2166f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:53.309157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950b8a8-0c26-4bc0-90fe-7c2403f2166f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:53.309437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950b8a8-0c26-4bc0-90fe-7c2403f2166f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:53.309707 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950b8a8-0c26-4bc0-90fe-7c2403f2166f admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:53.310430 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950b8a8-0c26-4bc0-90fe-7c2403f2166f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:53.312334 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950b8a8-0c26-4bc0-90fe-7c2403f2166f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:53.347400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1070/2125] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:53 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:53.351536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff51592-297f-46df-8b33-216d29c1424d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:53.361795 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff51592-297f-46df-8b33-216d29c1424d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:53.425532 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452f375-107b-45dc-9357-6a29444721e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:53.426241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452f375-107b-45dc-9357-6a29444721e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:53.426631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452f375-107b-45dc-9357-6a29444721e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:53.426977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452f375-107b-45dc-9357-6a29444721e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:53.427708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452f375-107b-45dc-9357-6a29444721e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:53.429649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452f375-107b-45dc-9357-6a29444721e3 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:53.456140 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1056/2126] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:53 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:53.460602 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950b8a8-0c26-4bc0-90fe-7c2403f2166f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:53.478007 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950b8a8-0c26-4bc0-90fe-7c2403f2166f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:53.483380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a52258-82a6-43f6-92c4-dc525ca2d452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:53.484089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a52258-82a6-43f6-92c4-dc525ca2d452 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:53.484452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a52258-82a6-43f6-92c4-dc525ca2d452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:53.484741 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a52258-82a6-43f6-92c4-dc525ca2d452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:53.485435 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a52258-82a6-43f6-92c4-dc525ca2d452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:53.487107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a52258-82a6-43f6-92c4-dc525ca2d452 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:53.499529 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1071/2127] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:53.503834 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452f375-107b-45dc-9357-6a29444721e3 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:53.516590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452f375-107b-45dc-9357-6a29444721e3 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:53.521596 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c4652-f889-4408-b0dd-7054c6874072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:53.522238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c4652-f889-4408-b0dd-7054c6874072 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:53.522559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c4652-f889-4408-b0dd-7054c6874072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:53.522836 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c4652-f889-4408-b0dd-7054c6874072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:53.523584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c4652-f889-4408-b0dd-7054c6874072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:53.525306 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c4652-f889-4408-b0dd-7054c6874072 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:53.536858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1057/2128] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:53.540931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a52258-82a6-43f6-92c4-dc525ca2d452 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:53.551012 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a52258-82a6-43f6-92c4-dc525ca2d452 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:53.555928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ba835-d644-40ea-a079-f394a8aa1ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:53.557284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ba835-d644-40ea-a079-f394a8aa1ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:53.557668 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ba835-d644-40ea-a079-f394a8aa1ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:53.558030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ba835-d644-40ea-a079-f394a8aa1ac7 admin admin] PATH_INFO: `/v3/projects/84da8e852f6741839b90953141b9039e/users/1e1576cd65994f30be7cef15f910cf3a/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:53.574108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ba835-d644-40ea-a079-f394a8aa1ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84da8e852f6741839b90953141b9039e, user_id=1e1576cd65994f30be7cef15f910cf3a, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:53.576943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ba835-d644-40ea-a079-f394a8aa1ac7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:53.591098 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1072/2129] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:53 2022] PUT /identity/v3/projects/84da8e852f6741839b90953141b9039e/users/1e1576cd65994f30be7cef15f910cf3a/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:53.601342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eab75-388f-4d11-9af9-3a12871c3ab6 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:53.601628 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eab75-388f-4d11-9af9-3a12871c3ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:53.601909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eab75-388f-4d11-9af9-3a12871c3ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:53.651126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6f6eab75-388f-4d11-9af9-3a12871c3ab6 None None] MFA Rules not processed for user `1e1576cd65994f30be7cef15f910cf3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:53.652371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6f6eab75-388f-4d11-9af9-3a12871c3ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:53.718199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1058/2130] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:53.722689 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ba835-d644-40ea-a079-f394a8aa1ac7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:53.785527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ba835-d644-40ea-a079-f394a8aa1ac7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:53.789754 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9df4a7-bf4b-4229-8f4c-870e5addd48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:53.790441 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9df4a7-bf4b-4229-8f4c-870e5addd48e admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:53.790766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9df4a7-bf4b-4229-8f4c-870e5addd48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:53.791062 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9df4a7-bf4b-4229-8f4c-870e5addd48e admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:53.791722 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9df4a7-bf4b-4229-8f4c-870e5addd48e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:53.793633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9df4a7-bf4b-4229-8f4c-870e5addd48e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:53.809920 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:53.828158 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1073/2131] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:53 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:53.830907 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6eab75-388f-4d11-9af9-3a12871c3ab6 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:53.841900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6eab75-388f-4d11-9af9-3a12871c3ab6 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:53.897389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:53.905299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa6b71-cdad-447f-8291-1b7117477efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:53.906051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6b71-cdad-447f-8291-1b7117477efa admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:53.906338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6b71-cdad-447f-8291-1b7117477efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:53.906660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa6b71-cdad-447f-8291-1b7117477efa admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:53.907330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa6b71-cdad-447f-8291-1b7117477efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:53.909255 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa6b71-cdad-447f-8291-1b7117477efa admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:53.932173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1059/2132] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:53 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:53.936145 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9df4a7-bf4b-4229-8f4c-870e5addd48e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:53.946266 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9df4a7-bf4b-4229-8f4c-870e5addd48e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:53.952471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7faeaa-7d81-44c0-b9b0-a09b1b17d15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:53.953848 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7faeaa-7d81-44c0-b9b0-a09b1b17d15f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:53.954134 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7faeaa-7d81-44c0-b9b0-a09b1b17d15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:53.954469 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7faeaa-7d81-44c0-b9b0-a09b1b17d15f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:53.955371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7faeaa-7d81-44c0-b9b0-a09b1b17d15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:53.960538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7faeaa-7d81-44c0-b9b0-a09b1b17d15f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:53.982157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1074/2133] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:26:53.986353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa6b71-cdad-447f-8291-1b7117477efa admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:53.999624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa6b71-cdad-447f-8291-1b7117477efa admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:54.008528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12ca3e-c506-4a94-ae5a-57a8f14a9438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:54.009297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ca3e-c506-4a94-ae5a-57a8f14a9438 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:54.009690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ca3e-c506-4a94-ae5a-57a8f14a9438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:54.010087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ca3e-c506-4a94-ae5a-57a8f14a9438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:54.010939 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12ca3e-c506-4a94-ae5a-57a8f14a9438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:54.012862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12ca3e-c506-4a94-ae5a-57a8f14a9438 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:54.026296 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1060/2134] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:54.031413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7faeaa-7d81-44c0-b9b0-a09b1b17d15f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:54.044514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7faeaa-7d81-44c0-b9b0-a09b1b17d15f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:54.051057 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59959484-0349-4151-ad22-24b377a50f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:54.051916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59959484-0349-4151-ad22-24b377a50f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:54.052207 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59959484-0349-4151-ad22-24b377a50f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:54.052516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59959484-0349-4151-ad22-24b377a50f9f admin admin] PATH_INFO: `/v3/projects/0acfb8c3b232426892c89abdde4c625b/users/3db6ebcf84ec405ca8af76e3e9d02526/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:54.078352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59959484-0349-4151-ad22-24b377a50f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acfb8c3b232426892c89abdde4c625b, user_id=3db6ebcf84ec405ca8af76e3e9d02526, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:54.081110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59959484-0349-4151-ad22-24b377a50f9f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:54.094961 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1075/2135] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:54 2022] PUT /identity/v3/projects/0acfb8c3b232426892c89abdde4c625b/users/3db6ebcf84ec405ca8af76e3e9d02526/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:54.107552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe6ca-23fe-4741-bc56-a9f1f667d3f3 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:54.107552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe6ca-23fe-4741-bc56-a9f1f667d3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:54.107792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe6ca-23fe-4741-bc56-a9f1f667d3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:54.176222 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5cdfe6ca-23fe-4741-bc56-a9f1f667d3f3 None None] MFA Rules not processed for user `3db6ebcf84ec405ca8af76e3e9d02526`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:54.177701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5cdfe6ca-23fe-4741-bc56-a9f1f667d3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:54.267982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1061/2136] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:54.272579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59959484-0349-4151-ad22-24b377a50f9f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:54.349967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59959484-0349-4151-ad22-24b377a50f9f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:54.355903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf0364-6b6c-4854-a72b-a03f6706a8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:54.356528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf0364-6b6c-4854-a72b-a03f6706a8bf admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:54.356808 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf0364-6b6c-4854-a72b-a03f6706a8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:54.357079 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf0364-6b6c-4854-a72b-a03f6706a8bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:54.357752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf0364-6b6c-4854-a72b-a03f6706a8bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:54.359759 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf0364-6b6c-4854-a72b-a03f6706a8bf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:54.387206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1076/2137] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:54 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:54.391377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfe6ca-23fe-4741-bc56-a9f1f667d3f3 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:54.403089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfe6ca-23fe-4741-bc56-a9f1f667d3f3 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:54.460640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31348ee-ca83-4dbe-a951-9170302b7d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:54.461356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31348ee-ca83-4dbe-a951-9170302b7d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:54.461590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31348ee-ca83-4dbe-a951-9170302b7d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:54.461873 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31348ee-ca83-4dbe-a951-9170302b7d48 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:54.463140 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31348ee-ca83-4dbe-a951-9170302b7d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:54.465602 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31348ee-ca83-4dbe-a951-9170302b7d48 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:54.490956 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1062/2138] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:54 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:54.492263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf0364-6b6c-4854-a72b-a03f6706a8bf admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:54.503785 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf0364-6b6c-4854-a72b-a03f6706a8bf admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:54.508396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbcfcb-5df7-4456-bdc6-12fbd59ed4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:54.509010 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbcfcb-5df7-4456-bdc6-12fbd59ed4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:54.509348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbcfcb-5df7-4456-bdc6-12fbd59ed4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:54.509633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbcfcb-5df7-4456-bdc6-12fbd59ed4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:54.510334 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbcfcb-5df7-4456-bdc6-12fbd59ed4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:54.511969 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbcfcb-5df7-4456-bdc6-12fbd59ed4a5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:54.522665 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1077/2139] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:54.527288 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31348ee-ca83-4dbe-a951-9170302b7d48 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:54.537087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31348ee-ca83-4dbe-a951-9170302b7d48 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:54.542176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7941900-8b31-4d72-a993-3aa9cb6233da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:54.542856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7941900-8b31-4d72-a993-3aa9cb6233da admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:54.543142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7941900-8b31-4d72-a993-3aa9cb6233da admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:54.543419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7941900-8b31-4d72-a993-3aa9cb6233da admin admin] PATH_INFO: `/v3/projects/c3ed9a54942943778692a9f390901f93/users/5a2e17bb55034af6895e6505d88bc635/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:54.558170 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7941900-8b31-4d72-a993-3aa9cb6233da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ed9a54942943778692a9f390901f93, user_id=5a2e17bb55034af6895e6505d88bc635, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:54.560795 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7941900-8b31-4d72-a993-3aa9cb6233da admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:54.573500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1063/2140] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:54 2022] PUT /identity/v3/projects/c3ed9a54942943778692a9f390901f93/users/5a2e17bb55034af6895e6505d88bc635/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:54.577499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbcfcb-5df7-4456-bdc6-12fbd59ed4a5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:54.588337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbcfcb-5df7-4456-bdc6-12fbd59ed4a5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:54.643637 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ba42b-9c3b-4ebf-a0ae-20bbeed86644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:54.644248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ba42b-9c3b-4ebf-a0ae-20bbeed86644 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:54.644533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ba42b-9c3b-4ebf-a0ae-20bbeed86644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:54.644809 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ba42b-9c3b-4ebf-a0ae-20bbeed86644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:54.645501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ba42b-9c3b-4ebf-a0ae-20bbeed86644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:54.647147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ba42b-9c3b-4ebf-a0ae-20bbeed86644 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:54.657412 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1078/2141] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:54.661652 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7941900-8b31-4d72-a993-3aa9cb6233da admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:54.672238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7941900-8b31-4d72-a993-3aa9cb6233da admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:54.676934 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ae42e-39e5-4a12-b25d-3ffbed0c29f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:54.677628 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae42e-39e5-4a12-b25d-3ffbed0c29f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:54.677927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae42e-39e5-4a12-b25d-3ffbed0c29f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:54.678190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae42e-39e5-4a12-b25d-3ffbed0c29f7 admin admin] PATH_INFO: `/v3/projects/c3ed9a54942943778692a9f390901f93/users/5a2e17bb55034af6895e6505d88bc635/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:54.680450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ae42e-39e5-4a12-b25d-3ffbed0c29f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ed9a54942943778692a9f390901f93, user_id=5a2e17bb55034af6895e6505d88bc635, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:54.683189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ae42e-39e5-4a12-b25d-3ffbed0c29f7 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:54.694043 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1064/2142] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:54 2022] PUT /identity/v3/projects/c3ed9a54942943778692a9f390901f93/users/5a2e17bb55034af6895e6505d88bc635/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:54.704527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfdb62-d4e1-42d3-ba23-2b4d366cbfa8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:54.704819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfdb62-d4e1-42d3-ba23-2b4d366cbfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:54.705096 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfdb62-d4e1-42d3-ba23-2b4d366cbfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:54.734206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e2cfdb62-d4e1-42d3-ba23-2b4d366cbfa8 None None] MFA Rules not processed for user `5a2e17bb55034af6895e6505d88bc635`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:54.735528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e2cfdb62-d4e1-42d3-ba23-2b4d366cbfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:54.754237 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:54.809846 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1079/2143] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:26:54.821330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ae42e-39e5-4a12-b25d-3ffbed0c29f7 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:54.823587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5f8ae42e-39e5-4a12-b25d-3ffbed0c29f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:54.844609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:54.886332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ae42e-39e5-4a12-b25d-3ffbed0c29f7 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:54.890644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd404f-de50-4889-a14d-186bffd5f028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:54.891261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd404f-de50-4889-a14d-186bffd5f028 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:54.891540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd404f-de50-4889-a14d-186bffd5f028 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:54.891811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd404f-de50-4889-a14d-186bffd5f028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:54.948285 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd404f-de50-4889-a14d-186bffd5f028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:54.949782 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd404f-de50-4889-a14d-186bffd5f028 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:54.959443 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1065/2144] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:55.915332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfdb62-d4e1-42d3-ba23-2b4d366cbfa8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:55.916867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e2cfdb62-d4e1-42d3-ba23-2b4d366cbfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:55.985997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfdb62-d4e1-42d3-ba23-2b4d366cbfa8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:55.990760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d0c5c-67c8-4f64-acf4-8d27fd983005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:55.991410 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d0c5c-67c8-4f64-acf4-8d27fd983005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:55.991693 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d0c5c-67c8-4f64-acf4-8d27fd983005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:55.991971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d0c5c-67c8-4f64-acf4-8d27fd983005 admin admin] PATH_INFO: `/v3/users/0f7c80211ad849d0b88738619c382a0c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:55.993231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d0c5c-67c8-4f64-acf4-8d27fd983005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f7c80211ad849d0b88738619c382a0c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:55.996021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d0c5c-67c8-4f64-acf4-8d27fd983005 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:56.043474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ca3d0c5c-67c8-4f64-acf4-8d27fd983005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f7c80211ad849d0b88738619c382a0c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:56.051810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ca3d0c5c-67c8-4f64-acf4-8d27fd983005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f7c80211ad849d0b88738619c382a0c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:56.064228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ca3d0c5c-67c8-4f64-acf4-8d27fd983005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f7c80211ad849d0b88738619c382a0c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:56.064869 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ca3d0c5c-67c8-4f64-acf4-8d27fd983005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f7c80211ad849d0b88738619c382a0c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:56.071776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ca3d0c5c-67c8-4f64-acf4-8d27fd983005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f7c80211ad849d0b88738619c382a0c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:56.078952 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1080/2145] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:55 2022] DELETE /identity/v3/users/0f7c80211ad849d0b88738619c382a0c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:56.084026 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be89cc-d1a2-40f5-9112-6928c6e87d2c None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:56.084529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be89cc-d1a2-40f5-9112-6928c6e87d2c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:56.084988 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be89cc-d1a2-40f5-9112-6928c6e87d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:56.105601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c0be89cc-d1a2-40f5-9112-6928c6e87d2c None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:56.106848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c0be89cc-d1a2-40f5-9112-6928c6e87d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:56.176461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1066/2146] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:56.186899 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d0c5c-67c8-4f64-acf4-8d27fd983005 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:56.188572 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ca3d0c5c-67c8-4f64-acf4-8d27fd983005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:56.234503 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:56.254670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d0c5c-67c8-4f64-acf4-8d27fd983005 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:56.258298 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc60a39-d599-4510-be21-720db5bd927c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:56.258945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc60a39-d599-4510-be21-720db5bd927c service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:56.259269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc60a39-d599-4510-be21-720db5bd927c service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:56.259536 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc60a39-d599-4510-be21-720db5bd927c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:56.269020 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc60a39-d599-4510-be21-720db5bd927c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:56.270488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc60a39-d599-4510-be21-720db5bd927c service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:56.280414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1081/2147] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:26:56.713549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be89cc-d1a2-40f5-9112-6928c6e87d2c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:56.715513 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c0be89cc-d1a2-40f5-9112-6928c6e87d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:56.727423 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be89cc-d1a2-40f5-9112-6928c6e87d2c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:56.732039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:56.732684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:56.732966 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:56.733590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] PATH_INFO: `/v3/projects/c0badb51a27d49069aec5f50b0d14aee` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:56.734712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0badb51a27d49069aec5f50b0d14aee)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:56.736622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:56.796763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0badb51a27d49069aec5f50b0d14aee', 'request_id': 'req-3f808948-9164-4b0f-90fe-8f4ebd8cd590'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:56.805335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0badb51a27d49069aec5f50b0d14aee', 'request_id': 'req-3f808948-9164-4b0f-90fe-8f4ebd8cd590'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:56.811953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0badb51a27d49069aec5f50b0d14aee', 'request_id': 'req-3f808948-9164-4b0f-90fe-8f4ebd8cd590'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:56.813059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:56.828073 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] The token cache is being invalidate because project c0badb51a27d49069aec5f50b0d14aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:56.828466 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:56.829676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:56.831808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1067/2148] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:56 2022] DELETE /identity/v3/projects/c0badb51a27d49069aec5f50b0d14aee => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:56.836090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc60a39-d599-4510-be21-720db5bd927c service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:56.848055 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc60a39-d599-4510-be21-720db5bd927c service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:56.912463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e774e-0322-4c28-abeb-244a7da9497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:56.913409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e774e-0322-4c28-abeb-244a7da9497d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:56.913794 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e774e-0322-4c28-abeb-244a7da9497d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:56.914170 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e774e-0322-4c28-abeb-244a7da9497d admin admin] PATH_INFO: `/v3/users/593c3e0a49be4cc5bbccd71d6cf55af8` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:56.916000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e774e-0322-4c28-abeb-244a7da9497d admin admin] RBAC: Authorizing `identity:delete_user(user_id=593c3e0a49be4cc5bbccd71d6cf55af8)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:56.918692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e774e-0322-4c28-abeb-244a7da9497d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:56.968798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bb6e774e-0322-4c28-abeb-244a7da9497d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593c3e0a49be4cc5bbccd71d6cf55af8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:56.976764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bb6e774e-0322-4c28-abeb-244a7da9497d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593c3e0a49be4cc5bbccd71d6cf55af8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:56.989427 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bb6e774e-0322-4c28-abeb-244a7da9497d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593c3e0a49be4cc5bbccd71d6cf55af8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:56.990141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bb6e774e-0322-4c28-abeb-244a7da9497d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593c3e0a49be4cc5bbccd71d6cf55af8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:56.998291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bb6e774e-0322-4c28-abeb-244a7da9497d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593c3e0a49be4cc5bbccd71d6cf55af8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:57.008840 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1082/2149] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:56 2022] DELETE /identity/v3/users/593c3e0a49be4cc5bbccd71d6cf55af8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:57.390549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:57.392047 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:57.412409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f808948-9164-4b0f-90fe-8f4ebd8cd590 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:57.489536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:57.490276 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:57.490696 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:57.491060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] PATH_INFO: `/v3/projects/5631c5ad7da24302a9eee5fd71682c84` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:57.492145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5631c5ad7da24302a9eee5fd71682c84)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:57.494677 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:57.573738 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5631c5ad7da24302a9eee5fd71682c84', 'request_id': 'req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:57.582810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5631c5ad7da24302a9eee5fd71682c84', 'request_id': 'req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:57.589598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5631c5ad7da24302a9eee5fd71682c84', 'request_id': 'req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:57.604956 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] The token cache is being invalidate because project 5631c5ad7da24302a9eee5fd71682c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:57.611879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:57.612198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:57.614014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1068/2150] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:57 2022] DELETE /identity/v3/projects/5631c5ad7da24302a9eee5fd71682c84 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:57.617858 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e774e-0322-4c28-abeb-244a7da9497d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:57.619975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bb6e774e-0322-4c28-abeb-244a7da9497d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:57.636915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e774e-0322-4c28-abeb-244a7da9497d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:57.723245 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:57.736200 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c297f-5d0e-4050-ba50-1a4a3648f4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:57.738714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c297f-5d0e-4050-ba50-1a4a3648f4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:57.739069 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c297f-5d0e-4050-ba50-1a4a3648f4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:57.739505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c297f-5d0e-4050-ba50-1a4a3648f4b4 admin admin] PATH_INFO: `/v3/users/0a70ee15474646da813f17937db7437f` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:57.740844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c297f-5d0e-4050-ba50-1a4a3648f4b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a70ee15474646da813f17937db7437f)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:57.743216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c297f-5d0e-4050-ba50-1a4a3648f4b4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:57.755629 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:57.757346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:57.800599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4f7c297f-5d0e-4050-ba50-1a4a3648f4b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a70ee15474646da813f17937db7437f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:57.809151 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4f7c297f-5d0e-4050-ba50-1a4a3648f4b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a70ee15474646da813f17937db7437f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:57.823777 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4f7c297f-5d0e-4050-ba50-1a4a3648f4b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a70ee15474646da813f17937db7437f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:57.824463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4f7c297f-5d0e-4050-ba50-1a4a3648f4b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a70ee15474646da813f17937db7437f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:57.829001 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b19f4-316c-4a52-a87a-59dc8a1a9c63 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:57.834589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda4324-cc22-49f3-9bdc-ffac8349eb9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:57.835721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4f7c297f-5d0e-4050-ba50-1a4a3648f4b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a70ee15474646da813f17937db7437f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:57.836220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4324-cc22-49f3-9bdc-ffac8349eb9e service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:57.836503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4324-cc22-49f3-9bdc-ffac8349eb9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:57.836780 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda4324-cc22-49f3-9bdc-ffac8349eb9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:57.838711 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1dda4324-cc22-49f3-9bdc-ffac8349eb9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:57.848328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1083/2151] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:26:57 2022] DELETE /identity/v3/users/0a70ee15474646da813f17937db7437f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:57.889561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:57.921368 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda4324-cc22-49f3-9bdc-ffac8349eb9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:57.922850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda4324-cc22-49f3-9bdc-ffac8349eb9e service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:57.935999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1069/2152] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:26:58.235034 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c297f-5d0e-4050-ba50-1a4a3648f4b4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:58.236531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4f7c297f-5d0e-4050-ba50-1a4a3648f4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:58.398219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c297f-5d0e-4050-ba50-1a4a3648f4b4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:58.405104 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260283b-b018-465d-a64e-91e65d36ea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:58.405897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260283b-b018-465d-a64e-91e65d36ea9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:58.406276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260283b-b018-465d-a64e-91e65d36ea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:58.406682 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260283b-b018-465d-a64e-91e65d36ea9e admin admin] PATH_INFO: `/v3/projects/162aade9e1534c49946f6c4a0fde2348` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:58.407985 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260283b-b018-465d-a64e-91e65d36ea9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=162aade9e1534c49946f6c4a0fde2348)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:58.409999 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260283b-b018-465d-a64e-91e65d36ea9e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:58.477897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9260283b-b018-465d-a64e-91e65d36ea9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162aade9e1534c49946f6c4a0fde2348', 'request_id': 'req-9260283b-b018-465d-a64e-91e65d36ea9e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:58.486863 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9260283b-b018-465d-a64e-91e65d36ea9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162aade9e1534c49946f6c4a0fde2348', 'request_id': 'req-9260283b-b018-465d-a64e-91e65d36ea9e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:58.496416 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9260283b-b018-465d-a64e-91e65d36ea9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162aade9e1534c49946f6c4a0fde2348', 'request_id': 'req-9260283b-b018-465d-a64e-91e65d36ea9e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:58.511162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9260283b-b018-465d-a64e-91e65d36ea9e admin admin] The token cache is being invalidate because project 162aade9e1534c49946f6c4a0fde2348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:26:58.511706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9260283b-b018-465d-a64e-91e65d36ea9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:58.530254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9260283b-b018-465d-a64e-91e65d36ea9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:26:58.535284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1084/2153] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:26:58 2022] DELETE /identity/v3/projects/162aade9e1534c49946f6c4a0fde2348 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:26:58.540292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c84a24-c8e6-4537-87a8-55fe7ce8a237 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:58.540809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c84a24-c8e6-4537-87a8-55fe7ce8a237 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:58.541013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c84a24-c8e6-4537-87a8-55fe7ce8a237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:58.567489 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-54c84a24-c8e6-4537-87a8-55fe7ce8a237 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:58.568913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-54c84a24-c8e6-4537-87a8-55fe7ce8a237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:58.640058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1070/2154] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:58.648086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c6075-60f6-4fcc-870e-8aa4cc825799 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:58.648337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c6075-60f6-4fcc-870e-8aa4cc825799 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:58.648617 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c6075-60f6-4fcc-870e-8aa4cc825799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:58.670749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:26:58.677732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3f2c6075-60f6-4fcc-870e-8aa4cc825799 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:58.679816 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3f2c6075-60f6-4fcc-870e-8aa4cc825799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:58.689808 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1085/2155] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:26:58.695279 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c84a24-c8e6-4537-87a8-55fe7ce8a237 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:58.705565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c84a24-c8e6-4537-87a8-55fe7ce8a237 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:58.710728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970a7de-cbfb-4796-8f41-4166b4d3d43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:58.711346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970a7de-cbfb-4796-8f41-4166b4d3d43d admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:58.711626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970a7de-cbfb-4796-8f41-4166b4d3d43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:58.711899 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970a7de-cbfb-4796-8f41-4166b4d3d43d admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:58.713243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970a7de-cbfb-4796-8f41-4166b4d3d43d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:26:58.713565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970a7de-cbfb-4796-8f41-4166b4d3d43d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:58.715213 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970a7de-cbfb-4796-8f41-4166b4d3d43d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:58.735074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1071/2156] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:26:58.739499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c6075-60f6-4fcc-870e-8aa4cc825799 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:58.751238 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c6075-60f6-4fcc-870e-8aa4cc825799 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:58.760460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff9788-32ad-4b4b-a41e-258f27baae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:58.761283 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9788-32ad-4b4b-a41e-258f27baae34 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:58.761413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9788-32ad-4b4b-a41e-258f27baae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:58.761688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9788-32ad-4b4b-a41e-258f27baae34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:58.762375 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff9788-32ad-4b4b-a41e-258f27baae34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:58.764348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff9788-32ad-4b4b-a41e-258f27baae34 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:58.808396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1086/2157] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:26:58 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:26:58.812868 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970a7de-cbfb-4796-8f41-4166b4d3d43d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:58.823727 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970a7de-cbfb-4796-8f41-4166b4d3d43d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:58.825471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff9788-32ad-4b4b-a41e-258f27baae34 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:58.827418 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e4ff9788-32ad-4b4b-a41e-258f27baae34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:58.897623 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f83b27-3965-4a54-b3f9-5ef98cfbce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:58.898313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f83b27-3965-4a54-b3f9-5ef98cfbce3b admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:58.898457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff9788-32ad-4b4b-a41e-258f27baae34 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:58.898558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f83b27-3965-4a54-b3f9-5ef98cfbce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:58.898833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f83b27-3965-4a54-b3f9-5ef98cfbce3b admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:58.899505 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f83b27-3965-4a54-b3f9-5ef98cfbce3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:58.902032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f83b27-3965-4a54-b3f9-5ef98cfbce3b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:58.902785 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f444f4-b8b4-44db-a129-da8848b59265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:58.903464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f444f4-b8b4-44db-a129-da8848b59265 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:58.903812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f444f4-b8b4-44db-a129-da8848b59265 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:58.904152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f444f4-b8b4-44db-a129-da8848b59265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:58.906063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-93f444f4-b8b4-44db-a129-da8848b59265 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:58.925222 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1072/2158] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:26:58 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:26:58.929467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f83b27-3965-4a54-b3f9-5ef98cfbce3b admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:58.941847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f83b27-3965-4a54-b3f9-5ef98cfbce3b admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:58.948827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c8e53-9b71-46d2-9090-4c80de7303f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:58.949455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c8e53-9b71-46d2-9090-4c80de7303f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:58.949736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c8e53-9b71-46d2-9090-4c80de7303f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:58.950012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c8e53-9b71-46d2-9090-4c80de7303f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:58.950745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c8e53-9b71-46d2-9090-4c80de7303f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:58.952365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c8e53-9b71-46d2-9090-4c80de7303f0 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:58.965811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1073/2159] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:58.969646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c8e53-9b71-46d2-9090-4c80de7303f0 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:58.984889 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c8e53-9b71-46d2-9090-4c80de7303f0 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:58.992388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55afe9-4595-489e-b028-1d21490c8049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:58.993106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55afe9-4595-489e-b028-1d21490c8049 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:58.993388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55afe9-4595-489e-b028-1d21490c8049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:58.993764 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55afe9-4595-489e-b028-1d21490c8049 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:58.994985 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55afe9-4595-489e-b028-1d21490c8049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:58.998353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55afe9-4595-489e-b028-1d21490c8049 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:59.010491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f444f4-b8b4-44db-a129-da8848b59265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:59.011061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1074/2160] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:26:59.013384 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f444f4-b8b4-44db-a129-da8848b59265 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:59.015857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55afe9-4595-489e-b028-1d21490c8049 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:26:59.029951 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1087/2161] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:26:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:26:59.030398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55afe9-4595-489e-b028-1d21490c8049 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:26:59.036860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81530e-56e4-4fdf-a06f-c661c9c06186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:26:59.037611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81530e-56e4-4fdf-a06f-c661c9c06186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:59.037873 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81530e-56e4-4fdf-a06f-c661c9c06186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:59.038161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81530e-56e4-4fdf-a06f-c661c9c06186 admin admin] PATH_INFO: `/v3/projects/09c777d70082413db9e51e3fbd0ef368/users/416dd3fe8f5a4bcbab2dc2ee7529207e/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:59.070903 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81530e-56e4-4fdf-a06f-c661c9c06186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09c777d70082413db9e51e3fbd0ef368, user_id=416dd3fe8f5a4bcbab2dc2ee7529207e, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:26:59.073718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81530e-56e4-4fdf-a06f-c661c9c06186 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:26:59.107252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1075/2162] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:26:59 2022] PUT /identity/v3/projects/09c777d70082413db9e51e3fbd0ef368/users/416dd3fe8f5a4bcbab2dc2ee7529207e/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:26:59.108283 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f47d2-29fa-4a28-8367-2ee0f83f4ffc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:26:59.108410 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f47d2-29fa-4a28-8367-2ee0f83f4ffc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:26:59.108648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f47d2-29fa-4a28-8367-2ee0f83f4ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:26:59.159097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6d1f47d2-29fa-4a28-8367-2ee0f83f4ffc None None] MFA Rules not processed for user `416dd3fe8f5a4bcbab2dc2ee7529207e`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:26:59.160354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6d1f47d2-29fa-4a28-8367-2ee0f83f4ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:26:59.248049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1088/2163] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:26:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:03.991217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81530e-56e4-4fdf-a06f-c661c9c06186 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:03.993042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-cd81530e-56e4-4fdf-a06f-c661c9c06186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:04.003808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:04.057710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81530e-56e4-4fdf-a06f-c661c9c06186 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:04.062392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20242a79-5a39-4bde-9080-e0447f0b6c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:04.063059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20242a79-5a39-4bde-9080-e0447f0b6c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:04.063342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20242a79-5a39-4bde-9080-e0447f0b6c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:04.063650 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20242a79-5a39-4bde-9080-e0447f0b6c9c admin admin] PATH_INFO: `/v3/users/1e1576cd65994f30be7cef15f910cf3a` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:04.064852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20242a79-5a39-4bde-9080-e0447f0b6c9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e1576cd65994f30be7cef15f910cf3a)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:04.066888 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20242a79-5a39-4bde-9080-e0447f0b6c9c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:04.114253 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-20242a79-5a39-4bde-9080-e0447f0b6c9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e1576cd65994f30be7cef15f910cf3a'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.121876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-20242a79-5a39-4bde-9080-e0447f0b6c9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e1576cd65994f30be7cef15f910cf3a'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.128993 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-20242a79-5a39-4bde-9080-e0447f0b6c9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e1576cd65994f30be7cef15f910cf3a'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.129636 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-20242a79-5a39-4bde-9080-e0447f0b6c9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e1576cd65994f30be7cef15f910cf3a'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.141168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-20242a79-5a39-4bde-9080-e0447f0b6c9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e1576cd65994f30be7cef15f910cf3a'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.146954 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1076/2164] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:27:03 2022] DELETE /identity/v3/users/1e1576cd65994f30be7cef15f910cf3a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:04.151921 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fa433-b624-4152-afa3-bdd47c150a9a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:04.152400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fa433-b624-4152-afa3-bdd47c150a9a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:04.152505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fa433-b624-4152-afa3-bdd47c150a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:04.173358 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-146fa433-b624-4152-afa3-bdd47c150a9a None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:04.174812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-146fa433-b624-4152-afa3-bdd47c150a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:04.186904 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:04.240416 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1089/2165] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:04.250609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20242a79-5a39-4bde-9080-e0447f0b6c9c admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:04.252077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-20242a79-5a39-4bde-9080-e0447f0b6c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:04.319312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20242a79-5a39-4bde-9080-e0447f0b6c9c admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:04.324207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c48cb-a3dd-4a19-acf2-64ca9437a79e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:04.324874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c48cb-a3dd-4a19-acf2-64ca9437a79e service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:04.325204 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c48cb-a3dd-4a19-acf2-64ca9437a79e service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:04.325479 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c48cb-a3dd-4a19-acf2-64ca9437a79e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:04.341277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c48cb-a3dd-4a19-acf2-64ca9437a79e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:04.341277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c48cb-a3dd-4a19-acf2-64ca9437a79e service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:04.354567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1077/2166] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:27:04.727262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fa433-b624-4152-afa3-bdd47c150a9a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:04.729379 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-146fa433-b624-4152-afa3-bdd47c150a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:04.743140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fa433-b624-4152-afa3-bdd47c150a9a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:04.747969 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:04.748623 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:04.748904 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:04.749182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] PATH_INFO: `/v3/projects/84da8e852f6741839b90953141b9039e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:04.750470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84da8e852f6741839b90953141b9039e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:04.752442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:04.800269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84da8e852f6741839b90953141b9039e', 'request_id': 'req-6150084c-a638-47de-903f-cf8079e96b39'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.806417 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84da8e852f6741839b90953141b9039e', 'request_id': 'req-6150084c-a638-47de-903f-cf8079e96b39'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.813687 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84da8e852f6741839b90953141b9039e', 'request_id': 'req-6150084c-a638-47de-903f-cf8079e96b39'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.823988 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] The token cache is being invalidate because project 84da8e852f6741839b90953141b9039e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:27:04.824281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.824899 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.826437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1090/2167] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:27:04 2022] DELETE /identity/v3/projects/84da8e852f6741839b90953141b9039e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:04.830484 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c48cb-a3dd-4a19-acf2-64ca9437a79e service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:04.840755 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c48cb-a3dd-4a19-acf2-64ca9437a79e service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:04.870800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:04.900900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54cd08-0450-4f61-ba9e-fb0b45ca72e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:04.901542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54cd08-0450-4f61-ba9e-fb0b45ca72e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:04.901828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54cd08-0450-4f61-ba9e-fb0b45ca72e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:04.902109 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54cd08-0450-4f61-ba9e-fb0b45ca72e2 admin admin] PATH_INFO: `/v3/users/3db6ebcf84ec405ca8af76e3e9d02526` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:04.903313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54cd08-0450-4f61-ba9e-fb0b45ca72e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3db6ebcf84ec405ca8af76e3e9d02526)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:04.905267 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54cd08-0450-4f61-ba9e-fb0b45ca72e2 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:04.950359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9c54cd08-0450-4f61-ba9e-fb0b45ca72e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3db6ebcf84ec405ca8af76e3e9d02526'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.957662 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9c54cd08-0450-4f61-ba9e-fb0b45ca72e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3db6ebcf84ec405ca8af76e3e9d02526'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.965699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9c54cd08-0450-4f61-ba9e-fb0b45ca72e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3db6ebcf84ec405ca8af76e3e9d02526'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.966322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9c54cd08-0450-4f61-ba9e-fb0b45ca72e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3db6ebcf84ec405ca8af76e3e9d02526'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.978152 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9c54cd08-0450-4f61-ba9e-fb0b45ca72e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3db6ebcf84ec405ca8af76e3e9d02526'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:04.984574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1078/2168] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:27:04 2022] DELETE /identity/v3/users/3db6ebcf84ec405ca8af76e3e9d02526 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:05.264946 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:05.266425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:05.279872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150084c-a638-47de-903f-cf8079e96b39 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:05.347683 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:05.348330 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:05.348609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:05.348886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] PATH_INFO: `/v3/projects/0acfb8c3b232426892c89abdde4c625b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:05.350149 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acfb8c3b232426892c89abdde4c625b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:05.352255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:05.401086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:05.405857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acfb8c3b232426892c89abdde4c625b', 'request_id': 'req-7f48b973-6486-4b33-8b91-18818f810f89'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:05.417714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acfb8c3b232426892c89abdde4c625b', 'request_id': 'req-7f48b973-6486-4b33-8b91-18818f810f89'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:05.429250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acfb8c3b232426892c89abdde4c625b', 'request_id': 'req-7f48b973-6486-4b33-8b91-18818f810f89'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:05.443577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] The token cache is being invalidate because project 0acfb8c3b232426892c89abdde4c625b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:27:05.443878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:05.444555 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:05.446296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1091/2169] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:27:05 2022] DELETE /identity/v3/projects/0acfb8c3b232426892c89abdde4c625b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:27:05.450784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54cd08-0450-4f61-ba9e-fb0b45ca72e2 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:05.454162 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9c54cd08-0450-4f61-ba9e-fb0b45ca72e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:05.478455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54cd08-0450-4f61-ba9e-fb0b45ca72e2 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:05.533465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371170b2-1a39-4b2f-8bb6-967122b0632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:05.534065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371170b2-1a39-4b2f-8bb6-967122b0632f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:05.534399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371170b2-1a39-4b2f-8bb6-967122b0632f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:05.534802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371170b2-1a39-4b2f-8bb6-967122b0632f admin admin] PATH_INFO: `/v3/users/5a2e17bb55034af6895e6505d88bc635` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:05.536078 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371170b2-1a39-4b2f-8bb6-967122b0632f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2e17bb55034af6895e6505d88bc635)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:05.538013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371170b2-1a39-4b2f-8bb6-967122b0632f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:05.591337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-371170b2-1a39-4b2f-8bb6-967122b0632f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2e17bb55034af6895e6505d88bc635'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:05.595239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:05.600480 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-371170b2-1a39-4b2f-8bb6-967122b0632f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2e17bb55034af6895e6505d88bc635'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:05.614710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-371170b2-1a39-4b2f-8bb6-967122b0632f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2e17bb55034af6895e6505d88bc635'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:05.615523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-371170b2-1a39-4b2f-8bb6-967122b0632f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2e17bb55034af6895e6505d88bc635'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:05.633126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-371170b2-1a39-4b2f-8bb6-967122b0632f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2e17bb55034af6895e6505d88bc635'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:05.640135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1079/2170] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:27:05 2022] DELETE /identity/v3/users/5a2e17bb55034af6895e6505d88bc635 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:06.032947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:06.034646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:06.050011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48b973-6486-4b33-8b91-18818f810f89 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:06.113869 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f8553-fddc-4e65-b633-aa0d7c07050b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:06.114573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f8553-fddc-4e65-b633-aa0d7c07050b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:06.114878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f8553-fddc-4e65-b633-aa0d7c07050b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:06.115147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f8553-fddc-4e65-b633-aa0d7c07050b admin admin] PATH_INFO: `/v3/projects/c3ed9a54942943778692a9f390901f93` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:06.116309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f8553-fddc-4e65-b633-aa0d7c07050b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3ed9a54942943778692a9f390901f93)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:06.118309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f8553-fddc-4e65-b633-aa0d7c07050b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:06.174481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec2f8553-fddc-4e65-b633-aa0d7c07050b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ed9a54942943778692a9f390901f93', 'request_id': 'req-ec2f8553-fddc-4e65-b633-aa0d7c07050b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:06.182050 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec2f8553-fddc-4e65-b633-aa0d7c07050b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ed9a54942943778692a9f390901f93', 'request_id': 'req-ec2f8553-fddc-4e65-b633-aa0d7c07050b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:06.191414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec2f8553-fddc-4e65-b633-aa0d7c07050b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ed9a54942943778692a9f390901f93', 'request_id': 'req-ec2f8553-fddc-4e65-b633-aa0d7c07050b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:06.205160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec2f8553-fddc-4e65-b633-aa0d7c07050b admin admin] The token cache is being invalidate because project c3ed9a54942943778692a9f390901f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:27:06.205457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec2f8553-fddc-4e65-b633-aa0d7c07050b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:06.206179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec2f8553-fddc-4e65-b633-aa0d7c07050b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:06.207923 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1092/2171] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:27:06 2022] DELETE /identity/v3/projects/c3ed9a54942943778692a9f390901f93 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:06.213710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9b304-bbb2-491f-84fe-3d7869490ac4 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:06.214500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9b304-bbb2-491f-84fe-3d7869490ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:06.214931 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9b304-bbb2-491f-84fe-3d7869490ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:06.256064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-f5f9b304-bbb2-491f-84fe-3d7869490ac4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:06.257312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f5f9b304-bbb2-491f-84fe-3d7869490ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:06.350689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1080/2172] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:06.356130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2c4db-f22e-4816-b227-07a5a36245df None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:06.356669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2c4db-f22e-4816-b227-07a5a36245df None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:06.356669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2c4db-f22e-4816-b227-07a5a36245df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:06.378210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-20d2c4db-f22e-4816-b227-07a5a36245df None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:06.379480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-20d2c4db-f22e-4816-b227-07a5a36245df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:06.391146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1093/2173] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:06.395463 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9b304-bbb2-491f-84fe-3d7869490ac4 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:06.406309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9b304-bbb2-491f-84fe-3d7869490ac4 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:06.411280 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504f5b4-dbfc-4587-9295-670d1354fea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:06.412011 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504f5b4-dbfc-4587-9295-670d1354fea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:06.412395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504f5b4-dbfc-4587-9295-670d1354fea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:06.412858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504f5b4-dbfc-4587-9295-670d1354fea5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:06.413641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504f5b4-dbfc-4587-9295-670d1354fea5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:27:06.414046 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504f5b4-dbfc-4587-9295-670d1354fea5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:06.415778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504f5b4-dbfc-4587-9295-670d1354fea5 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:06.429346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1081/2174] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:27:06.438021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2c4db-f22e-4816-b227-07a5a36245df None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:06.448260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2c4db-f22e-4816-b227-07a5a36245df None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:06.452938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a240e-3a91-49de-808a-2f8d183ed90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:06.453596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a240e-3a91-49de-808a-2f8d183ed90d admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:06.453847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a240e-3a91-49de-808a-2f8d183ed90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:06.454125 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a240e-3a91-49de-808a-2f8d183ed90d admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:06.454852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a240e-3a91-49de-808a-2f8d183ed90d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:06.456776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a240e-3a91-49de-808a-2f8d183ed90d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:06.485894 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1094/2175] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:27:06 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:27:06.489841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504f5b4-dbfc-4587-9295-670d1354fea5 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:06.504960 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504f5b4-dbfc-4587-9295-670d1354fea5 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:06.569287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4da21-5199-46d8-89dd-f322731aa097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:06.569906 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4da21-5199-46d8-89dd-f322731aa097 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:06.570190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4da21-5199-46d8-89dd-f322731aa097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:06.570498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4da21-5199-46d8-89dd-f322731aa097 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:06.571159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4da21-5199-46d8-89dd-f322731aa097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:06.573094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4da21-5199-46d8-89dd-f322731aa097 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:06.595442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1082/2176] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:27:06 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:27:06.599547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a240e-3a91-49de-808a-2f8d183ed90d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:06.610852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a240e-3a91-49de-808a-2f8d183ed90d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:06.615519 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905003b-bb07-4561-a2d9-71c2dfc55d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:06.616136 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905003b-bb07-4561-a2d9-71c2dfc55d4e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:06.616421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905003b-bb07-4561-a2d9-71c2dfc55d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:06.616717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905003b-bb07-4561-a2d9-71c2dfc55d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:06.617396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905003b-bb07-4561-a2d9-71c2dfc55d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:06.619066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905003b-bb07-4561-a2d9-71c2dfc55d4e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:06.629095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1095/2177] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:27:06.633753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4da21-5199-46d8-89dd-f322731aa097 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:06.645631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4da21-5199-46d8-89dd-f322731aa097 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:06.651912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0b95b-cd33-4781-af19-520945cc2b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:06.652533 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0b95b-cd33-4781-af19-520945cc2b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:06.652814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0b95b-cd33-4781-af19-520945cc2b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:06.653089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0b95b-cd33-4781-af19-520945cc2b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:06.653942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0b95b-cd33-4781-af19-520945cc2b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:06.656115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0b95b-cd33-4781-af19-520945cc2b5b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:06.671609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1083/2178] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:27:06.672948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905003b-bb07-4561-a2d9-71c2dfc55d4e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:06.683692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905003b-bb07-4561-a2d9-71c2dfc55d4e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:06.688297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dafda0-c6e1-42ff-9a10-d30e8298967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:06.688951 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dafda0-c6e1-42ff-9a10-d30e8298967d admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:06.689234 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dafda0-c6e1-42ff-9a10-d30e8298967d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:06.689510 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dafda0-c6e1-42ff-9a10-d30e8298967d admin admin] PATH_INFO: `/v3/projects/858942827f3a4fb1b67dc199a055c7fd/users/28c5afc84c1340d3960d810532adfb0f/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:06.704361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dafda0-c6e1-42ff-9a10-d30e8298967d admin admin] RBAC: Authorizing `identity:create_grant(project_id=858942827f3a4fb1b67dc199a055c7fd, user_id=28c5afc84c1340d3960d810532adfb0f, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:06.707180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dafda0-c6e1-42ff-9a10-d30e8298967d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:06.715264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:06.728157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1096/2179] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:27:06 2022] PUT /identity/v3/projects/858942827f3a4fb1b67dc199a055c7fd/users/28c5afc84c1340d3960d810532adfb0f/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:06.732991 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23096511-e15c-4671-985c-c9e073bf172a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:06.733942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23096511-e15c-4671-985c-c9e073bf172a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:06.733942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23096511-e15c-4671-985c-c9e073bf172a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:06.766370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-23096511-e15c-4671-985c-c9e073bf172a None None] MFA Rules not processed for user `28c5afc84c1340d3960d810532adfb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:06.767784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-23096511-e15c-4671-985c-c9e073bf172a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:06.795750 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:06.848858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1084/2180] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:06.855859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dafda0-c6e1-42ff-9a10-d30e8298967d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:06.857696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-23dafda0-c6e1-42ff-9a10-d30e8298967d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:06.919230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dafda0-c6e1-42ff-9a10-d30e8298967d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:06.924335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e203f-8696-4d58-baad-99bf3dc8cccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:06.925007 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e203f-8696-4d58-baad-99bf3dc8cccd service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:06.925298 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e203f-8696-4d58-baad-99bf3dc8cccd service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:06.925577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e203f-8696-4d58-baad-99bf3dc8cccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:06.935335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e203f-8696-4d58-baad-99bf3dc8cccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:06.936707 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e203f-8696-4d58-baad-99bf3dc8cccd service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:06.946076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1097/2181] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:27:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:27:06.972068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23096511-e15c-4671-985c-c9e073bf172a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:07.037098 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23096511-e15c-4671-985c-c9e073bf172a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:07.042667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f077069-04be-47f4-bab9-d333fc0d1d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:07.043478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077069-04be-47f4-bab9-d333fc0d1d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:07.043770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077069-04be-47f4-bab9-d333fc0d1d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:07.044052 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077069-04be-47f4-bab9-d333fc0d1d14 admin admin] PATH_INFO: `/v3/users/28c5afc84c1340d3960d810532adfb0f` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:07.045592 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f077069-04be-47f4-bab9-d333fc0d1d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c5afc84c1340d3960d810532adfb0f)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:07.047864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f077069-04be-47f4-bab9-d333fc0d1d14 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:07.101340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5f077069-04be-47f4-bab9-d333fc0d1d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c5afc84c1340d3960d810532adfb0f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:07.109662 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5f077069-04be-47f4-bab9-d333fc0d1d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c5afc84c1340d3960d810532adfb0f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:07.116597 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5f077069-04be-47f4-bab9-d333fc0d1d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c5afc84c1340d3960d810532adfb0f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:07.117317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5f077069-04be-47f4-bab9-d333fc0d1d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c5afc84c1340d3960d810532adfb0f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:07.129914 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5f077069-04be-47f4-bab9-d333fc0d1d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c5afc84c1340d3960d810532adfb0f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:07.135819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1085/2182] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:27:06 2022] DELETE /identity/v3/users/28c5afc84c1340d3960d810532adfb0f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:07.140278 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a675159-3a1e-4497-9725-9aeeb43061d4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:07.140571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a675159-3a1e-4497-9725-9aeeb43061d4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:07.140851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a675159-3a1e-4497-9725-9aeeb43061d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:07.162016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6a675159-3a1e-4497-9725-9aeeb43061d4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:07.163337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6a675159-3a1e-4497-9725-9aeeb43061d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:07.223208 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1098/2183] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:07.232868 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f077069-04be-47f4-bab9-d333fc0d1d14 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:07.234264 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5f077069-04be-47f4-bab9-d333fc0d1d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:07.281569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:07.293687 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f077069-04be-47f4-bab9-d333fc0d1d14 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:07.297656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a017e-3453-4d16-b3a0-64bbd3651a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:07.298272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a017e-3453-4d16-b3a0-64bbd3651a0b service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:07.298594 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a017e-3453-4d16-b3a0-64bbd3651a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:07.298870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a017e-3453-4d16-b3a0-64bbd3651a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:07.308687 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a017e-3453-4d16-b3a0-64bbd3651a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:07.310207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a017e-3453-4d16-b3a0-64bbd3651a0b service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:07.320142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1086/2184] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:27:07.602163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a675159-3a1e-4497-9725-9aeeb43061d4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:07.603799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6a675159-3a1e-4497-9725-9aeeb43061d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:07.616573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a675159-3a1e-4497-9725-9aeeb43061d4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:07.628972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:07.629770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:07.630151 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:07.630317 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452 admin admin] PATH_INFO: `/v3/projects/858942827f3a4fb1b67dc199a055c7fd` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:07.632614 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=858942827f3a4fb1b67dc199a055c7fd)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:07.635400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:07.686439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858942827f3a4fb1b67dc199a055c7fd', 'request_id': 'req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:07.692970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858942827f3a4fb1b67dc199a055c7fd', 'request_id': 'req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:07.700889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858942827f3a4fb1b67dc199a055c7fd', 'request_id': 'req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:07.712548 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452 admin admin] The token cache is being invalidate because project 858942827f3a4fb1b67dc199a055c7fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:27:07.712834 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:07.714065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c0e5a8f1-62ff-48b5-b8ee-24a1a919e452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:07.716062 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1099/2185] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:27:07 2022] DELETE /identity/v3/projects/858942827f3a4fb1b67dc199a055c7fd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:12.866289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83127fa4-a735-4474-be14-7dde22194bab None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:12.866795 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83127fa4-a735-4474-be14-7dde22194bab None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:12.867021 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83127fa4-a735-4474-be14-7dde22194bab None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:12.868380 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1087/2186] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 4 22:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:27:12.882712 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f59fb-da09-47bd-8969-6ffc0c0f39a8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:12.883176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f59fb-da09-47bd-8969-6ffc0c0f39a8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:12.883270 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f59fb-da09-47bd-8969-6ffc0c0f39a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:12.903897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-355f59fb-da09-47bd-8969-6ffc0c0f39a8 None None] MFA Rules not processed for user `94b2448489cc4ad1a6fd3096ebd3f746`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:12.905952 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-355f59fb-da09-47bd-8969-6ffc0c0f39a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:12.929154 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:12.974517 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83127fa4-a735-4474-be14-7dde22194bab None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:12.976232 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-83127fa4-a735-4474-be14-7dde22194bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:12.993626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1100/2187] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 4 22:27:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:13.004756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f59fb-da09-47bd-8969-6ffc0c0f39a8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:13.006143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-355f59fb-da09-47bd-8969-6ffc0c0f39a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:13.019820 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f59fb-da09-47bd-8969-6ffc0c0f39a8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:13.026611 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80b283-bb6f-4191-afbe-f8407645b095 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2448489cc4ad1a6fd3096ebd3f746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:13.027301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80b283-bb6f-4191-afbe-f8407645b095 service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:13.027583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80b283-bb6f-4191-afbe-f8407645b095 service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:13.027854 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80b283-bb6f-4191-afbe-f8407645b095 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:13.038133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80b283-bb6f-4191-afbe-f8407645b095 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:13.039764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80b283-bb6f-4191-afbe-f8407645b095 service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:13.044615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83127fa4-a735-4474-be14-7dde22194bab None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:13.049552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e99e7f-453e-479f-b593-b3f7dc7a55f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:13.050191 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99e7f-453e-479f-b593-b3f7dc7a55f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:13.050507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1101/2188] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:27:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:27:13.052151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99e7f-453e-479f-b593-b3f7dc7a55f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:13.052464 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e99e7f-453e-479f-b593-b3f7dc7a55f7 admin admin] PATH_INFO: `/v3/users/ffee73e2e3d2449ba017f04ed8b511d4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:13.053653 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e99e7f-453e-479f-b593-b3f7dc7a55f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffee73e2e3d2449ba017f04ed8b511d4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:13.055576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e99e7f-453e-479f-b593-b3f7dc7a55f7 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:13.104770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d8e99e7f-453e-479f-b593-b3f7dc7a55f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffee73e2e3d2449ba017f04ed8b511d4'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:13.112698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d8e99e7f-453e-479f-b593-b3f7dc7a55f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffee73e2e3d2449ba017f04ed8b511d4'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:13.131516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d8e99e7f-453e-479f-b593-b3f7dc7a55f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffee73e2e3d2449ba017f04ed8b511d4'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:13.132265 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d8e99e7f-453e-479f-b593-b3f7dc7a55f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffee73e2e3d2449ba017f04ed8b511d4'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:13.145421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d8e99e7f-453e-479f-b593-b3f7dc7a55f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffee73e2e3d2449ba017f04ed8b511d4'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:13.152754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1088/2189] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:27:12 2022] DELETE /identity/v3/users/ffee73e2e3d2449ba017f04ed8b511d4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:13.392076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80b283-bb6f-4191-afbe-f8407645b095 service placement] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:13.409191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80b283-bb6f-4191-afbe-f8407645b095 service placement] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:13.469244 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e229d99-ac94-4f33-a389-e136b99971b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:13.469922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229d99-ac94-4f33-a389-e136b99971b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:13.470203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229d99-ac94-4f33-a389-e136b99971b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:13.470512 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229d99-ac94-4f33-a389-e136b99971b9 admin admin] PATH_INFO: `/v3/projects/f293b1aed65340138d272729f2286fff` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:13.471674 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e229d99-ac94-4f33-a389-e136b99971b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f293b1aed65340138d272729f2286fff)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:13.473613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e229d99-ac94-4f33-a389-e136b99971b9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:13.522831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8e229d99-ac94-4f33-a389-e136b99971b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f293b1aed65340138d272729f2286fff', 'request_id': 'req-8e229d99-ac94-4f33-a389-e136b99971b9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:13.530337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8e229d99-ac94-4f33-a389-e136b99971b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f293b1aed65340138d272729f2286fff', 'request_id': 'req-8e229d99-ac94-4f33-a389-e136b99971b9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:13.539138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8e229d99-ac94-4f33-a389-e136b99971b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f293b1aed65340138d272729f2286fff', 'request_id': 'req-8e229d99-ac94-4f33-a389-e136b99971b9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:13.549572 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8e229d99-ac94-4f33-a389-e136b99971b9 admin admin] The token cache is being invalidate because project f293b1aed65340138d272729f2286fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:27:13.549868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8e229d99-ac94-4f33-a389-e136b99971b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:13.550557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8e229d99-ac94-4f33-a389-e136b99971b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:13.552432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1102/2190] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:27:13 2022] DELETE /identity/v3/projects/f293b1aed65340138d272729f2286fff => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:13.557543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b26b9-01f9-4cf5-a55d-45112ab8804d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:13.557825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b26b9-01f9-4cf5-a55d-45112ab8804d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:13.558135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b26b9-01f9-4cf5-a55d-45112ab8804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:13.579725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2f0b26b9-01f9-4cf5-a55d-45112ab8804d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:13.580958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2f0b26b9-01f9-4cf5-a55d-45112ab8804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:13.643805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1089/2191] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:27:13.652142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e1fa4-2b1b-4733-919f-a7a864a33cfb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:13.652429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e1fa4-2b1b-4733-919f-a7a864a33cfb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:13.652705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e1fa4-2b1b-4733-919f-a7a864a33cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:13.672379 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-df0e1fa4-2b1b-4733-919f-a7a864a33cfb None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:13.673612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-df0e1fa4-2b1b-4733-919f-a7a864a33cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:13.681744 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1103/2192] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:13.686529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b26b9-01f9-4cf5-a55d-45112ab8804d None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:13.696630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b26b9-01f9-4cf5-a55d-45112ab8804d None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:13.701769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf1d18-ab23-4cb4-ac2e-bfdd340f4549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:13.702377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf1d18-ab23-4cb4-ac2e-bfdd340f4549 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:13.702689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf1d18-ab23-4cb4-ac2e-bfdd340f4549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:13.702967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf1d18-ab23-4cb4-ac2e-bfdd340f4549 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:13.703664 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf1d18-ab23-4cb4-ac2e-bfdd340f4549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:27:13.703989 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf1d18-ab23-4cb4-ac2e-bfdd340f4549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:13.705563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf1d18-ab23-4cb4-ac2e-bfdd340f4549 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:13.707058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:13.719441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1090/2193] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:27:13.723813 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e1fa4-2b1b-4733-919f-a7a864a33cfb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:13.733039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e1fa4-2b1b-4733-919f-a7a864a33cfb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:13.737668 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f47040-dd15-41ef-b2a7-7105654ae303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:13.738324 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f47040-dd15-41ef-b2a7-7105654ae303 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:13.738628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f47040-dd15-41ef-b2a7-7105654ae303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:13.738902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f47040-dd15-41ef-b2a7-7105654ae303 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:13.739567 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f47040-dd15-41ef-b2a7-7105654ae303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:13.741513 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f47040-dd15-41ef-b2a7-7105654ae303 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:13.772000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1104/2194] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:27:13 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:27:13.773240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf1d18-ab23-4cb4-ac2e-bfdd340f4549 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:13.783966 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf1d18-ab23-4cb4-ac2e-bfdd340f4549 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:13.841006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7d550-8e8b-41f6-b8bd-532335385f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:13.841618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7d550-8e8b-41f6-b8bd-532335385f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:13.841896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7d550-8e8b-41f6-b8bd-532335385f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:13.842168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7d550-8e8b-41f6-b8bd-532335385f03 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:13.842872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7d550-8e8b-41f6-b8bd-532335385f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:13.844758 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7d550-8e8b-41f6-b8bd-532335385f03 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:13.867208 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1091/2195] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:27:13 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:27:13.870906 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f47040-dd15-41ef-b2a7-7105654ae303 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:13.881635 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f47040-dd15-41ef-b2a7-7105654ae303 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:13.886978 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cc94f-62c3-496f-b018-717681a56ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:13.887594 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc94f-62c3-496f-b018-717681a56ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:13.887875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc94f-62c3-496f-b018-717681a56ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:13.888151 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc94f-62c3-496f-b018-717681a56ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:13.888850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cc94f-62c3-496f-b018-717681a56ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:13.890460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cc94f-62c3-496f-b018-717681a56ca1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:13.892661 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:13.901168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1105/2196] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:27:13.905007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7d550-8e8b-41f6-b8bd-532335385f03 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:13.917020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7d550-8e8b-41f6-b8bd-532335385f03 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:13.921798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833ff4f-c8b1-49bf-9874-8aedd378830b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:13.922451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833ff4f-c8b1-49bf-9874-8aedd378830b admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:13.922744 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833ff4f-c8b1-49bf-9874-8aedd378830b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:13.923022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833ff4f-c8b1-49bf-9874-8aedd378830b admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:13.923721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833ff4f-c8b1-49bf-9874-8aedd378830b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:13.925405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833ff4f-c8b1-49bf-9874-8aedd378830b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:13.937028 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1092/2197] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:27:13.941334 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cc94f-62c3-496f-b018-717681a56ca1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:13.951800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cc94f-62c3-496f-b018-717681a56ca1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:13.956697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa205d-ff82-4124-a3a0-853ab5e2b0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:13.957345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa205d-ff82-4124-a3a0-853ab5e2b0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:13.957627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa205d-ff82-4124-a3a0-853ab5e2b0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:13.957903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa205d-ff82-4124-a3a0-853ab5e2b0e5 admin admin] PATH_INFO: `/v3/projects/9e77ea3eb102436f8de3c58a43aea4ca/users/bf807d1c7e6244edbf3f4d8fae5fe67d/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:13.972226 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa205d-ff82-4124-a3a0-853ab5e2b0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e77ea3eb102436f8de3c58a43aea4ca, user_id=bf807d1c7e6244edbf3f4d8fae5fe67d, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:13.974927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa205d-ff82-4124-a3a0-853ab5e2b0e5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:13.987672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1106/2198] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:27:13 2022] PUT /identity/v3/projects/9e77ea3eb102436f8de3c58a43aea4ca/users/bf807d1c7e6244edbf3f4d8fae5fe67d/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:13.992953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db6aca-9a8d-4ac0-a732-9a9d00499d63 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:13.993244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db6aca-9a8d-4ac0-a732-9a9d00499d63 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:13.993533 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db6aca-9a8d-4ac0-a732-9a9d00499d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:14.013710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-75db6aca-9a8d-4ac0-a732-9a9d00499d63 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:14.014942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-75db6aca-9a8d-4ac0-a732-9a9d00499d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:14.073983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1093/2199] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:14.084401 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa205d-ff82-4124-a3a0-853ab5e2b0e5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:14.086351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-81fa205d-ff82-4124-a3a0-853ab5e2b0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:14.144604 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa205d-ff82-4124-a3a0-853ab5e2b0e5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:14.148391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2efc3-584c-4b14-9ea9-fa72aaa697ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:14.149011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2efc3-584c-4b14-9ea9-fa72aaa697ba service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:14.149294 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2efc3-584c-4b14-9ea9-fa72aaa697ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:14.149568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2efc3-584c-4b14-9ea9-fa72aaa697ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:14.158515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2efc3-584c-4b14-9ea9-fa72aaa697ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:14.159946 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2efc3-584c-4b14-9ea9-fa72aaa697ba service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:14.169685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1107/2200] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:27:18.488961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa18b9-260c-4d6d-96d7-cedb62eef311 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:18.489433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa18b9-260c-4d6d-96d7-cedb62eef311 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:18.490012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa18b9-260c-4d6d-96d7-cedb62eef311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:18.539550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-8dfa18b9-260c-4d6d-96d7-cedb62eef311 None None] MFA Rules not processed for user `bf807d1c7e6244edbf3f4d8fae5fe67d`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:18.540784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8dfa18b9-260c-4d6d-96d7-cedb62eef311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:18.637931 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1094/2201] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:27:18.656748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2efc3-584c-4b14-9ea9-fa72aaa697ba service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:18.658240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5fe2efc3-584c-4b14-9ea9-fa72aaa697ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:18.739058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2efc3-584c-4b14-9ea9-fa72aaa697ba service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:18.744582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d506a1-922a-40c6-916a-7bc6fd417e46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:18.745209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d506a1-922a-40c6-916a-7bc6fd417e46 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:18.745671 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d506a1-922a-40c6-916a-7bc6fd417e46 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:18.746026 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d506a1-922a-40c6-916a-7bc6fd417e46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:18.756573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d506a1-922a-40c6-916a-7bc6fd417e46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:18.758150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d506a1-922a-40c6-916a-7bc6fd417e46 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:18.768649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1108/2202] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:27:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:27:20.223798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adfb47-686e-4b76-81b7-52eeae3800c2 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:20.224735 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adfb47-686e-4b76-81b7-52eeae3800c2 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:20.225166 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3adfb47-686e-4b76-81b7-52eeae3800c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:20.234199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:20.251815 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-f3adfb47-686e-4b76-81b7-52eeae3800c2 None None] MFA Rules not processed for user `bf807d1c7e6244edbf3f4d8fae5fe67d`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:20.253616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f3adfb47-686e-4b76-81b7-52eeae3800c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:20.263814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1095/2203] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:24.599297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d506a1-922a-40c6-916a-7bc6fd417e46 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:24.600892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d7d506a1-922a-40c6-916a-7bc6fd417e46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:24.660714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d506a1-922a-40c6-916a-7bc6fd417e46 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:24.664363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21285a-65a7-4dc1-bf14-da1d0601e04b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce7db16c4904fb1b75ac7910f4470f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:24.664973 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21285a-65a7-4dc1-bf14-da1d0601e04b service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:24.665258 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21285a-65a7-4dc1-bf14-da1d0601e04b service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:24.665534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21285a-65a7-4dc1-bf14-da1d0601e04b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:24.667281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0c21285a-65a7-4dc1-bf14-da1d0601e04b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:24.680571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:24.726301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21285a-65a7-4dc1-bf14-da1d0601e04b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:24.727769 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21285a-65a7-4dc1-bf14-da1d0601e04b service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:24.736677 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1109/2204] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:27:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:27:30.245818 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:34.732571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=20 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:43.787832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adfb47-686e-4b76-81b7-52eeae3800c2 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:43.789286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f3adfb47-686e-4b76-81b7-52eeae3800c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:43.802815 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3adfb47-686e-4b76-81b7-52eeae3800c2 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:43.807266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32fa6f-277e-42cf-9e8f-a3dc9ad95772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:43.807905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32fa6f-277e-42cf-9e8f-a3dc9ad95772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:43.808187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32fa6f-277e-42cf-9e8f-a3dc9ad95772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:43.808465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32fa6f-277e-42cf-9e8f-a3dc9ad95772 admin admin] PATH_INFO: `/v3/users/481c82a05f86471da6961a95d8198a9f` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:43.809618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32fa6f-277e-42cf-9e8f-a3dc9ad95772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=481c82a05f86471da6961a95d8198a9f)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:43.811563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32fa6f-277e-42cf-9e8f-a3dc9ad95772 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:43.865558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8b32fa6f-277e-42cf-9e8f-a3dc9ad95772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481c82a05f86471da6961a95d8198a9f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:43.873750 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8b32fa6f-277e-42cf-9e8f-a3dc9ad95772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481c82a05f86471da6961a95d8198a9f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:43.881499 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8b32fa6f-277e-42cf-9e8f-a3dc9ad95772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481c82a05f86471da6961a95d8198a9f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:43.882185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8b32fa6f-277e-42cf-9e8f-a3dc9ad95772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481c82a05f86471da6961a95d8198a9f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:43.895530 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8b32fa6f-277e-42cf-9e8f-a3dc9ad95772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481c82a05f86471da6961a95d8198a9f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:43.902059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1096/2205] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:27:43 2022] DELETE /identity/v3/users/481c82a05f86471da6961a95d8198a9f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:43.906575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6566d-525f-4cab-8b7d-6af01fe0d1c6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:43.907089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6566d-525f-4cab-8b7d-6af01fe0d1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:43.907201 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6566d-525f-4cab-8b7d-6af01fe0d1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:43.925574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b7a6566d-525f-4cab-8b7d-6af01fe0d1c6 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:43.926810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b7a6566d-525f-4cab-8b7d-6af01fe0d1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:43.989363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1110/2206] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:44.000277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32fa6f-277e-42cf-9e8f-a3dc9ad95772 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:44.001802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8b32fa6f-277e-42cf-9e8f-a3dc9ad95772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:44.065236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32fa6f-277e-42cf-9e8f-a3dc9ad95772 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:44.068947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d997e45-5a03-4e84-81a0-20cefdca7516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:44.069593 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d997e45-5a03-4e84-81a0-20cefdca7516 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:44.069884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d997e45-5a03-4e84-81a0-20cefdca7516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:44.070181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d997e45-5a03-4e84-81a0-20cefdca7516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:44.080143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d997e45-5a03-4e84-81a0-20cefdca7516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:44.081729 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d997e45-5a03-4e84-81a0-20cefdca7516 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:44.093313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1097/2207] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:27:44.475157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6566d-525f-4cab-8b7d-6af01fe0d1c6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:44.476830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b7a6566d-525f-4cab-8b7d-6af01fe0d1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:44.495160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6566d-525f-4cab-8b7d-6af01fe0d1c6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:44.502013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321f7c3-a327-4867-a29d-96d89d7cd218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:44.502818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321f7c3-a327-4867-a29d-96d89d7cd218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:44.503308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321f7c3-a327-4867-a29d-96d89d7cd218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:44.503695 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321f7c3-a327-4867-a29d-96d89d7cd218 admin admin] PATH_INFO: `/v3/projects/d1cdc361bba2472398e88f99550a2798` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:44.505018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321f7c3-a327-4867-a29d-96d89d7cd218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1cdc361bba2472398e88f99550a2798)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:44.507530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321f7c3-a327-4867-a29d-96d89d7cd218 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:44.581318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0321f7c3-a327-4867-a29d-96d89d7cd218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1cdc361bba2472398e88f99550a2798', 'request_id': 'req-0321f7c3-a327-4867-a29d-96d89d7cd218'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:44.590537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0321f7c3-a327-4867-a29d-96d89d7cd218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1cdc361bba2472398e88f99550a2798', 'request_id': 'req-0321f7c3-a327-4867-a29d-96d89d7cd218'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:44.616016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0321f7c3-a327-4867-a29d-96d89d7cd218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1cdc361bba2472398e88f99550a2798', 'request_id': 'req-0321f7c3-a327-4867-a29d-96d89d7cd218'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:44.631727 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0321f7c3-a327-4867-a29d-96d89d7cd218 admin admin] The token cache is being invalidate because project d1cdc361bba2472398e88f99550a2798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:27:44.632303 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0321f7c3-a327-4867-a29d-96d89d7cd218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:44.633414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0321f7c3-a327-4867-a29d-96d89d7cd218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:44.638752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1111/2208] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:27:44 2022] DELETE /identity/v3/projects/d1cdc361bba2472398e88f99550a2798 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:44.640328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b98ce-e121-4396-9491-82282687decb None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:44.640616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b98ce-e121-4396-9491-82282687decb None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:44.640973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b98ce-e121-4396-9491-82282687decb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:44.677529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-0e7b98ce-e121-4396-9491-82282687decb None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:44.677529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0e7b98ce-e121-4396-9491-82282687decb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:44.805068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1098/2209] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:27:44.815461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85770a-4987-418b-a520-29ef8e98df86 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:44.816025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85770a-4987-418b-a520-29ef8e98df86 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:44.816283 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85770a-4987-418b-a520-29ef8e98df86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:44.865192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6b85770a-4987-418b-a520-29ef8e98df86 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:44.866793 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6b85770a-4987-418b-a520-29ef8e98df86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:44.879021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1112/2210] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:27:44.883803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b98ce-e121-4396-9491-82282687decb None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:44.895970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b98ce-e121-4396-9491-82282687decb None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:44.908419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51504ede-fed2-4ad7-9f99-f57430a5be3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:44.909216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51504ede-fed2-4ad7-9f99-f57430a5be3e admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:44.909678 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51504ede-fed2-4ad7-9f99-f57430a5be3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:44.910138 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51504ede-fed2-4ad7-9f99-f57430a5be3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:44.911078 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51504ede-fed2-4ad7-9f99-f57430a5be3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:27:44.912156 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51504ede-fed2-4ad7-9f99-f57430a5be3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:44.914830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51504ede-fed2-4ad7-9f99-f57430a5be3e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:44.932661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1099/2211] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:27:44.936701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85770a-4987-418b-a520-29ef8e98df86 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:44.947510 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85770a-4987-418b-a520-29ef8e98df86 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:44.954121 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1ffb2-d60d-4e64-aee5-e2cb7fd2503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:44.955735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1ffb2-d60d-4e64-aee5-e2cb7fd2503c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:44.956199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1ffb2-d60d-4e64-aee5-e2cb7fd2503c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:44.956631 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1ffb2-d60d-4e64-aee5-e2cb7fd2503c admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:44.957724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1ffb2-d60d-4e64-aee5-e2cb7fd2503c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:44.961724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1ffb2-d60d-4e64-aee5-e2cb7fd2503c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:45.007344 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1113/2212] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:27:44 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:27:45.008478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51504ede-fed2-4ad7-9f99-f57430a5be3e admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:45.015461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:45.021182 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51504ede-fed2-4ad7-9f99-f57430a5be3e admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:45.110345 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0e332-3c51-4d6c-89c4-91bb1f7e2d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:45.111401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0e332-3c51-4d6c-89c4-91bb1f7e2d61 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:45.111914 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0e332-3c51-4d6c-89c4-91bb1f7e2d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:45.112398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0e332-3c51-4d6c-89c4-91bb1f7e2d61 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:45.113301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0e332-3c51-4d6c-89c4-91bb1f7e2d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:45.116303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0e332-3c51-4d6c-89c4-91bb1f7e2d61 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:45.148482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1ffb2-d60d-4e64-aee5-e2cb7fd2503c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:45.149112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1100/2213] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:27:45 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:27:45.161092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1ffb2-d60d-4e64-aee5-e2cb7fd2503c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:45.182928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23b661-43d5-4961-96bb-8b5bf1b745a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:45.186239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b661-43d5-4961-96bb-8b5bf1b745a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:45.190099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b661-43d5-4961-96bb-8b5bf1b745a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:45.190639 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23b661-43d5-4961-96bb-8b5bf1b745a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:45.193395 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23b661-43d5-4961-96bb-8b5bf1b745a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:45.198595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23b661-43d5-4961-96bb-8b5bf1b745a3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:45.234224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0e332-3c51-4d6c-89c4-91bb1f7e2d61 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:45.247052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1114/2214] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:27:45.250496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0e332-3c51-4d6c-89c4-91bb1f7e2d61 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:45.257414 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805da1a-1abe-45cf-824b-7323c2de58ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:45.258307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805da1a-1abe-45cf-824b-7323c2de58ca admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:45.258877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805da1a-1abe-45cf-824b-7323c2de58ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:45.259371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805da1a-1abe-45cf-824b-7323c2de58ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:45.260294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805da1a-1abe-45cf-824b-7323c2de58ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:45.262512 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805da1a-1abe-45cf-824b-7323c2de58ca admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:45.299691 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1101/2215] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:27:45.303486 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23b661-43d5-4961-96bb-8b5bf1b745a3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:45.314496 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23b661-43d5-4961-96bb-8b5bf1b745a3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:45.325991 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba510f-a767-4e98-b0b9-9c2029b7068b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:45.326982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba510f-a767-4e98-b0b9-9c2029b7068b admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:45.327532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba510f-a767-4e98-b0b9-9c2029b7068b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:45.328633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba510f-a767-4e98-b0b9-9c2029b7068b admin admin] PATH_INFO: `/v3/projects/5231a83afbf44f039d225c24515eb1d6/users/b92232af93bf4b16ad6e16e8ca7a21dd/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:45.360119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba510f-a767-4e98-b0b9-9c2029b7068b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5231a83afbf44f039d225c24515eb1d6, user_id=b92232af93bf4b16ad6e16e8ca7a21dd, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:45.363676 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba510f-a767-4e98-b0b9-9c2029b7068b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:45.382849 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1115/2216] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:27:45 2022] PUT /identity/v3/projects/5231a83afbf44f039d225c24515eb1d6/users/b92232af93bf4b16ad6e16e8ca7a21dd/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:27:45.393905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ad0b-15c1-4940-8433-8676ad388e63 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:45.394388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ad0b-15c1-4940-8433-8676ad388e63 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:45.394797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ad0b-15c1-4940-8433-8676ad388e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:45.423504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5371ad0b-15c1-4940-8433-8676ad388e63 None None] MFA Rules not processed for user `b92232af93bf4b16ad6e16e8ca7a21dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:45.424710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5371ad0b-15c1-4940-8433-8676ad388e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:45.503027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1102/2217] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:45.515618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba510f-a767-4e98-b0b9-9c2029b7068b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:45.518037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-71ba510f-a767-4e98-b0b9-9c2029b7068b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:45.545118 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:45.583653 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba510f-a767-4e98-b0b9-9c2029b7068b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:45.587546 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16c4d9-ba3c-4b7c-96de-6340a0676ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:45.588168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16c4d9-ba3c-4b7c-96de-6340a0676ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:45.588535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16c4d9-ba3c-4b7c-96de-6340a0676ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:45.588707 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16c4d9-ba3c-4b7c-96de-6340a0676ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:45.598950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16c4d9-ba3c-4b7c-96de-6340a0676ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:45.600391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16c4d9-ba3c-4b7c-96de-6340a0676ac6 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:45.609945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1116/2218] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:27:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:27:50.858614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371ad0b-15c1-4940-8433-8676ad388e63 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:50.860784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5371ad0b-15c1-4940-8433-8676ad388e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:50.926315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371ad0b-15c1-4940-8433-8676ad388e63 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:50.930858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55706015-0ba6-4be0-91c3-3c92b605b377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:50.931502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55706015-0ba6-4be0-91c3-3c92b605b377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:50.931787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55706015-0ba6-4be0-91c3-3c92b605b377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:50.932065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55706015-0ba6-4be0-91c3-3c92b605b377 admin admin] PATH_INFO: `/v3/users/d672ac73b2d845adbcd4711229f9d44c` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:50.933250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55706015-0ba6-4be0-91c3-3c92b605b377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d672ac73b2d845adbcd4711229f9d44c)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:50.935202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55706015-0ba6-4be0-91c3-3c92b605b377 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:50.947976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:50.982536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-55706015-0ba6-4be0-91c3-3c92b605b377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd672ac73b2d845adbcd4711229f9d44c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:50.990416 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-55706015-0ba6-4be0-91c3-3c92b605b377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd672ac73b2d845adbcd4711229f9d44c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:50.997181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-55706015-0ba6-4be0-91c3-3c92b605b377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd672ac73b2d845adbcd4711229f9d44c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:50.997809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-55706015-0ba6-4be0-91c3-3c92b605b377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd672ac73b2d845adbcd4711229f9d44c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:51.010138 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-55706015-0ba6-4be0-91c3-3c92b605b377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd672ac73b2d845adbcd4711229f9d44c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:51.016019 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1103/2219] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:27:50 2022] DELETE /identity/v3/users/d672ac73b2d845adbcd4711229f9d44c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:51.020600 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d347523-577e-4b97-8e8c-a709aff5d2d4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:51.021068 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d347523-577e-4b97-8e8c-a709aff5d2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:51.021156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d347523-577e-4b97-8e8c-a709aff5d2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:51.039534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2d347523-577e-4b97-8e8c-a709aff5d2d4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:51.040658 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2d347523-577e-4b97-8e8c-a709aff5d2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:51.099487 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1117/2220] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:51.109887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55706015-0ba6-4be0-91c3-3c92b605b377 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:51.111350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-55706015-0ba6-4be0-91c3-3c92b605b377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:51.167381 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55706015-0ba6-4be0-91c3-3c92b605b377 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:51.171076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ac0fb-9870-4388-9be4-970ed1a3b76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:51.172406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ac0fb-9870-4388-9be4-970ed1a3b76a service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:51.172708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ac0fb-9870-4388-9be4-970ed1a3b76a service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:51.173010 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ac0fb-9870-4388-9be4-970ed1a3b76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:51.183922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ac0fb-9870-4388-9be4-970ed1a3b76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:51.185421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ac0fb-9870-4388-9be4-970ed1a3b76a service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:51.194793 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1104/2221] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:27:51.466383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d347523-577e-4b97-8e8c-a709aff5d2d4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:51.468427 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2d347523-577e-4b97-8e8c-a709aff5d2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:51.484648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d347523-577e-4b97-8e8c-a709aff5d2d4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:51.489914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a69b3-0135-4c82-a03e-8d9918712fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:51.490766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a69b3-0135-4c82-a03e-8d9918712fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:51.490917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a69b3-0135-4c82-a03e-8d9918712fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:51.491195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a69b3-0135-4c82-a03e-8d9918712fcd admin admin] PATH_INFO: `/v3/projects/cd1f23c9d45f47aab803d6065ad79e11` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:51.492435 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a69b3-0135-4c82-a03e-8d9918712fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1f23c9d45f47aab803d6065ad79e11)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:51.494318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a69b3-0135-4c82-a03e-8d9918712fcd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:51.541059 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1b7a69b3-0135-4c82-a03e-8d9918712fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1f23c9d45f47aab803d6065ad79e11', 'request_id': 'req-1b7a69b3-0135-4c82-a03e-8d9918712fcd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:51.547086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1b7a69b3-0135-4c82-a03e-8d9918712fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1f23c9d45f47aab803d6065ad79e11', 'request_id': 'req-1b7a69b3-0135-4c82-a03e-8d9918712fcd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:51.554474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1b7a69b3-0135-4c82-a03e-8d9918712fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1f23c9d45f47aab803d6065ad79e11', 'request_id': 'req-1b7a69b3-0135-4c82-a03e-8d9918712fcd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:51.565662 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1b7a69b3-0135-4c82-a03e-8d9918712fcd admin admin] The token cache is being invalidate because project cd1f23c9d45f47aab803d6065ad79e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:27:51.565957 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1b7a69b3-0135-4c82-a03e-8d9918712fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:51.566629 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1b7a69b3-0135-4c82-a03e-8d9918712fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:51.568136 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1118/2222] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:27:51 2022] DELETE /identity/v3/projects/cd1f23c9d45f47aab803d6065ad79e11 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:53.030242 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ac0fb-9870-4388-9be4-970ed1a3b76a service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:53.032156 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7a6ac0fb-9870-4388-9be4-970ed1a3b76a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:53.045530 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ac0fb-9870-4388-9be4-970ed1a3b76a service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:53.103613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16488132-566f-4d6c-9e91-82096e4d5f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:53.104260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488132-566f-4d6c-9e91-82096e4d5f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:53.104546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488132-566f-4d6c-9e91-82096e4d5f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:53.104825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488132-566f-4d6c-9e91-82096e4d5f32 admin admin] PATH_INFO: `/v3/users/b92232af93bf4b16ad6e16e8ca7a21dd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:53.106006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16488132-566f-4d6c-9e91-82096e4d5f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92232af93bf4b16ad6e16e8ca7a21dd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:53.107960 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16488132-566f-4d6c-9e91-82096e4d5f32 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:53.145227 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:53.155757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-16488132-566f-4d6c-9e91-82096e4d5f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92232af93bf4b16ad6e16e8ca7a21dd'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:53.162653 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-16488132-566f-4d6c-9e91-82096e4d5f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92232af93bf4b16ad6e16e8ca7a21dd'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:53.169442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-16488132-566f-4d6c-9e91-82096e4d5f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92232af93bf4b16ad6e16e8ca7a21dd'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:53.170088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-16488132-566f-4d6c-9e91-82096e4d5f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92232af93bf4b16ad6e16e8ca7a21dd'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:53.185588 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-16488132-566f-4d6c-9e91-82096e4d5f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92232af93bf4b16ad6e16e8ca7a21dd'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:53.192229 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1105/2223] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:27:53 2022] DELETE /identity/v3/users/b92232af93bf4b16ad6e16e8ca7a21dd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:53.196890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73abea-cb9a-405c-b3ad-540d293ae5f7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:53.197435 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73abea-cb9a-405c-b3ad-540d293ae5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:53.197435 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73abea-cb9a-405c-b3ad-540d293ae5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:53.217109 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6d73abea-cb9a-405c-b3ad-540d293ae5f7 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:53.218298 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6d73abea-cb9a-405c-b3ad-540d293ae5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:53.262561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:53.282738 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1119/2224] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:53.293351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16488132-566f-4d6c-9e91-82096e4d5f32 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:53.294868 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-16488132-566f-4d6c-9e91-82096e4d5f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:53.352056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16488132-566f-4d6c-9e91-82096e4d5f32 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:53.355767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411889d-4fbd-4978-ad25-cd0ec2ff162c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:53.356391 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411889d-4fbd-4978-ad25-cd0ec2ff162c service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:53.356672 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411889d-4fbd-4978-ad25-cd0ec2ff162c service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:53.356947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411889d-4fbd-4978-ad25-cd0ec2ff162c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:53.366547 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411889d-4fbd-4978-ad25-cd0ec2ff162c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:53.367991 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411889d-4fbd-4978-ad25-cd0ec2ff162c service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:53.377835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1106/2225] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:27:53.720640 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73abea-cb9a-405c-b3ad-540d293ae5f7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:53.722156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6d73abea-cb9a-405c-b3ad-540d293ae5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:53.735845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73abea-cb9a-405c-b3ad-540d293ae5f7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:53.741144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcded3df-2ba1-4dd5-914e-eb83f346a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:53.741787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcded3df-2ba1-4dd5-914e-eb83f346a97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:53.742061 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcded3df-2ba1-4dd5-914e-eb83f346a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:53.742330 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcded3df-2ba1-4dd5-914e-eb83f346a97f admin admin] PATH_INFO: `/v3/projects/5231a83afbf44f039d225c24515eb1d6` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:53.743674 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcded3df-2ba1-4dd5-914e-eb83f346a97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5231a83afbf44f039d225c24515eb1d6)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:53.745579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcded3df-2ba1-4dd5-914e-eb83f346a97f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:53.791828 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fcded3df-2ba1-4dd5-914e-eb83f346a97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5231a83afbf44f039d225c24515eb1d6', 'request_id': 'req-fcded3df-2ba1-4dd5-914e-eb83f346a97f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:53.798143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fcded3df-2ba1-4dd5-914e-eb83f346a97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5231a83afbf44f039d225c24515eb1d6', 'request_id': 'req-fcded3df-2ba1-4dd5-914e-eb83f346a97f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:53.807735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fcded3df-2ba1-4dd5-914e-eb83f346a97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5231a83afbf44f039d225c24515eb1d6', 'request_id': 'req-fcded3df-2ba1-4dd5-914e-eb83f346a97f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:53.818489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fcded3df-2ba1-4dd5-914e-eb83f346a97f admin admin] The token cache is being invalidate because project 5231a83afbf44f039d225c24515eb1d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:27:53.818782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fcded3df-2ba1-4dd5-914e-eb83f346a97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:53.819408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fcded3df-2ba1-4dd5-914e-eb83f346a97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:27:53.820919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1120/2226] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:27:53 2022] DELETE /identity/v3/projects/5231a83afbf44f039d225c24515eb1d6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:27:53.826560 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f9eca-4723-4933-bf3d-4badaa1c7138 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:53.826853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f9eca-4723-4933-bf3d-4badaa1c7138 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:53.827131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f9eca-4723-4933-bf3d-4badaa1c7138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:53.847542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-4b1f9eca-4723-4933-bf3d-4badaa1c7138 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:53.848740 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4b1f9eca-4723-4933-bf3d-4badaa1c7138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:53.908028 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1107/2227] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:53.915477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4e1fa-723e-43f3-af28-2b56882cbd35 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:53.915760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4e1fa-723e-43f3-af28-2b56882cbd35 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:53.916029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4e1fa-723e-43f3-af28-2b56882cbd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:53.936051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c6f4e1fa-723e-43f3-af28-2b56882cbd35 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:53.937240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c6f4e1fa-723e-43f3-af28-2b56882cbd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:53.945055 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1121/2228] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:53.949185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f9eca-4723-4933-bf3d-4badaa1c7138 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:53.959579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f9eca-4723-4933-bf3d-4badaa1c7138 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:53.964235 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d029b4-d8aa-444e-aade-32fe9fe0fed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:53.964836 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d029b4-d8aa-444e-aade-32fe9fe0fed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:53.965114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d029b4-d8aa-444e-aade-32fe9fe0fed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:53.965386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d029b4-d8aa-444e-aade-32fe9fe0fed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:53.966071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d029b4-d8aa-444e-aade-32fe9fe0fed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:27:53.966375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d029b4-d8aa-444e-aade-32fe9fe0fed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:53.967985 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d029b4-d8aa-444e-aade-32fe9fe0fed4 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:53.979852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1108/2229] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:27:53.984173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4e1fa-723e-43f3-af28-2b56882cbd35 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:53.993737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4e1fa-723e-43f3-af28-2b56882cbd35 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:53.998399 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2425134-d4db-41ad-a85d-0addcfe48890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:53.999040 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2425134-d4db-41ad-a85d-0addcfe48890 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:53.999323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2425134-d4db-41ad-a85d-0addcfe48890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:53.999599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2425134-d4db-41ad-a85d-0addcfe48890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:54.000264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2425134-d4db-41ad-a85d-0addcfe48890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:54.002164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2425134-d4db-41ad-a85d-0addcfe48890 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:54.028838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1122/2230] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:27:53 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:27:54.033463 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d029b4-d8aa-444e-aade-32fe9fe0fed4 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:54.043371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d029b4-d8aa-444e-aade-32fe9fe0fed4 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:54.086265 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:27:54.104862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca28fc-bbe9-417b-b8b7-988135ed0db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:54.105487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca28fc-bbe9-417b-b8b7-988135ed0db3 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:54.105770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca28fc-bbe9-417b-b8b7-988135ed0db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:54.106049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca28fc-bbe9-417b-b8b7-988135ed0db3 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:54.106889 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca28fc-bbe9-417b-b8b7-988135ed0db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:54.108780 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca28fc-bbe9-417b-b8b7-988135ed0db3 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:54.129956 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1109/2231] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:27:54 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:27:54.134101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2425134-d4db-41ad-a85d-0addcfe48890 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:54.145163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2425134-d4db-41ad-a85d-0addcfe48890 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:54.149843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00406b-f946-4b2e-989d-e0c49b0a0a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:54.150489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00406b-f946-4b2e-989d-e0c49b0a0a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:54.150773 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00406b-f946-4b2e-989d-e0c49b0a0a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:54.151055 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00406b-f946-4b2e-989d-e0c49b0a0a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:54.151746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00406b-f946-4b2e-989d-e0c49b0a0a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:54.153443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00406b-f946-4b2e-989d-e0c49b0a0a56 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:54.166825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1123/2232] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:27:54.168179 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca28fc-bbe9-417b-b8b7-988135ed0db3 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:54.179511 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca28fc-bbe9-417b-b8b7-988135ed0db3 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:54.184164 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc067c-59f6-4674-8310-6a09d8530d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:54.184775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc067c-59f6-4674-8310-6a09d8530d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:54.185054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc067c-59f6-4674-8310-6a09d8530d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:54.185325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc067c-59f6-4674-8310-6a09d8530d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:54.186016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc067c-59f6-4674-8310-6a09d8530d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:54.187785 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc067c-59f6-4674-8310-6a09d8530d4d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:54.199184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1110/2233] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:27:54.203499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00406b-f946-4b2e-989d-e0c49b0a0a56 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:54.214709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00406b-f946-4b2e-989d-e0c49b0a0a56 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:54.219667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaf8b9-f589-40a0-baea-6bb4b37dfbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:54.219910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaf8b9-f589-40a0-baea-6bb4b37dfbb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:54.220091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaf8b9-f589-40a0-baea-6bb4b37dfbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:54.220369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaf8b9-f589-40a0-baea-6bb4b37dfbb5 admin admin] PATH_INFO: `/v3/projects/4d87a9a292564a02b06c1d683d966c49/users/97c1cd3f0ffd445581f81a90101bd1ec/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:54.235873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaf8b9-f589-40a0-baea-6bb4b37dfbb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d87a9a292564a02b06c1d683d966c49, user_id=97c1cd3f0ffd445581f81a90101bd1ec, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:54.238547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaf8b9-f589-40a0-baea-6bb4b37dfbb5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:54.253634 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1124/2234] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:27:54 2022] PUT /identity/v3/projects/4d87a9a292564a02b06c1d683d966c49/users/97c1cd3f0ffd445581f81a90101bd1ec/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:27:54.264061 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a16d9-4665-4347-ac49-d2663eafb234 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:54.264437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a16d9-4665-4347-ac49-d2663eafb234 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:54.264799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a16d9-4665-4347-ac49-d2663eafb234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:54.292804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-001a16d9-4665-4347-ac49-d2663eafb234 None None] MFA Rules not processed for user `97c1cd3f0ffd445581f81a90101bd1ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:27:54.294027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-001a16d9-4665-4347-ac49-d2663eafb234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:54.357381 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1111/2235] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:27:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:27:54.369968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaf8b9-f589-40a0-baea-6bb4b37dfbb5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:27:54.371706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-79eaf8b9-f589-40a0-baea-6bb4b37dfbb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:27:54.430014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaf8b9-f589-40a0-baea-6bb4b37dfbb5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:27:54.433677 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5525e12-e130-4161-a498-18804a18e27c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce7db16c4904fb1b75ac7910f4470f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:27:54.434295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5525e12-e130-4161-a498-18804a18e27c service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:27:54.434605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5525e12-e130-4161-a498-18804a18e27c service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:27:54.434881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5525e12-e130-4161-a498-18804a18e27c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:27:54.443648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5525e12-e130-4161-a498-18804a18e27c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:27:54.445084 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5525e12-e130-4161-a498-18804a18e27c service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:27:54.453926 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1125/2236] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:27:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:28:04.354541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:04.449863 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:15.033862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a16d9-4665-4347-ac49-d2663eafb234 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:15.035803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-001a16d9-4665-4347-ac49-d2663eafb234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:15.101404 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a16d9-4665-4347-ac49-d2663eafb234 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:15.105869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c5aa2-47b3-44a9-bc71-26e53da443c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:15.106533 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c5aa2-47b3-44a9-bc71-26e53da443c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:15.106814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c5aa2-47b3-44a9-bc71-26e53da443c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:15.107085 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c5aa2-47b3-44a9-bc71-26e53da443c8 admin admin] PATH_INFO: `/v3/users/416dd3fe8f5a4bcbab2dc2ee7529207e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:15.108219 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c5aa2-47b3-44a9-bc71-26e53da443c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=416dd3fe8f5a4bcbab2dc2ee7529207e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:15.110115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c5aa2-47b3-44a9-bc71-26e53da443c8 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:15.162005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-535c5aa2-47b3-44a9-bc71-26e53da443c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416dd3fe8f5a4bcbab2dc2ee7529207e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:15.171624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-535c5aa2-47b3-44a9-bc71-26e53da443c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416dd3fe8f5a4bcbab2dc2ee7529207e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:15.180529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-535c5aa2-47b3-44a9-bc71-26e53da443c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416dd3fe8f5a4bcbab2dc2ee7529207e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:15.181167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-535c5aa2-47b3-44a9-bc71-26e53da443c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416dd3fe8f5a4bcbab2dc2ee7529207e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:15.192863 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-535c5aa2-47b3-44a9-bc71-26e53da443c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416dd3fe8f5a4bcbab2dc2ee7529207e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:15.200067 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1112/2237] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:28:15 2022] DELETE /identity/v3/users/416dd3fe8f5a4bcbab2dc2ee7529207e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:28:15.204437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10916d3-95c0-4447-8f9e-13b13e08aa8f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:15.204905 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10916d3-95c0-4447-8f9e-13b13e08aa8f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:15.205015 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10916d3-95c0-4447-8f9e-13b13e08aa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:15.226182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b10916d3-95c0-4447-8f9e-13b13e08aa8f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:28:15.227446 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b10916d3-95c0-4447-8f9e-13b13e08aa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:15.287268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1126/2238] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:28:15.297422 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c5aa2-47b3-44a9-bc71-26e53da443c8 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:15.299169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-535c5aa2-47b3-44a9-bc71-26e53da443c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:15.358000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c5aa2-47b3-44a9-bc71-26e53da443c8 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:15.361772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab0f6d-b5b6-4a05-bbc0-be915ddfffe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:15.362385 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab0f6d-b5b6-4a05-bbc0-be915ddfffe4 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:15.362698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab0f6d-b5b6-4a05-bbc0-be915ddfffe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:15.362975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab0f6d-b5b6-4a05-bbc0-be915ddfffe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:15.372323 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab0f6d-b5b6-4a05-bbc0-be915ddfffe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:15.373755 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab0f6d-b5b6-4a05-bbc0-be915ddfffe4 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:15.384352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1113/2239] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:28:15.659128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10916d3-95c0-4447-8f9e-13b13e08aa8f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:15.660671 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b10916d3-95c0-4447-8f9e-13b13e08aa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:15.678705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10916d3-95c0-4447-8f9e-13b13e08aa8f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:15.684401 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:15.685086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:15.685404 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:15.685576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] PATH_INFO: `/v3/projects/09c777d70082413db9e51e3fbd0ef368` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:15.686804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=09c777d70082413db9e51e3fbd0ef368)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:15.688742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:15.736680 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09c777d70082413db9e51e3fbd0ef368', 'request_id': 'req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:15.743856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09c777d70082413db9e51e3fbd0ef368', 'request_id': 'req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:15.751778 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09c777d70082413db9e51e3fbd0ef368', 'request_id': 'req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:15.761863 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] The token cache is being invalidate because project 09c777d70082413db9e51e3fbd0ef368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:28:15.762153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:15.762797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:15.764320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1127/2240] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:28:15 2022] DELETE /identity/v3/projects/09c777d70082413db9e51e3fbd0ef368 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:28:25.379876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:25.758838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:32.828332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cea29-929a-4bf5-9450-4c0de110beb2 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:32.828843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cea29-929a-4bf5-9450-4c0de110beb2 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:32.828927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cea29-929a-4bf5-9450-4c0de110beb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:32.848307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-1d6cea29-929a-4bf5-9450-4c0de110beb2 None None] MFA Rules not processed for user `ad5781045de04647bd213028d7209fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:28:32.849498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1d6cea29-929a-4bf5-9450-4c0de110beb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:32.903481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1114/2241] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:28:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:28:34.074228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:34.075741 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:34.148071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e035adc-ee13-4686-a0c9-a4a0e0582d2e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:34.153062 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db7189-fd36-4e6d-8c72-af0a3aa9a966 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2448489cc4ad1a6fd3096ebd3f746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:34.153677 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db7189-fd36-4e6d-8c72-af0a3aa9a966 service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:34.153960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db7189-fd36-4e6d-8c72-af0a3aa9a966 service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:34.154232 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db7189-fd36-4e6d-8c72-af0a3aa9a966 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:34.156119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e3db7189-fd36-4e6d-8c72-af0a3aa9a966 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:34.167741 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db7189-fd36-4e6d-8c72-af0a3aa9a966 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:34.169319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db7189-fd36-4e6d-8c72-af0a3aa9a966 service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:34.182877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1128/2242] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:28:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:28:37.017555 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cea29-929a-4bf5-9450-4c0de110beb2 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:37.019126 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1d6cea29-929a-4bf5-9450-4c0de110beb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:37.098793 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cea29-929a-4bf5-9450-4c0de110beb2 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:37.105391 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662b74b-f628-4f67-9e8d-117f790692fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:37.106524 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b74b-f628-4f67-9e8d-117f790692fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:37.107035 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b74b-f628-4f67-9e8d-117f790692fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:37.107566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662b74b-f628-4f67-9e8d-117f790692fa admin admin] PATH_INFO: `/v3/users/97c1cd3f0ffd445581f81a90101bd1ec` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:37.109199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662b74b-f628-4f67-9e8d-117f790692fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c1cd3f0ffd445581f81a90101bd1ec)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:37.111223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662b74b-f628-4f67-9e8d-117f790692fa admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:37.163187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1662b74b-f628-4f67-9e8d-117f790692fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c1cd3f0ffd445581f81a90101bd1ec'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:37.171410 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1662b74b-f628-4f67-9e8d-117f790692fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c1cd3f0ffd445581f81a90101bd1ec'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:37.178691 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1662b74b-f628-4f67-9e8d-117f790692fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c1cd3f0ffd445581f81a90101bd1ec'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:37.179473 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1662b74b-f628-4f67-9e8d-117f790692fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c1cd3f0ffd445581f81a90101bd1ec'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:37.193007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-1662b74b-f628-4f67-9e8d-117f790692fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c1cd3f0ffd445581f81a90101bd1ec'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:37.202505 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1115/2243] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:28:37 2022] DELETE /identity/v3/users/97c1cd3f0ffd445581f81a90101bd1ec => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:28:37.204211 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48ddc9-e098-437c-984e-b0bbbb8ca77c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:37.204693 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48ddc9-e098-437c-984e-b0bbbb8ca77c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:37.204802 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48ddc9-e098-437c-984e-b0bbbb8ca77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:37.224646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4c48ddc9-e098-437c-984e-b0bbbb8ca77c None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:28:37.225857 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4c48ddc9-e098-437c-984e-b0bbbb8ca77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:37.285742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1129/2244] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:28:37.296062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662b74b-f628-4f67-9e8d-117f790692fa admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:37.297509 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1662b74b-f628-4f67-9e8d-117f790692fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:37.327408 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:37.364239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662b74b-f628-4f67-9e8d-117f790692fa admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:37.367959 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4148da6-2621-41f1-96a6-fa9dad11bfeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:37.368587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4148da6-2621-41f1-96a6-fa9dad11bfeb service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:37.368870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4148da6-2621-41f1-96a6-fa9dad11bfeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:37.369148 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4148da6-2621-41f1-96a6-fa9dad11bfeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:37.379667 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4148da6-2621-41f1-96a6-fa9dad11bfeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:37.381193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4148da6-2621-41f1-96a6-fa9dad11bfeb service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:37.391599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1116/2245] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:28:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:28:37.677728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48ddc9-e098-437c-984e-b0bbbb8ca77c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:37.679269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4c48ddc9-e098-437c-984e-b0bbbb8ca77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:37.691874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48ddc9-e098-437c-984e-b0bbbb8ca77c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:37.696545 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:37.697187 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:37.697506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:37.697782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2 admin admin] PATH_INFO: `/v3/projects/4d87a9a292564a02b06c1d683d966c49` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:37.698978 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d87a9a292564a02b06c1d683d966c49)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:37.700963 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:37.748760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d87a9a292564a02b06c1d683d966c49', 'request_id': 'req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:37.754831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d87a9a292564a02b06c1d683d966c49', 'request_id': 'req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:37.762124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d87a9a292564a02b06c1d683d966c49', 'request_id': 'req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:37.772532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2 admin admin] The token cache is being invalidate because project 4d87a9a292564a02b06c1d683d966c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:28:37.772859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:37.773483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5a50b7cb-3c98-4a00-bce2-5f0a185a9fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:37.775048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1130/2246] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:28:37 2022] DELETE /identity/v3/projects/4d87a9a292564a02b06c1d683d966c49 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:28:37.780335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaedf5-5e0e-4ac6-967e-53abab65cb75 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:37.780627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaedf5-5e0e-4ac6-967e-53abab65cb75 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:37.780905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaedf5-5e0e-4ac6-967e-53abab65cb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:37.800402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6feaedf5-5e0e-4ac6-967e-53abab65cb75 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:28:37.801616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6feaedf5-5e0e-4ac6-967e-53abab65cb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:37.859977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1117/2247] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:28:37.868638 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3106a-e51a-4fe9-a1cf-ea72a0b9c393 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:37.868926 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3106a-e51a-4fe9-a1cf-ea72a0b9c393 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:37.869204 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3106a-e51a-4fe9-a1cf-ea72a0b9c393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:37.888680 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d0c3106a-e51a-4fe9-a1cf-ea72a0b9c393 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:28:37.889873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d0c3106a-e51a-4fe9-a1cf-ea72a0b9c393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:37.897698 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1131/2248] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:28:37.902468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaedf5-5e0e-4ac6-967e-53abab65cb75 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:37.912035 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaedf5-5e0e-4ac6-967e-53abab65cb75 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:37.917097 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb453a0-2cf7-4eb9-ac62-7db1cb8c6557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:37.917699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb453a0-2cf7-4eb9-ac62-7db1cb8c6557 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:37.917979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb453a0-2cf7-4eb9-ac62-7db1cb8c6557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:37.918249 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb453a0-2cf7-4eb9-ac62-7db1cb8c6557 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:37.918979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb453a0-2cf7-4eb9-ac62-7db1cb8c6557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:28:37.919283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb453a0-2cf7-4eb9-ac62-7db1cb8c6557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:37.920857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb453a0-2cf7-4eb9-ac62-7db1cb8c6557 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:37.932228 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1118/2249] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:28:37.936462 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3106a-e51a-4fe9-a1cf-ea72a0b9c393 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:37.945606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3106a-e51a-4fe9-a1cf-ea72a0b9c393 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:37.950301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750420c-d675-4960-a2d2-004e1a3da39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:37.950945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750420c-d675-4960-a2d2-004e1a3da39f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:37.951230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750420c-d675-4960-a2d2-004e1a3da39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:37.951508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750420c-d675-4960-a2d2-004e1a3da39f admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:37.952170 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750420c-d675-4960-a2d2-004e1a3da39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:37.954070 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750420c-d675-4960-a2d2-004e1a3da39f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:37.958563 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:37.984644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1132/2250] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:28:37 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:28:37.988720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb453a0-2cf7-4eb9-ac62-7db1cb8c6557 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:37.998545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb453a0-2cf7-4eb9-ac62-7db1cb8c6557 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:38.056805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c116dc0-132d-48f0-89a4-148526467411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:38.057490 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c116dc0-132d-48f0-89a4-148526467411 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:38.057689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c116dc0-132d-48f0-89a4-148526467411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:38.057963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c116dc0-132d-48f0-89a4-148526467411 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:38.058661 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c116dc0-132d-48f0-89a4-148526467411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:38.060593 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c116dc0-132d-48f0-89a4-148526467411 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:38.083647 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1119/2251] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:28:37 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:28:38.088089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750420c-d675-4960-a2d2-004e1a3da39f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:38.098852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750420c-d675-4960-a2d2-004e1a3da39f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:38.104108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60261b5e-de80-4820-bd2f-284af58e9ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:38.104721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60261b5e-de80-4820-bd2f-284af58e9ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:38.105006 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60261b5e-de80-4820-bd2f-284af58e9ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:38.105282 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60261b5e-de80-4820-bd2f-284af58e9ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:38.105975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60261b5e-de80-4820-bd2f-284af58e9ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:38.107606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60261b5e-de80-4820-bd2f-284af58e9ceb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:38.118625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1133/2252] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:28:38.122386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c116dc0-132d-48f0-89a4-148526467411 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:38.132427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c116dc0-132d-48f0-89a4-148526467411 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:38.138853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4561929-d0fa-45ac-8912-098ab73ed15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:38.139120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4561929-d0fa-45ac-8912-098ab73ed15a admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:38.139398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4561929-d0fa-45ac-8912-098ab73ed15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:38.139675 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4561929-d0fa-45ac-8912-098ab73ed15a admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:38.140371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4561929-d0fa-45ac-8912-098ab73ed15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:38.141992 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4561929-d0fa-45ac-8912-098ab73ed15a admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:38.154161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1120/2253] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:28:38.158188 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60261b5e-de80-4820-bd2f-284af58e9ceb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:38.168974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60261b5e-de80-4820-bd2f-284af58e9ceb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:38.177873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c297bcc-8c14-4589-8666-e1006995cdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:38.178772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c297bcc-8c14-4589-8666-e1006995cdff admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:38.178912 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c297bcc-8c14-4589-8666-e1006995cdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:38.179143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c297bcc-8c14-4589-8666-e1006995cdff admin admin] PATH_INFO: `/v3/projects/9b9f4984ebca478b83df48d412e2fba1/users/775a498b583240e38500d98a2a056c1e/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:38.195807 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c297bcc-8c14-4589-8666-e1006995cdff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9f4984ebca478b83df48d412e2fba1, user_id=775a498b583240e38500d98a2a056c1e, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:38.199037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c297bcc-8c14-4589-8666-e1006995cdff admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:38.214144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1134/2254] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:28:38 2022] PUT /identity/v3/projects/9b9f4984ebca478b83df48d412e2fba1/users/775a498b583240e38500d98a2a056c1e/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:28:38.224392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430cd4f-72df-4238-8683-91e70cef4ae5 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:38.224683 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430cd4f-72df-4238-8683-91e70cef4ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:38.224956 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430cd4f-72df-4238-8683-91e70cef4ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:38.251754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-4430cd4f-72df-4238-8683-91e70cef4ae5 None None] MFA Rules not processed for user `775a498b583240e38500d98a2a056c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:28:38.252949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4430cd4f-72df-4238-8683-91e70cef4ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:38.272936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:38.319373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1121/2255] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:28:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:28:38.330429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c297bcc-8c14-4589-8666-e1006995cdff admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:38.332162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7c297bcc-8c14-4589-8666-e1006995cdff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:38.393219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c297bcc-8c14-4589-8666-e1006995cdff admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:38.396941 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58d549-7023-45c3-a0ee-0ae3e7702316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:38.397553 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58d549-7023-45c3-a0ee-0ae3e7702316 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:38.397836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58d549-7023-45c3-a0ee-0ae3e7702316 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:38.398112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58d549-7023-45c3-a0ee-0ae3e7702316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:38.407391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58d549-7023-45c3-a0ee-0ae3e7702316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:38.408825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58d549-7023-45c3-a0ee-0ae3e7702316 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:38.417658 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1135/2256] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:28:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:28:48.316414 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=17 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:48.385965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430cd4f-72df-4238-8683-91e70cef4ae5 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:48.413685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:48.452051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430cd4f-72df-4238-8683-91e70cef4ae5 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:48.456461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af5c5e-65c0-41bc-a050-27ef66cecef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:48.457102 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af5c5e-65c0-41bc-a050-27ef66cecef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:48.457380 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af5c5e-65c0-41bc-a050-27ef66cecef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:48.457651 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af5c5e-65c0-41bc-a050-27ef66cecef0 admin admin] PATH_INFO: `/v3/users/775a498b583240e38500d98a2a056c1e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:48.458873 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af5c5e-65c0-41bc-a050-27ef66cecef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=775a498b583240e38500d98a2a056c1e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:48.461027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af5c5e-65c0-41bc-a050-27ef66cecef0 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:48.507158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d4af5c5e-65c0-41bc-a050-27ef66cecef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775a498b583240e38500d98a2a056c1e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:48.514211 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d4af5c5e-65c0-41bc-a050-27ef66cecef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775a498b583240e38500d98a2a056c1e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:48.521120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d4af5c5e-65c0-41bc-a050-27ef66cecef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775a498b583240e38500d98a2a056c1e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:48.521748 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d4af5c5e-65c0-41bc-a050-27ef66cecef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775a498b583240e38500d98a2a056c1e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:48.533270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d4af5c5e-65c0-41bc-a050-27ef66cecef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775a498b583240e38500d98a2a056c1e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:48.539012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1122/2257] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:28:48 2022] DELETE /identity/v3/users/775a498b583240e38500d98a2a056c1e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:28:48.544176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a46ce-4f08-4bc1-a60c-eb119e0ad7fa None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:48.544470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a46ce-4f08-4bc1-a60c-eb119e0ad7fa None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:48.544749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a46ce-4f08-4bc1-a60c-eb119e0ad7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:48.564502 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-804a46ce-4f08-4bc1-a60c-eb119e0ad7fa None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:28:48.565699 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-804a46ce-4f08-4bc1-a60c-eb119e0ad7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:48.627723 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1136/2258] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:28:48.638527 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af5c5e-65c0-41bc-a050-27ef66cecef0 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:48.640023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d4af5c5e-65c0-41bc-a050-27ef66cecef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:48.697453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af5c5e-65c0-41bc-a050-27ef66cecef0 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:48.701957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba5528-55b1-4e38-8cd6-7a540dba4693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:48.702613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba5528-55b1-4e38-8cd6-7a540dba4693 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:48.702897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba5528-55b1-4e38-8cd6-7a540dba4693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:48.703173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba5528-55b1-4e38-8cd6-7a540dba4693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:48.712686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba5528-55b1-4e38-8cd6-7a540dba4693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:48.714111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba5528-55b1-4e38-8cd6-7a540dba4693 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:48.724257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1123/2259] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:28:49.055152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a46ce-4f08-4bc1-a60c-eb119e0ad7fa None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:28:49.056744 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-804a46ce-4f08-4bc1-a60c-eb119e0ad7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:28:49.070439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a46ce-4f08-4bc1-a60c-eb119e0ad7fa None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:28:49.077926 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:28:49.078611 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:28:49.078896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:28:49.079175 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] PATH_INFO: `/v3/projects/9b9f4984ebca478b83df48d412e2fba1` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:28:49.080381 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9f4984ebca478b83df48d412e2fba1)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:28:49.082309 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:28:49.133711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9f4984ebca478b83df48d412e2fba1', 'request_id': 'req-974cd2eb-3759-459c-bec3-ce037ce30f25'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:49.140566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9f4984ebca478b83df48d412e2fba1', 'request_id': 'req-974cd2eb-3759-459c-bec3-ce037ce30f25'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:49.150648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9f4984ebca478b83df48d412e2fba1', 'request_id': 'req-974cd2eb-3759-459c-bec3-ce037ce30f25'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:49.162445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] The token cache is being invalidate because project 9b9f4984ebca478b83df48d412e2fba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:28:49.162732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:49.163407 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:28:49.165296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1137/2260] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:28:49 2022] DELETE /identity/v3/projects/9b9f4984ebca478b83df48d412e2fba1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:28:58.720063 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:28:59.159462 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:29:47.215290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe6d0-68e5-4941-a510-e0e5fb026694 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:29:47.215789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe6d0-68e5-4941-a510-e0e5fb026694 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:29:47.215941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe6d0-68e5-4941-a510-e0e5fb026694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:29:47.235141 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-58dbe6d0-68e5-4941-a510-e0e5fb026694 None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:29:47.236340 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-58dbe6d0-68e5-4941-a510-e0e5fb026694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:29:47.293797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1124/2261] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:29:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:29:47.339317 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:29:47.340853 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:29:47.429440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cd2eb-3759-459c-bec3-ce037ce30f25 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:29:47.435001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ef243-d78d-4c46-acd8-6708f2cf28c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:29:47.435982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef243-d78d-4c46-acd8-6708f2cf28c9 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:29:47.436453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef243-d78d-4c46-acd8-6708f2cf28c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:29:47.436928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ef243-d78d-4c46-acd8-6708f2cf28c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:29:47.451640 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ef243-d78d-4c46-acd8-6708f2cf28c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:29:47.453422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ef243-d78d-4c46-acd8-6708f2cf28c9 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:29:47.466218 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1138/2262] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:29:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:29:57.286290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=25 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:29:57.459041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=32 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:05.545130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285d8ba-3381-4fff-8bda-f2f6efc0d664 None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:05.545681 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285d8ba-3381-4fff-8bda-f2f6efc0d664 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:05.545681 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285d8ba-3381-4fff-8bda-f2f6efc0d664 None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:05.547133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1125/2263] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 4 22:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:30:05.553431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dd858-e389-4ed4-9ccb-fab4c40e8820 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:05.553876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dd858-e389-4ed4-9ccb-fab4c40e8820 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:05.554019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dd858-e389-4ed4-9ccb-fab4c40e8820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:05.574837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-539dd858-e389-4ed4-9ccb-fab4c40e8820 None None] MFA Rules not processed for user `04899781f67746e193a05bdc004804cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:30:05.576091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-539dd858-e389-4ed4-9ccb-fab4c40e8820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:30:05.648660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1139/2264] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 4 22:30:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:30:05.659952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285d8ba-3381-4fff-8bda-f2f6efc0d664 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:30:05.661802 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3285d8ba-3381-4fff-8bda-f2f6efc0d664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:30:05.723473 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285d8ba-3381-4fff-8bda-f2f6efc0d664 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:30:05.726936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ec835-2481-4c78-a795-f026a87fb8c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce7db16c4904fb1b75ac7910f4470f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:30:05.727537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ec835-2481-4c78-a795-f026a87fb8c6 service glance] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:05.727814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ec835-2481-4c78-a795-f026a87fb8c6 service glance] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:05.728084 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ec835-2481-4c78-a795-f026a87fb8c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:05.737740 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ec835-2481-4c78-a795-f026a87fb8c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:30:05.739219 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ec835-2481-4c78-a795-f026a87fb8c6 service glance] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:30:05.749556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1126/2265] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:30:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:30:05.817850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced8b72-f7f6-4cf2-8615-0dc739260c23 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:05.818142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced8b72-f7f6-4cf2-8615-0dc739260c23 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:05.818439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced8b72-f7f6-4cf2-8615-0dc739260c23 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:05.819811 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1140/2266] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 4 22:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:30:05.824336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948c790-81f0-41af-bce2-e7dfca3f5d5f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:05.824627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948c790-81f0-41af-bce2-e7dfca3f5d5f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:05.825147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948c790-81f0-41af-bce2-e7dfca3f5d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:05.845129 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-d948c790-81f0-41af-bce2-e7dfca3f5d5f None None] MFA Rules not processed for user `9ee0de72ba804ba491342a8ae82a44f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:30:05.846378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d948c790-81f0-41af-bce2-e7dfca3f5d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:30:05.897087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1127/2267] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 4 22:30:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:30:05.909491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced8b72-f7f6-4cf2-8615-0dc739260c23 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:30:05.911217 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9ced8b72-f7f6-4cf2-8615-0dc739260c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:30:05.924913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced8b72-f7f6-4cf2-8615-0dc739260c23 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:30:05.929139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38197648-f464-4ac6-baa7-afae33730c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:30:05.929752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38197648-f464-4ac6-baa7-afae33730c16 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:05.930029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38197648-f464-4ac6-baa7-afae33730c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:05.930326 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38197648-f464-4ac6-baa7-afae33730c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:05.939179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38197648-f464-4ac6-baa7-afae33730c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:30:05.940617 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38197648-f464-4ac6-baa7-afae33730c16 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:30:05.950154 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1141/2268] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:30:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:30:06.031977 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1095c78-2903-43ea-b419-b1267ea3ed8c None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:06.032268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1095c78-2903-43ea-b419-b1267ea3ed8c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:06.032549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1095c78-2903-43ea-b419-b1267ea3ed8c None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:06.033940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1128/2269] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 4 22:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:30:06.039281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a45e8-c8ed-42be-8b64-b0f367680ae9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:06.039569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a45e8-c8ed-42be-8b64-b0f367680ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:06.039844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a45e8-c8ed-42be-8b64-b0f367680ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:06.060508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-406a45e8-c8ed-42be-8b64-b0f367680ae9 None None] MFA Rules not processed for user `04899781f67746e193a05bdc004804cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:30:06.061736 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-406a45e8-c8ed-42be-8b64-b0f367680ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:30:06.071661 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1142/2270] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 4 22:30:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:30:06.081890 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1095c78-2903-43ea-b419-b1267ea3ed8c None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:30:06.093029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1095c78-2903-43ea-b419-b1267ea3ed8c None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:30:06.096637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9004f-5904-4c3b-b7c4-cb6bdef5cd26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:30:06.097244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9004f-5904-4c3b-b7c4-cb6bdef5cd26 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:06.097525 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9004f-5904-4c3b-b7c4-cb6bdef5cd26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:06.097799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9004f-5904-4c3b-b7c4-cb6bdef5cd26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:06.107901 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9004f-5904-4c3b-b7c4-cb6bdef5cd26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:30:06.109314 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9004f-5904-4c3b-b7c4-cb6bdef5cd26 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:30:06.120310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1129/2271] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:30:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:30:09.547770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560443d-7952-4c5a-8b33-5f8d2f421a77 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:09.548244 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560443d-7952-4c5a-8b33-5f8d2f421a77 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:09.548357 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560443d-7952-4c5a-8b33-5f8d2f421a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:09.566591 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5560443d-7952-4c5a-8b33-5f8d2f421a77 None None] MFA Rules not processed for user `bf807d1c7e6244edbf3f4d8fae5fe67d`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:30:09.568300 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5560443d-7952-4c5a-8b33-5f8d2f421a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:30:09.620555 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1143/2272] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:30:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:30:09.716604 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597ff8f-fbef-4920-956c-d5ce993b4fee None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:09.717062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597ff8f-fbef-4920-956c-d5ce993b4fee None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:09.717152 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597ff8f-fbef-4920-956c-d5ce993b4fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:09.736437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-9597ff8f-fbef-4920-956c-d5ce993b4fee None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:30:09.737826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9597ff8f-fbef-4920-956c-d5ce993b4fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:30:09.745507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1130/2273] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:30:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:30:09.758259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560443d-7952-4c5a-8b33-5f8d2f421a77 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:30:09.769871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560443d-7952-4c5a-8b33-5f8d2f421a77 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:30:09.775099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bc375-801b-43a6-a994-6acebe72fb44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:30:09.775720 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc375-801b-43a6-a994-6acebe72fb44 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:09.776002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc375-801b-43a6-a994-6acebe72fb44 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:09.776275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc375-801b-43a6-a994-6acebe72fb44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:09.784767 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bc375-801b-43a6-a994-6acebe72fb44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:30:09.786516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bc375-801b-43a6-a994-6acebe72fb44 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:30:09.795127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1144/2274] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:30:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:30:19.731237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=58 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:19.791502 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=71 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:38.964775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597ff8f-fbef-4920-956c-d5ce993b4fee None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:30:38.973958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597ff8f-fbef-4920-956c-d5ce993b4fee None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:30:38.977886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e572ce2-39b6-4171-b5be-020cd19c3652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:30:38.978546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e572ce2-39b6-4171-b5be-020cd19c3652 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:38.978827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e572ce2-39b6-4171-b5be-020cd19c3652 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:38.979099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e572ce2-39b6-4171-b5be-020cd19c3652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:38.980852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4e572ce2-39b6-4171-b5be-020cd19c3652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:30:38.994477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e572ce2-39b6-4171-b5be-020cd19c3652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:30:38.995880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e572ce2-39b6-4171-b5be-020cd19c3652 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:30:39.006457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1131/2275] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:30:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:30:39.183177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bc375-801b-43a6-a994-6acebe72fb44 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:30:39.184673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e30bc375-801b-43a6-a994-6acebe72fb44 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:30:39.197896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bc375-801b-43a6-a994-6acebe72fb44 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:30:39.201526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa1de1-607b-405c-839c-1d0e0471f0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:30:39.202133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1de1-607b-405c-839c-1d0e0471f0ea service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:39.202434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1de1-607b-405c-839c-1d0e0471f0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:39.202719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa1de1-607b-405c-839c-1d0e0471f0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:39.204447 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-27aa1de1-607b-405c-839c-1d0e0471f0ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:30:39.219281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa1de1-607b-405c-839c-1d0e0471f0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:30:39.220866 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa1de1-607b-405c-839c-1d0e0471f0ea service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:30:39.234347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1145/2276] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:30:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:30:45.437839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfaa59-15b3-4454-b8f5-3fb8ac8a99e5 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:45.438367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfaa59-15b3-4454-b8f5-3fb8ac8a99e5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:45.438511 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfaa59-15b3-4454-b8f5-3fb8ac8a99e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:45.463811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-7bcfaa59-15b3-4454-b8f5-3fb8ac8a99e5 None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:30:45.464478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7bcfaa59-15b3-4454-b8f5-3fb8ac8a99e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:30:45.476095 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1132/2277] 10.222.0.27 () {58 vars in 967 bytes} [Thu Aug 4 22:30:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:30:45.490515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa1de1-607b-405c-839c-1d0e0471f0ea service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:30:45.505625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa1de1-607b-405c-839c-1d0e0471f0ea service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:30:45.515131 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a12c3-6a71-4740-8a50-f88b50711270 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:30:45.515708 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a12c3-6a71-4740-8a50-f88b50711270 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:30:45.515990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a12c3-6a71-4740-8a50-f88b50711270 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:30:45.516266 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a12c3-6a71-4740-8a50-f88b50711270 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:30:45.526873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a12c3-6a71-4740-8a50-f88b50711270 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:30:45.528597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a12c3-6a71-4740-8a50-f88b50711270 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:30:45.537614 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1146/2278] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:30:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:30:55.455657 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=9 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:30:55.533703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=12 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:31:03.403795 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfaa59-15b3-4454-b8f5-3fb8ac8a99e5 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:31:03.405255 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7bcfaa59-15b3-4454-b8f5-3fb8ac8a99e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:31:03.422034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfaa59-15b3-4454-b8f5-3fb8ac8a99e5 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:31:03.427893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8acb4-e182-4c22-bdc3-cce2bfa28f24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:31:03.428504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8acb4-e182-4c22-bdc3-cce2bfa28f24 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:31:03.428784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8acb4-e182-4c22-bdc3-cce2bfa28f24 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:31:03.429056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8acb4-e182-4c22-bdc3-cce2bfa28f24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:31:03.430939 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ecd8acb4-e182-4c22-bdc3-cce2bfa28f24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:31:03.494357 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8acb4-e182-4c22-bdc3-cce2bfa28f24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:31:03.497034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8acb4-e182-4c22-bdc3-cce2bfa28f24 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:31:03.506842 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1133/2279] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:31:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:31:07.529132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a12c3-6a71-4740-8a50-f88b50711270 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:31:07.539711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a12c3-6a71-4740-8a50-f88b50711270 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:31:07.544164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c286e-561f-4b94-b484-2fb4a0082669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:31:07.545440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c286e-561f-4b94-b484-2fb4a0082669 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:31:07.545440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c286e-561f-4b94-b484-2fb4a0082669 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:31:07.545440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c286e-561f-4b94-b484-2fb4a0082669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:31:07.547348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-887c286e-561f-4b94-b484-2fb4a0082669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:31:07.560413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c286e-561f-4b94-b484-2fb4a0082669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:31:07.561876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c286e-561f-4b94-b484-2fb4a0082669 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:31:07.571082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1147/2280] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:31:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:31:13.502375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=28 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:31:17.566820 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:31:29.922260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a909c3e-bf43-4078-8c68-72930fce5b3d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:31:29.922809 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a909c3e-bf43-4078-8c68-72930fce5b3d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:31:29.922913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a909c3e-bf43-4078-8c68-72930fce5b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:31:29.941988 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-8a909c3e-bf43-4078-8c68-72930fce5b3d None None] MFA Rules not processed for user `ad5781045de04647bd213028d7209fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:31:29.943214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8a909c3e-bf43-4078-8c68-72930fce5b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:31:29.950730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1134/2281] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:31:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:31:31.354547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c286e-561f-4b94-b484-2fb4a0082669 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:31:31.356138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-887c286e-561f-4b94-b484-2fb4a0082669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:31:31.374086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c286e-561f-4b94-b484-2fb4a0082669 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:31:31.379696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb7e93-36b4-44bc-aaa1-58001043ff06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:31:31.380325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7e93-36b4-44bc-aaa1-58001043ff06 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:31:31.380610 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7e93-36b4-44bc-aaa1-58001043ff06 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:31:31.380890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7e93-36b4-44bc-aaa1-58001043ff06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:31:31.382687 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-39bb7e93-36b4-44bc-aaa1-58001043ff06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:31:31.446503 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb7e93-36b4-44bc-aaa1-58001043ff06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:31:31.451656 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb7e93-36b4-44bc-aaa1-58001043ff06 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:31:31.460730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1148/2282] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:31:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:31:38.681164 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a909c3e-bf43-4078-8c68-72930fce5b3d None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:31:38.698913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a909c3e-bf43-4078-8c68-72930fce5b3d None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:31:38.707956 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4537d4-c503-4100-920e-77dc144e52af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:31:38.708601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4537d4-c503-4100-920e-77dc144e52af service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:31:38.708889 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4537d4-c503-4100-920e-77dc144e52af service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:31:38.709166 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4537d4-c503-4100-920e-77dc144e52af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:31:38.710961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7e4537d4-c503-4100-920e-77dc144e52af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:31:38.724217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4537d4-c503-4100-920e-77dc144e52af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:31:38.725784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4537d4-c503-4100-920e-77dc144e52af service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:31:38.736863 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1135/2283] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:31:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:31:41.453959 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=28 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:31:48.732501 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=9 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:32:29.363023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb7e93-36b4-44bc-aaa1-58001043ff06 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:32:29.374275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb7e93-36b4-44bc-aaa1-58001043ff06 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:32:29.380687 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772ceb4-43ab-4142-9279-33979a99da02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:32:29.381318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772ceb4-43ab-4142-9279-33979a99da02 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:32:29.381602 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772ceb4-43ab-4142-9279-33979a99da02 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:32:29.381876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772ceb4-43ab-4142-9279-33979a99da02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:32:29.383674 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0772ceb4-43ab-4142-9279-33979a99da02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:32:29.440831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772ceb4-43ab-4142-9279-33979a99da02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:32:29.442438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772ceb4-43ab-4142-9279-33979a99da02 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:32:29.451422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1149/2284] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:32:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:32:39.154734 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cee9d-5c48-4616-b9bb-02e8640a04df None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:32:39.155272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cee9d-5c48-4616-b9bb-02e8640a04df None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:32:39.155272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cee9d-5c48-4616-b9bb-02e8640a04df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:32:39.174879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-979cee9d-5c48-4616-b9bb-02e8640a04df None None] MFA Rules not processed for user `edd38bf6e5f849ff99259f9f494203d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:32:39.176311 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-979cee9d-5c48-4616-b9bb-02e8640a04df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:32:39.183148 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1136/2285] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:32:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:32:39.447226 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=28 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:32:39.496813 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772ceb4-43ab-4142-9279-33979a99da02 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:32:39.506508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772ceb4-43ab-4142-9279-33979a99da02 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:32:39.510024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421b3da-c182-4668-9547-e8edca20779e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:32:39.510667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421b3da-c182-4668-9547-e8edca20779e service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:32:39.510950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421b3da-c182-4668-9547-e8edca20779e service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:32:39.511223 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421b3da-c182-4668-9547-e8edca20779e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:32:39.512951 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b421b3da-c182-4668-9547-e8edca20779e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:32:39.522790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421b3da-c182-4668-9547-e8edca20779e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:32:39.524199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421b3da-c182-4668-9547-e8edca20779e service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:32:39.531956 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1150/2286] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:32:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:32:39.843951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cee9d-5c48-4616-b9bb-02e8640a04df None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:32:39.845447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-979cee9d-5c48-4616-b9bb-02e8640a04df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:32:39.919455 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cee9d-5c48-4616-b9bb-02e8640a04df None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:32:39.924537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6a03d-0ea9-48fa-a500-a492142be851 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2448489cc4ad1a6fd3096ebd3f746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:32:39.925689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6a03d-0ea9-48fa-a500-a492142be851 service placement] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:32:39.925973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6a03d-0ea9-48fa-a500-a492142be851 service placement] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:32:39.926269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6a03d-0ea9-48fa-a500-a492142be851 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:32:39.928114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9ff6a03d-0ea9-48fa-a500-a492142be851 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:32:39.939372 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6a03d-0ea9-48fa-a500-a492142be851 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:32:39.941506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6a03d-0ea9-48fa-a500-a492142be851 service placement] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:32:39.951091 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1137/2287] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:32:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:32:49.528496 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:32:49.947064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=35 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:32:50.365548 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421b3da-c182-4668-9547-e8edca20779e service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:32:50.379999 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421b3da-c182-4668-9547-e8edca20779e service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:32:50.385740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d3d54-c50a-4d4b-9c23-198d43ea0236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:32:50.386365 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d3d54-c50a-4d4b-9c23-198d43ea0236 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:32:50.386732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d3d54-c50a-4d4b-9c23-198d43ea0236 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:32:50.386958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d3d54-c50a-4d4b-9c23-198d43ea0236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:32:50.388734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fd3d3d54-c50a-4d4b-9c23-198d43ea0236 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:32:50.401934 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d3d54-c50a-4d4b-9c23-198d43ea0236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:32:50.403573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d3d54-c50a-4d4b-9c23-198d43ea0236 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:32:50.421783 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1151/2288] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:32:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:32:53.431800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6a03d-0ea9-48fa-a500-a492142be851 service placement] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:32:53.444575 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6a03d-0ea9-48fa-a500-a492142be851 service placement] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:32:53.450024 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a7fde-cd42-47f2-812e-cc28e350d074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:32:53.450668 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a7fde-cd42-47f2-812e-cc28e350d074 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:32:53.450954 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a7fde-cd42-47f2-812e-cc28e350d074 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:32:53.451230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a7fde-cd42-47f2-812e-cc28e350d074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:32:53.452957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0c3a7fde-cd42-47f2-812e-cc28e350d074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:32:53.463732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a7fde-cd42-47f2-812e-cc28e350d074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:32:53.465310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a7fde-cd42-47f2-812e-cc28e350d074 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:32:53.474732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1138/2289] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:32:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:32:56.682684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d3d54-c50a-4d4b-9c23-198d43ea0236 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:32:56.694197 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d3d54-c50a-4d4b-9c23-198d43ea0236 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:32:56.699769 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e757af2-ac88-4e21-ab17-a279884c75ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:32:56.700379 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e757af2-ac88-4e21-ab17-a279884c75ae service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:32:56.700665 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e757af2-ac88-4e21-ab17-a279884c75ae service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:32:56.700940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e757af2-ac88-4e21-ab17-a279884c75ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:32:56.702776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6e757af2-ac88-4e21-ab17-a279884c75ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:32:56.716084 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e757af2-ac88-4e21-ab17-a279884c75ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:32:56.717729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e757af2-ac88-4e21-ab17-a279884c75ae service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:32:56.728143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1152/2290] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:32:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:33:03.470300 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=6 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:06.723768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=12 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:08.359541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9f2c-1ca8-4a28-a57e-d2f44fba1543 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:08.360067 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9f2c-1ca8-4a28-a57e-d2f44fba1543 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:08.360067 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9f2c-1ca8-4a28-a57e-d2f44fba1543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:08.379525 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-f6ce9f2c-1ca8-4a28-a57e-d2f44fba1543 None None] MFA Rules not processed for user `bf807d1c7e6244edbf3f4d8fae5fe67d`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:08.380718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f6ce9f2c-1ca8-4a28-a57e-d2f44fba1543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:08.387612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1139/2291] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:18.374242 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:32.087785 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec84d54-e509-4c48-a4b4-6c0c0e2030cb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:32.088602 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec84d54-e509-4c48-a4b4-6c0c0e2030cb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:32.088700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec84d54-e509-4c48-a4b4-6c0c0e2030cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:32.118198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4ec84d54-e509-4c48-a4b4-6c0c0e2030cb None None] MFA Rules not processed for user `951b36037e3a413ba8e43487fce4f651`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:32.119587 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4ec84d54-e509-4c48-a4b4-6c0c0e2030cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:32.147616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1153/2292] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:34.064541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce9f2c-1ca8-4a28-a57e-d2f44fba1543 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:34.084804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce9f2c-1ca8-4a28-a57e-d2f44fba1543 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:34.088968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793da511-45e8-4a7c-90e3-1207d71fc2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:34.089690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793da511-45e8-4a7c-90e3-1207d71fc2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:34.089963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793da511-45e8-4a7c-90e3-1207d71fc2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:34.090265 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793da511-45e8-4a7c-90e3-1207d71fc2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:34.092222 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-793da511-45e8-4a7c-90e3-1207d71fc2f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:34.187566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793da511-45e8-4a7c-90e3-1207d71fc2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:34.188941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793da511-45e8-4a7c-90e3-1207d71fc2f1 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:34.213352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1140/2293] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:33:38.015157 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec84d54-e509-4c48-a4b4-6c0c0e2030cb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:38.054194 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec84d54-e509-4c48-a4b4-6c0c0e2030cb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:38.063789 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4299e7a-ec10-4c99-94ad-40215529885e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2448489cc4ad1a6fd3096ebd3f746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:38.064436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4299e7a-ec10-4c99-94ad-40215529885e service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:38.064745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4299e7a-ec10-4c99-94ad-40215529885e service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:38.064995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4299e7a-ec10-4c99-94ad-40215529885e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:38.066863 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c4299e7a-ec10-4c99-94ad-40215529885e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:38.085174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793da511-45e8-4a7c-90e3-1207d71fc2f1 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:38.086653 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-793da511-45e8-4a7c-90e3-1207d71fc2f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:38.100669 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793da511-45e8-4a7c-90e3-1207d71fc2f1 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:38.105506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4299e7a-ec10-4c99-94ad-40215529885e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:38.106225 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439eb853-b59b-4b53-90b2-50adef9f16e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:38.106978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eb853-b59b-4b53-90b2-50adef9f16e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:38.107193 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4299e7a-ec10-4c99-94ad-40215529885e service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:38.107402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eb853-b59b-4b53-90b2-50adef9f16e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:38.107748 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439eb853-b59b-4b53-90b2-50adef9f16e9 admin admin] PATH_INFO: `/v3/users/ad5781045de04647bd213028d7209fe1` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:38.109162 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439eb853-b59b-4b53-90b2-50adef9f16e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5781045de04647bd213028d7209fe1)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:38.111312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439eb853-b59b-4b53-90b2-50adef9f16e9 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:38.117515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1154/2294] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:33:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:33:38.174116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-439eb853-b59b-4b53-90b2-50adef9f16e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5781045de04647bd213028d7209fe1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:38.182274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-439eb853-b59b-4b53-90b2-50adef9f16e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5781045de04647bd213028d7209fe1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:38.189460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-439eb853-b59b-4b53-90b2-50adef9f16e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5781045de04647bd213028d7209fe1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:38.190086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-439eb853-b59b-4b53-90b2-50adef9f16e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5781045de04647bd213028d7209fe1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:38.204001 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-439eb853-b59b-4b53-90b2-50adef9f16e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5781045de04647bd213028d7209fe1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:38.210597 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1141/2295] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:33:38 2022] DELETE /identity/v3/users/ad5781045de04647bd213028d7209fe1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:38.383460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4299e7a-ec10-4c99-94ad-40215529885e service placement] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:38.396305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4299e7a-ec10-4c99-94ad-40215529885e service placement] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:38.454822 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf80e24-611b-4f54-9c1d-6018198844c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:38.455505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf80e24-611b-4f54-9c1d-6018198844c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:38.455787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf80e24-611b-4f54-9c1d-6018198844c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:38.456059 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf80e24-611b-4f54-9c1d-6018198844c3 admin admin] PATH_INFO: `/v3/projects/a8982f0fbed84453a5266650fa95c61c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:38.457204 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf80e24-611b-4f54-9c1d-6018198844c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8982f0fbed84453a5266650fa95c61c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:38.459762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf80e24-611b-4f54-9c1d-6018198844c3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:38.505772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbf80e24-611b-4f54-9c1d-6018198844c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8982f0fbed84453a5266650fa95c61c', 'request_id': 'req-dbf80e24-611b-4f54-9c1d-6018198844c3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:38.512026 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbf80e24-611b-4f54-9c1d-6018198844c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8982f0fbed84453a5266650fa95c61c', 'request_id': 'req-dbf80e24-611b-4f54-9c1d-6018198844c3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:38.519260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbf80e24-611b-4f54-9c1d-6018198844c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8982f0fbed84453a5266650fa95c61c', 'request_id': 'req-dbf80e24-611b-4f54-9c1d-6018198844c3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:38.529700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbf80e24-611b-4f54-9c1d-6018198844c3 admin admin] The token cache is being invalidate because project a8982f0fbed84453a5266650fa95c61c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:33:38.530022 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbf80e24-611b-4f54-9c1d-6018198844c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:38.530685 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbf80e24-611b-4f54-9c1d-6018198844c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:38.532199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1155/2296] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:33:38 2022] DELETE /identity/v3/projects/a8982f0fbed84453a5266650fa95c61c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:38.537403 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284220a6-9054-4697-8e74-cb8a8b73832d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:38.537693 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284220a6-9054-4697-8e74-cb8a8b73832d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:38.538024 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284220a6-9054-4697-8e74-cb8a8b73832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:38.568908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:38.601488 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-284220a6-9054-4697-8e74-cb8a8b73832d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:38.602719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-284220a6-9054-4697-8e74-cb8a8b73832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:38.659694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1142/2297] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:38.667616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7177a-f358-4631-8ab6-c5ab24bd8560 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:38.667913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7177a-f358-4631-8ab6-c5ab24bd8560 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:38.668196 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7177a-f358-4631-8ab6-c5ab24bd8560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:38.688137 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-dae7177a-f358-4631-8ab6-c5ab24bd8560 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:38.689337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dae7177a-f358-4631-8ab6-c5ab24bd8560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:38.698135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1156/2298] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:38.702439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284220a6-9054-4697-8e74-cb8a8b73832d None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:38.712104 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284220a6-9054-4697-8e74-cb8a8b73832d None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:38.716926 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e3153-112c-46b0-8afa-faf74b68e372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:38.717534 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e3153-112c-46b0-8afa-faf74b68e372 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:38.717815 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e3153-112c-46b0-8afa-faf74b68e372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:38.718090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e3153-112c-46b0-8afa-faf74b68e372 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:38.718847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e3153-112c-46b0-8afa-faf74b68e372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:33:38.719154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e3153-112c-46b0-8afa-faf74b68e372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:38.720739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e3153-112c-46b0-8afa-faf74b68e372 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:38.732199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1143/2299] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:33:38.736511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7177a-f358-4631-8ab6-c5ab24bd8560 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:38.746532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7177a-f358-4631-8ab6-c5ab24bd8560 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:38.751108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09621410-1327-47b9-8db0-491ebb53dda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:38.751763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09621410-1327-47b9-8db0-491ebb53dda9 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:38.752041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09621410-1327-47b9-8db0-491ebb53dda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:38.752315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09621410-1327-47b9-8db0-491ebb53dda9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:38.752971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09621410-1327-47b9-8db0-491ebb53dda9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:38.755462 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09621410-1327-47b9-8db0-491ebb53dda9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:38.764674 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:38.783920 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1157/2300] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:33:38 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:33:38.788055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e3153-112c-46b0-8afa-faf74b68e372 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:38.798163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e3153-112c-46b0-8afa-faf74b68e372 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:38.856490 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eccf9-a386-4a59-909e-055179b69e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:38.857113 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eccf9-a386-4a59-909e-055179b69e4f admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:38.857400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eccf9-a386-4a59-909e-055179b69e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:38.857677 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eccf9-a386-4a59-909e-055179b69e4f admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:38.858345 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551eccf9-a386-4a59-909e-055179b69e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:38.860305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551eccf9-a386-4a59-909e-055179b69e4f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:38.884431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1144/2301] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:33:38 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:33:38.888433 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09621410-1327-47b9-8db0-491ebb53dda9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:38.899347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09621410-1327-47b9-8db0-491ebb53dda9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:38.904322 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f063c1-852f-41d1-b9ee-3b6d3bb02c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:38.904950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f063c1-852f-41d1-b9ee-3b6d3bb02c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:38.905231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f063c1-852f-41d1-b9ee-3b6d3bb02c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:38.905511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f063c1-852f-41d1-b9ee-3b6d3bb02c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:38.906213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f063c1-852f-41d1-b9ee-3b6d3bb02c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:38.907875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f063c1-852f-41d1-b9ee-3b6d3bb02c91 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:38.918726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1158/2302] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:33:38.922837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eccf9-a386-4a59-909e-055179b69e4f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:38.934088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eccf9-a386-4a59-909e-055179b69e4f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:38.939784 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59f4cd-0e0c-4c0f-b4c2-af4c23f15c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:38.940401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59f4cd-0e0c-4c0f-b4c2-af4c23f15c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:38.940690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59f4cd-0e0c-4c0f-b4c2-af4c23f15c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:38.940953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59f4cd-0e0c-4c0f-b4c2-af4c23f15c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:38.941640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59f4cd-0e0c-4c0f-b4c2-af4c23f15c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:38.943899 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59f4cd-0e0c-4c0f-b4c2-af4c23f15c03 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:38.954849 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1145/2303] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:33:38.959282 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f063c1-852f-41d1-b9ee-3b6d3bb02c91 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:38.970339 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f063c1-852f-41d1-b9ee-3b6d3bb02c91 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:38.976426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cc1d9-1990-4ca9-84c9-2dac8a85e0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:38.977174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cc1d9-1990-4ca9-84c9-2dac8a85e0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:38.977456 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cc1d9-1990-4ca9-84c9-2dac8a85e0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:38.977735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cc1d9-1990-4ca9-84c9-2dac8a85e0ee admin admin] PATH_INFO: `/v3/projects/baafe7796e52402891dc59c13b245ab9/users/8aab66694bbe45b18930e0dd6224d2ff/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:38.994132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cc1d9-1990-4ca9-84c9-2dac8a85e0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=baafe7796e52402891dc59c13b245ab9, user_id=8aab66694bbe45b18930e0dd6224d2ff, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:38.996853 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cc1d9-1990-4ca9-84c9-2dac8a85e0ee admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:39.014363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1159/2304] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:33:38 2022] PUT /identity/v3/projects/baafe7796e52402891dc59c13b245ab9/users/8aab66694bbe45b18930e0dd6224d2ff/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:39.021326 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa821-0b24-4432-9e8c-8046a127a817 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:39.021638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa821-0b24-4432-9e8c-8046a127a817 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:39.021911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa821-0b24-4432-9e8c-8046a127a817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:39.049638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-4f5fa821-0b24-4432-9e8c-8046a127a817 None None] MFA Rules not processed for user `8aab66694bbe45b18930e0dd6224d2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:39.050887 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4f5fa821-0b24-4432-9e8c-8046a127a817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:39.094079 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:39.116038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1146/2305] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:39.127068 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cc1d9-1990-4ca9-84c9-2dac8a85e0ee admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:39.128758 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-346cc1d9-1990-4ca9-84c9-2dac8a85e0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:39.235580 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cc1d9-1990-4ca9-84c9-2dac8a85e0ee admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:39.242026 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d3ecb-5c77-4b15-81d8-d396a911d4f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:39.242666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d3ecb-5c77-4b15-81d8-d396a911d4f9 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:39.242952 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d3ecb-5c77-4b15-81d8-d396a911d4f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:39.243231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d3ecb-5c77-4b15-81d8-d396a911d4f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:39.250895 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d3ecb-5c77-4b15-81d8-d396a911d4f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:39.252579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d3ecb-5c77-4b15-81d8-d396a911d4f9 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:39.261863 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1160/2306] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:33:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:33:44.436736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fa821-0b24-4432-9e8c-8046a127a817 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:44.497646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fa821-0b24-4432-9e8c-8046a127a817 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:44.502523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93054e-e9a5-4e39-bf2c-931753d0596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:44.503154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93054e-e9a5-4e39-bf2c-931753d0596f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:44.503435 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93054e-e9a5-4e39-bf2c-931753d0596f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:44.503704 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93054e-e9a5-4e39-bf2c-931753d0596f admin admin] PATH_INFO: `/v3/users/8aab66694bbe45b18930e0dd6224d2ff` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:44.504868 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93054e-e9a5-4e39-bf2c-931753d0596f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aab66694bbe45b18930e0dd6224d2ff)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:44.506822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93054e-e9a5-4e39-bf2c-931753d0596f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:44.551489 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4b93054e-e9a5-4e39-bf2c-931753d0596f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aab66694bbe45b18930e0dd6224d2ff'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:44.558225 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4b93054e-e9a5-4e39-bf2c-931753d0596f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aab66694bbe45b18930e0dd6224d2ff'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:44.564935 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4b93054e-e9a5-4e39-bf2c-931753d0596f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aab66694bbe45b18930e0dd6224d2ff'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:44.565554 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4b93054e-e9a5-4e39-bf2c-931753d0596f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aab66694bbe45b18930e0dd6224d2ff'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:44.576986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4b93054e-e9a5-4e39-bf2c-931753d0596f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aab66694bbe45b18930e0dd6224d2ff'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:44.583327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1147/2307] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:33:44 2022] DELETE /identity/v3/users/8aab66694bbe45b18930e0dd6224d2ff => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:44.587885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e707-7fc6-4bfa-9db2-f0b859ec3dab None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:44.588654 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e707-7fc6-4bfa-9db2-f0b859ec3dab None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:44.588758 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e707-7fc6-4bfa-9db2-f0b859ec3dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:44.607917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cbd9e707-7fc6-4bfa-9db2-f0b859ec3dab None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:44.609119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cbd9e707-7fc6-4bfa-9db2-f0b859ec3dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:44.667086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1161/2308] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:44.676899 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93054e-e9a5-4e39-bf2c-931753d0596f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:44.678284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4b93054e-e9a5-4e39-bf2c-931753d0596f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:44.748623 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:44.757405 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93054e-e9a5-4e39-bf2c-931753d0596f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:44.762336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32479f-0349-4057-aa85-965463ff5ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:44.763055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32479f-0349-4057-aa85-965463ff5ddd service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:44.763343 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32479f-0349-4057-aa85-965463ff5ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:44.763679 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32479f-0349-4057-aa85-965463ff5ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:44.773541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32479f-0349-4057-aa85-965463ff5ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:44.775003 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32479f-0349-4057-aa85-965463ff5ddd service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:44.784674 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1148/2309] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:33:45.061231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9e707-7fc6-4bfa-9db2-f0b859ec3dab None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:45.062838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cbd9e707-7fc6-4bfa-9db2-f0b859ec3dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:45.075737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9e707-7fc6-4bfa-9db2-f0b859ec3dab None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:45.080302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb91df-170b-4b5a-9eab-a70ca9fd2356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:45.080955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb91df-170b-4b5a-9eab-a70ca9fd2356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:45.081227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb91df-170b-4b5a-9eab-a70ca9fd2356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:45.081503 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb91df-170b-4b5a-9eab-a70ca9fd2356 admin admin] PATH_INFO: `/v3/projects/baafe7796e52402891dc59c13b245ab9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:45.083306 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb91df-170b-4b5a-9eab-a70ca9fd2356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baafe7796e52402891dc59c13b245ab9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:45.085190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb91df-170b-4b5a-9eab-a70ca9fd2356 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:45.093958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:45.134376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-52eb91df-170b-4b5a-9eab-a70ca9fd2356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baafe7796e52402891dc59c13b245ab9', 'request_id': 'req-52eb91df-170b-4b5a-9eab-a70ca9fd2356'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:45.140753 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-52eb91df-170b-4b5a-9eab-a70ca9fd2356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baafe7796e52402891dc59c13b245ab9', 'request_id': 'req-52eb91df-170b-4b5a-9eab-a70ca9fd2356'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:45.148762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-52eb91df-170b-4b5a-9eab-a70ca9fd2356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baafe7796e52402891dc59c13b245ab9', 'request_id': 'req-52eb91df-170b-4b5a-9eab-a70ca9fd2356'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:45.159087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-52eb91df-170b-4b5a-9eab-a70ca9fd2356 admin admin] The token cache is being invalidate because project baafe7796e52402891dc59c13b245ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:33:45.159378 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-52eb91df-170b-4b5a-9eab-a70ca9fd2356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:45.159998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-52eb91df-170b-4b5a-9eab-a70ca9fd2356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:45.161531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1162/2310] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:33:45 2022] DELETE /identity/v3/projects/baafe7796e52402891dc59c13b245ab9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:45.166498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a5fe0-72bf-4557-8f61-866a63025fc8 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:45.166789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a5fe0-72bf-4557-8f61-866a63025fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:45.167066 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a5fe0-72bf-4557-8f61-866a63025fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:45.186209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-9c0a5fe0-72bf-4557-8f61-866a63025fc8 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:45.187422 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9c0a5fe0-72bf-4557-8f61-866a63025fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:45.247070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1149/2311] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:45.255550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59c04b-ec84-44bf-875f-7657f23ae394 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:45.255836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59c04b-ec84-44bf-875f-7657f23ae394 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:45.256110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59c04b-ec84-44bf-875f-7657f23ae394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:45.276313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-da59c04b-ec84-44bf-875f-7657f23ae394 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:45.277556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-da59c04b-ec84-44bf-875f-7657f23ae394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:45.290701 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1163/2312] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:45.296139 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a5fe0-72bf-4557-8f61-866a63025fc8 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:45.305954 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a5fe0-72bf-4557-8f61-866a63025fc8 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:45.310750 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c3b63-df4c-4440-afcf-c6e31cfde31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:45.311364 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c3b63-df4c-4440-afcf-c6e31cfde31d admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:45.311646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c3b63-df4c-4440-afcf-c6e31cfde31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:45.311921 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c3b63-df4c-4440-afcf-c6e31cfde31d admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:45.312615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c3b63-df4c-4440-afcf-c6e31cfde31d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:33:45.312922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c3b63-df4c-4440-afcf-c6e31cfde31d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:45.314587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c3b63-df4c-4440-afcf-c6e31cfde31d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:45.327203 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1150/2313] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:33:45.331523 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59c04b-ec84-44bf-875f-7657f23ae394 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:45.341556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59c04b-ec84-44bf-875f-7657f23ae394 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:45.346179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87289589-7bc3-430b-9952-46f39cc371be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:45.346833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87289589-7bc3-430b-9952-46f39cc371be admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:45.347109 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87289589-7bc3-430b-9952-46f39cc371be admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:45.347381 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87289589-7bc3-430b-9952-46f39cc371be admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:45.348050 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87289589-7bc3-430b-9952-46f39cc371be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:45.350615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87289589-7bc3-430b-9952-46f39cc371be admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:45.378025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1164/2314] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:33:45 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:33:45.381450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c3b63-df4c-4440-afcf-c6e31cfde31d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:45.391329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c3b63-df4c-4440-afcf-c6e31cfde31d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:45.449112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26d108-8d2c-43c5-befd-ec040d3cbde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:45.450030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26d108-8d2c-43c5-befd-ec040d3cbde3 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:45.450030 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26d108-8d2c-43c5-befd-ec040d3cbde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:45.450342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26d108-8d2c-43c5-befd-ec040d3cbde3 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:45.450940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26d108-8d2c-43c5-befd-ec040d3cbde3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:45.452825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26d108-8d2c-43c5-befd-ec040d3cbde3 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:45.475609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1151/2315] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:33:45 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:33:45.479786 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87289589-7bc3-430b-9952-46f39cc371be admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:45.491002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87289589-7bc3-430b-9952-46f39cc371be admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:45.495796 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d004bd-4a66-4d35-b52b-b2235b120469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:45.496411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d004bd-4a66-4d35-b52b-b2235b120469 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:45.496694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d004bd-4a66-4d35-b52b-b2235b120469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:45.496967 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d004bd-4a66-4d35-b52b-b2235b120469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:45.497797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d004bd-4a66-4d35-b52b-b2235b120469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:45.499438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d004bd-4a66-4d35-b52b-b2235b120469 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:45.509575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1165/2316] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:33:45.513645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26d108-8d2c-43c5-befd-ec040d3cbde3 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:45.524193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26d108-8d2c-43c5-befd-ec040d3cbde3 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:45.528829 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5836c1f-b525-4ee3-a542-550cc92fd49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:45.529438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5836c1f-b525-4ee3-a542-550cc92fd49d admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:45.529722 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5836c1f-b525-4ee3-a542-550cc92fd49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:45.530006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5836c1f-b525-4ee3-a542-550cc92fd49d admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:45.530762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5836c1f-b525-4ee3-a542-550cc92fd49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:45.532347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5836c1f-b525-4ee3-a542-550cc92fd49d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:45.543374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1152/2317] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:33:45.547625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d004bd-4a66-4d35-b52b-b2235b120469 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:45.557987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d004bd-4a66-4d35-b52b-b2235b120469 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:45.562922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f7cb1-daae-4b87-9cc5-ea61af9f2d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:45.563574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f7cb1-daae-4b87-9cc5-ea61af9f2d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:45.563859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f7cb1-daae-4b87-9cc5-ea61af9f2d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:45.564135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f7cb1-daae-4b87-9cc5-ea61af9f2d55 admin admin] PATH_INFO: `/v3/projects/9c6c9ea488534f42b5746e1189de60e8/users/46765b5f10a04ce7b97a608360d65715/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:45.579333 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f7cb1-daae-4b87-9cc5-ea61af9f2d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6c9ea488534f42b5746e1189de60e8, user_id=46765b5f10a04ce7b97a608360d65715, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:45.581939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f7cb1-daae-4b87-9cc5-ea61af9f2d55 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:45.595992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1166/2318] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:33:45 2022] PUT /identity/v3/projects/9c6c9ea488534f42b5746e1189de60e8/users/46765b5f10a04ce7b97a608360d65715/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:45.606723 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078012ea-5204-4d57-b59b-af60323cf560 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:45.607012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078012ea-5204-4d57-b59b-af60323cf560 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:45.607291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078012ea-5204-4d57-b59b-af60323cf560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:45.639468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-078012ea-5204-4d57-b59b-af60323cf560 None None] MFA Rules not processed for user `46765b5f10a04ce7b97a608360d65715`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:45.640698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-078012ea-5204-4d57-b59b-af60323cf560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:45.687742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:45.711560 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1153/2319] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:45.716465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f7cb1-daae-4b87-9cc5-ea61af9f2d55 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:45.777703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f7cb1-daae-4b87-9cc5-ea61af9f2d55 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:45.782344 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27c13a-5f48-411f-8fa2-3624ea424507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:45.782992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27c13a-5f48-411f-8fa2-3624ea424507 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:45.783278 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27c13a-5f48-411f-8fa2-3624ea424507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:45.783557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27c13a-5f48-411f-8fa2-3624ea424507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:45.784228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27c13a-5f48-411f-8fa2-3624ea424507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:45.786130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27c13a-5f48-411f-8fa2-3624ea424507 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:45.814239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1167/2320] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:33:45 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:33:45.819397 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078012ea-5204-4d57-b59b-af60323cf560 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:45.831371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078012ea-5204-4d57-b59b-af60323cf560 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:45.886558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faea87-1421-41ed-a06f-3608479949d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:45.887174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faea87-1421-41ed-a06f-3608479949d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:45.887465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faea87-1421-41ed-a06f-3608479949d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:45.887745 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faea87-1421-41ed-a06f-3608479949d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:45.888408 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23faea87-1421-41ed-a06f-3608479949d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:45.890324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23faea87-1421-41ed-a06f-3608479949d2 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:45.912634 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1154/2321] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:33:45 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:33:45.916694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27c13a-5f48-411f-8fa2-3624ea424507 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:45.927498 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27c13a-5f48-411f-8fa2-3624ea424507 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:45.933121 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2846e-1896-47da-89a5-cdb46706c9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:45.933750 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2846e-1896-47da-89a5-cdb46706c9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:45.934099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2846e-1896-47da-89a5-cdb46706c9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:45.934380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2846e-1896-47da-89a5-cdb46706c9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:45.935119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2846e-1896-47da-89a5-cdb46706c9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:45.936733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2846e-1896-47da-89a5-cdb46706c9a9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:45.950355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1168/2322] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:33:45.954614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faea87-1421-41ed-a06f-3608479949d2 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:45.966513 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faea87-1421-41ed-a06f-3608479949d2 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:45.971487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eabf9-0612-4dd2-8bbf-5db7ccb97df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:45.972158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eabf9-0612-4dd2-8bbf-5db7ccb97df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:45.972440 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eabf9-0612-4dd2-8bbf-5db7ccb97df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:45.972706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eabf9-0612-4dd2-8bbf-5db7ccb97df6 admin admin] PATH_INFO: `/v3/projects/c66cec3fe8274259a6e291295dfaee53/users/4f9b93854d844439b0f6f015c7f3839f/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:45.988917 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04eabf9-0612-4dd2-8bbf-5db7ccb97df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66cec3fe8274259a6e291295dfaee53, user_id=4f9b93854d844439b0f6f015c7f3839f, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:45.992228 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04eabf9-0612-4dd2-8bbf-5db7ccb97df6 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:46.007825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1155/2323] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:33:45 2022] PUT /identity/v3/projects/c66cec3fe8274259a6e291295dfaee53/users/4f9b93854d844439b0f6f015c7f3839f/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:33:46.011908 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2846e-1896-47da-89a5-cdb46706c9a9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:46.022336 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2846e-1896-47da-89a5-cdb46706c9a9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:46.026089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:46.084503 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276309b2-6ead-4cf2-ad66-7eb505b76244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:46.085054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276309b2-6ead-4cf2-ad66-7eb505b76244 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:46.085344 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276309b2-6ead-4cf2-ad66-7eb505b76244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:46.085607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276309b2-6ead-4cf2-ad66-7eb505b76244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:46.086288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276309b2-6ead-4cf2-ad66-7eb505b76244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:46.087896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276309b2-6ead-4cf2-ad66-7eb505b76244 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:46.097862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1169/2324] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:33:46.101963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eabf9-0612-4dd2-8bbf-5db7ccb97df6 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:46.112099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eabf9-0612-4dd2-8bbf-5db7ccb97df6 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:46.117327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50280aa-cfa9-4567-806a-939cb0477b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:46.117986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50280aa-cfa9-4567-806a-939cb0477b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:46.118268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50280aa-cfa9-4567-806a-939cb0477b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:46.118587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50280aa-cfa9-4567-806a-939cb0477b32 admin admin] PATH_INFO: `/v3/projects/c66cec3fe8274259a6e291295dfaee53/users/4f9b93854d844439b0f6f015c7f3839f/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:46.120522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50280aa-cfa9-4567-806a-939cb0477b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66cec3fe8274259a6e291295dfaee53, user_id=4f9b93854d844439b0f6f015c7f3839f, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:46.123196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50280aa-cfa9-4567-806a-939cb0477b32 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:46.134158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1156/2325] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:33:46 2022] PUT /identity/v3/projects/c66cec3fe8274259a6e291295dfaee53/users/4f9b93854d844439b0f6f015c7f3839f/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:46.145547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778d299-cd82-4bd2-9830-9eb6bbfc4f37 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:46.145838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778d299-cd82-4bd2-9830-9eb6bbfc4f37 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:46.146180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778d299-cd82-4bd2-9830-9eb6bbfc4f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:46.173593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5778d299-cd82-4bd2-9830-9eb6bbfc4f37 None None] MFA Rules not processed for user `4f9b93854d844439b0f6f015c7f3839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:46.174853 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5778d299-cd82-4bd2-9830-9eb6bbfc4f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:46.242639 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1170/2326] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:46.253999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50280aa-cfa9-4567-806a-939cb0477b32 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:46.255740 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f50280aa-cfa9-4567-806a-939cb0477b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:46.333504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50280aa-cfa9-4567-806a-939cb0477b32 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:46.337606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d09557-f2ab-4340-b16e-7619c93eb7dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:46.338502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d09557-f2ab-4340-b16e-7619c93eb7dc service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:46.338811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d09557-f2ab-4340-b16e-7619c93eb7dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:46.339091 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d09557-f2ab-4340-b16e-7619c93eb7dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:46.350366 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d09557-f2ab-4340-b16e-7619c93eb7dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:46.351830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d09557-f2ab-4340-b16e-7619c93eb7dc service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:46.362210 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1157/2327] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:33:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:33:46.774788 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778d299-cd82-4bd2-9830-9eb6bbfc4f37 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:46.837489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778d299-cd82-4bd2-9830-9eb6bbfc4f37 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:46.842507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c617de-a710-4ad5-b141-eef37e2bc847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:46.843101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c617de-a710-4ad5-b141-eef37e2bc847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:46.843379 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c617de-a710-4ad5-b141-eef37e2bc847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:46.843675 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c617de-a710-4ad5-b141-eef37e2bc847 admin admin] PATH_INFO: `/v3/users/46765b5f10a04ce7b97a608360d65715` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:46.845067 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c617de-a710-4ad5-b141-eef37e2bc847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46765b5f10a04ce7b97a608360d65715)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:46.847084 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c617de-a710-4ad5-b141-eef37e2bc847 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:46.879515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:46.892930 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-66c617de-a710-4ad5-b141-eef37e2bc847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46765b5f10a04ce7b97a608360d65715'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:46.900660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-66c617de-a710-4ad5-b141-eef37e2bc847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46765b5f10a04ce7b97a608360d65715'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:46.913161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-66c617de-a710-4ad5-b141-eef37e2bc847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46765b5f10a04ce7b97a608360d65715'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:46.913791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-66c617de-a710-4ad5-b141-eef37e2bc847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46765b5f10a04ce7b97a608360d65715'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:46.920522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-66c617de-a710-4ad5-b141-eef37e2bc847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46765b5f10a04ce7b97a608360d65715'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:46.926311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1171/2328] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:33:46 2022] DELETE /identity/v3/users/46765b5f10a04ce7b97a608360d65715 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:46.930850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf4e03-0926-4415-995c-ea972e53d7d0 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:46.931307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf4e03-0926-4415-995c-ea972e53d7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:46.931425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf4e03-0926-4415-995c-ea972e53d7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:46.949771 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5fbf4e03-0926-4415-995c-ea972e53d7d0 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:46.950986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5fbf4e03-0926-4415-995c-ea972e53d7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:46.963056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:47.010793 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1158/2329] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:47.020426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c617de-a710-4ad5-b141-eef37e2bc847 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:47.022432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-66c617de-a710-4ad5-b141-eef37e2bc847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:47.079215 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c617de-a710-4ad5-b141-eef37e2bc847 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:47.083146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08358450-5e99-4fdb-b447-9abffc35bcbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:47.083766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358450-5e99-4fdb-b447-9abffc35bcbf service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:47.084618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358450-5e99-4fdb-b447-9abffc35bcbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:47.084880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358450-5e99-4fdb-b447-9abffc35bcbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:47.094686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08358450-5e99-4fdb-b447-9abffc35bcbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:47.096192 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08358450-5e99-4fdb-b447-9abffc35bcbf service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:47.106209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1172/2330] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:33:47.465718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf4e03-0926-4415-995c-ea972e53d7d0 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:47.466345 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5fbf4e03-0926-4415-995c-ea972e53d7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:47.479153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf4e03-0926-4415-995c-ea972e53d7d0 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:47.484034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:47.484760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:47.486450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:47.486450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] PATH_INFO: `/v3/projects/9c6c9ea488534f42b5746e1189de60e8` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:47.486647 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6c9ea488534f42b5746e1189de60e8)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:47.488876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:47.541669 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6c9ea488534f42b5746e1189de60e8', 'request_id': 'req-269bda41-3ac2-4f44-ba3f-658403010007'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:47.548963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6c9ea488534f42b5746e1189de60e8', 'request_id': 'req-269bda41-3ac2-4f44-ba3f-658403010007'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:47.555313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6c9ea488534f42b5746e1189de60e8', 'request_id': 'req-269bda41-3ac2-4f44-ba3f-658403010007'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:47.567324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] The token cache is being invalidate because project 9c6c9ea488534f42b5746e1189de60e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:33:47.567613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:47.568273 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:47.570347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1159/2331] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:33:47 2022] DELETE /identity/v3/projects/9c6c9ea488534f42b5746e1189de60e8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:47.574296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08358450-5e99-4fdb-b447-9abffc35bcbf service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:47.584133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08358450-5e99-4fdb-b447-9abffc35bcbf service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:47.640346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b94ab-87f6-43a7-ab39-7cd5e68d47e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:47.641023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b94ab-87f6-43a7-ab39-7cd5e68d47e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:47.641305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b94ab-87f6-43a7-ab39-7cd5e68d47e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:47.641615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b94ab-87f6-43a7-ab39-7cd5e68d47e2 admin admin] PATH_INFO: `/v3/users/4f9b93854d844439b0f6f015c7f3839f` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:47.642809 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b94ab-87f6-43a7-ab39-7cd5e68d47e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9b93854d844439b0f6f015c7f3839f)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:47.644751 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b94ab-87f6-43a7-ab39-7cd5e68d47e2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:47.691794 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e15b94ab-87f6-43a7-ab39-7cd5e68d47e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9b93854d844439b0f6f015c7f3839f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:47.696405 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:47.700699 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e15b94ab-87f6-43a7-ab39-7cd5e68d47e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9b93854d844439b0f6f015c7f3839f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:47.718121 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e15b94ab-87f6-43a7-ab39-7cd5e68d47e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9b93854d844439b0f6f015c7f3839f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:47.718780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e15b94ab-87f6-43a7-ab39-7cd5e68d47e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9b93854d844439b0f6f015c7f3839f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:47.725937 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e15b94ab-87f6-43a7-ab39-7cd5e68d47e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9b93854d844439b0f6f015c7f3839f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:47.731853 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1173/2332] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:33:47 2022] DELETE /identity/v3/users/4f9b93854d844439b0f6f015c7f3839f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:48.016314 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:48.018527 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:48.034180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bda41-3ac2-4f44-ba3f-658403010007 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:48.097548 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee163ef5-fd8a-4168-9b92-c75147e49d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:48.098324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee163ef5-fd8a-4168-9b92-c75147e49d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:48.098642 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee163ef5-fd8a-4168-9b92-c75147e49d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:48.098921 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee163ef5-fd8a-4168-9b92-c75147e49d03 admin admin] PATH_INFO: `/v3/projects/c66cec3fe8274259a6e291295dfaee53` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:48.101770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee163ef5-fd8a-4168-9b92-c75147e49d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c66cec3fe8274259a6e291295dfaee53)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:48.103736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee163ef5-fd8a-4168-9b92-c75147e49d03 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:48.149128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:48.153954 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ee163ef5-fd8a-4168-9b92-c75147e49d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c66cec3fe8274259a6e291295dfaee53', 'request_id': 'req-ee163ef5-fd8a-4168-9b92-c75147e49d03'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:48.163797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ee163ef5-fd8a-4168-9b92-c75147e49d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c66cec3fe8274259a6e291295dfaee53', 'request_id': 'req-ee163ef5-fd8a-4168-9b92-c75147e49d03'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:48.170235 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ee163ef5-fd8a-4168-9b92-c75147e49d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c66cec3fe8274259a6e291295dfaee53', 'request_id': 'req-ee163ef5-fd8a-4168-9b92-c75147e49d03'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:48.181905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ee163ef5-fd8a-4168-9b92-c75147e49d03 admin admin] The token cache is being invalidate because project c66cec3fe8274259a6e291295dfaee53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:33:48.182194 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ee163ef5-fd8a-4168-9b92-c75147e49d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:48.182864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ee163ef5-fd8a-4168-9b92-c75147e49d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:48.184382 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1160/2333] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:33:48 2022] DELETE /identity/v3/projects/c66cec3fe8274259a6e291295dfaee53 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:48.189367 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b9c89-69c2-4865-85d8-44ba6343ba83 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:48.189876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b9c89-69c2-4865-85d8-44ba6343ba83 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:48.189973 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b9c89-69c2-4865-85d8-44ba6343ba83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:48.209992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-234b9c89-69c2-4865-85d8-44ba6343ba83 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:48.211259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-234b9c89-69c2-4865-85d8-44ba6343ba83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:48.273579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1174/2334] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:48.281556 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12ec8-998f-4aae-9519-3339e6f376ed None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:48.281852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12ec8-998f-4aae-9519-3339e6f376ed None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:48.282164 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12ec8-998f-4aae-9519-3339e6f376ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:48.303080 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b2b12ec8-998f-4aae-9519-3339e6f376ed None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:48.304301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b2b12ec8-998f-4aae-9519-3339e6f376ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:48.312332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1161/2335] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:48.316897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b9c89-69c2-4865-85d8-44ba6343ba83 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:48.328001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b9c89-69c2-4865-85d8-44ba6343ba83 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:48.334867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ebc25-4c76-410a-a881-f6ed8f11596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:48.335258 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ebc25-4c76-410a-a881-f6ed8f11596a admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:48.335604 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ebc25-4c76-410a-a881-f6ed8f11596a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:48.335945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ebc25-4c76-410a-a881-f6ed8f11596a admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:48.336724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ebc25-4c76-410a-a881-f6ed8f11596a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:33:48.337117 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ebc25-4c76-410a-a881-f6ed8f11596a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:48.339120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ebc25-4c76-410a-a881-f6ed8f11596a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:48.360108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b12ec8-998f-4aae-9519-3339e6f376ed None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:48.366540 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1175/2336] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:33:48.370559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b12ec8-998f-4aae-9519-3339e6f376ed None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:48.375516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc36500-08d8-4a92-b79a-90240e6f2194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:48.376147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc36500-08d8-4a92-b79a-90240e6f2194 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:48.376561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc36500-08d8-4a92-b79a-90240e6f2194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:48.377025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc36500-08d8-4a92-b79a-90240e6f2194 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:48.377780 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc36500-08d8-4a92-b79a-90240e6f2194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:48.379837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc36500-08d8-4a92-b79a-90240e6f2194 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:48.419911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1162/2337] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:33:48 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:33:48.424013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ebc25-4c76-410a-a881-f6ed8f11596a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:48.434038 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ebc25-4c76-410a-a881-f6ed8f11596a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:48.532717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159e4a9-dfb7-4759-afb4-9e6c1b8220a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:48.533398 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159e4a9-dfb7-4759-afb4-9e6c1b8220a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:48.533753 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159e4a9-dfb7-4759-afb4-9e6c1b8220a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:48.534107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159e4a9-dfb7-4759-afb4-9e6c1b8220a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:48.535056 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159e4a9-dfb7-4759-afb4-9e6c1b8220a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:48.537945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159e4a9-dfb7-4759-afb4-9e6c1b8220a8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:48.567731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1176/2338] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:33:48 2022] POST /identity/v3/users => generated 282 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:33:48.572353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc36500-08d8-4a92-b79a-90240e6f2194 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:48.588411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc36500-08d8-4a92-b79a-90240e6f2194 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:48.596900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b00722-8ce6-478e-ad51-e86b70aa925d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:48.597940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b00722-8ce6-478e-ad51-e86b70aa925d admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:48.598437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b00722-8ce6-478e-ad51-e86b70aa925d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:48.598975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b00722-8ce6-478e-ad51-e86b70aa925d admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:48.600924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b00722-8ce6-478e-ad51-e86b70aa925d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:48.602682 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b00722-8ce6-478e-ad51-e86b70aa925d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:48.615772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1163/2339] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:33:48.619321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159e4a9-dfb7-4759-afb4-9e6c1b8220a8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:48.632269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159e4a9-dfb7-4759-afb4-9e6c1b8220a8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:48.641933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4953c-80d7-4624-97ad-af26ed838c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:48.643265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4953c-80d7-4624-97ad-af26ed838c4b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:48.643558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4953c-80d7-4624-97ad-af26ed838c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:48.643839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4953c-80d7-4624-97ad-af26ed838c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:48.644680 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4953c-80d7-4624-97ad-af26ed838c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:48.647306 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4953c-80d7-4624-97ad-af26ed838c4b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:48.666934 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b00722-8ce6-478e-ad51-e86b70aa925d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:48.667627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1177/2340] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:33:48.680838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b00722-8ce6-478e-ad51-e86b70aa925d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:48.687840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57573109-85f2-4e9d-81c4-c06ab42e3b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:48.689178 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57573109-85f2-4e9d-81c4-c06ab42e3b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:48.689958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57573109-85f2-4e9d-81c4-c06ab42e3b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:48.690311 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57573109-85f2-4e9d-81c4-c06ab42e3b03 admin admin] PATH_INFO: `/v3/projects/e22fe43236f74b82bce15882f3ab36ed/users/c4ad021541af49f38100ca8f2f21d84e/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:48.712190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57573109-85f2-4e9d-81c4-c06ab42e3b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e22fe43236f74b82bce15882f3ab36ed, user_id=c4ad021541af49f38100ca8f2f21d84e, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:48.715904 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57573109-85f2-4e9d-81c4-c06ab42e3b03 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:48.746712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1164/2341] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:33:48 2022] PUT /identity/v3/projects/e22fe43236f74b82bce15882f3ab36ed/users/c4ad021541af49f38100ca8f2f21d84e/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:48.757269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98d541-5ea5-4cb6-8b4e-35bc4370c22c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:48.757651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98d541-5ea5-4cb6-8b4e-35bc4370c22c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:48.758005 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98d541-5ea5-4cb6-8b4e-35bc4370c22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:48.789449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ce98d541-5ea5-4cb6-8b4e-35bc4370c22c None None] MFA Rules not processed for user `c4ad021541af49f38100ca8f2f21d84e`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:48.790725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ce98d541-5ea5-4cb6-8b4e-35bc4370c22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:48.831541 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:48.870148 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1178/2342] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:48.874678 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57573109-85f2-4e9d-81c4-c06ab42e3b03 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:48.939817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57573109-85f2-4e9d-81c4-c06ab42e3b03 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:48.945426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01196b08-2c46-42c2-bdca-34125b5dda25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:48.946046 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01196b08-2c46-42c2-bdca-34125b5dda25 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:48.946327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01196b08-2c46-42c2-bdca-34125b5dda25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:48.946633 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01196b08-2c46-42c2-bdca-34125b5dda25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:48.947312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01196b08-2c46-42c2-bdca-34125b5dda25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:48.949213 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01196b08-2c46-42c2-bdca-34125b5dda25 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:48.980756 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1165/2343] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:33:48 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:33:48.984990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98d541-5ea5-4cb6-8b4e-35bc4370c22c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:48.997076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98d541-5ea5-4cb6-8b4e-35bc4370c22c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:49.058324 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8bba3-5052-4b14-8eb4-9326050a60ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:49.058894 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8bba3-5052-4b14-8eb4-9326050a60ac admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:49.059325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8bba3-5052-4b14-8eb4-9326050a60ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:49.059650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8bba3-5052-4b14-8eb4-9326050a60ac admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:49.060343 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8bba3-5052-4b14-8eb4-9326050a60ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:49.062963 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8bba3-5052-4b14-8eb4-9326050a60ac admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:49.087596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1179/2344] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:33:48 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:33:49.091866 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01196b08-2c46-42c2-bdca-34125b5dda25 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:49.103189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01196b08-2c46-42c2-bdca-34125b5dda25 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:49.107960 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed871f13-1c98-46db-b645-5198c4210d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:49.108583 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed871f13-1c98-46db-b645-5198c4210d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:49.108880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed871f13-1c98-46db-b645-5198c4210d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:49.109157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed871f13-1c98-46db-b645-5198c4210d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:49.109856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed871f13-1c98-46db-b645-5198c4210d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:49.111648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed871f13-1c98-46db-b645-5198c4210d17 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:49.131953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1166/2345] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:33:49.136766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8bba3-5052-4b14-8eb4-9326050a60ac admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:49.148199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8bba3-5052-4b14-8eb4-9326050a60ac admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:49.152978 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809ea3e-f96a-4d94-bb74-90badb2aa498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:49.153649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ea3e-f96a-4d94-bb74-90badb2aa498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:49.153934 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ea3e-f96a-4d94-bb74-90badb2aa498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:49.154212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ea3e-f96a-4d94-bb74-90badb2aa498 admin admin] PATH_INFO: `/v3/projects/8b975963254d43e6ab8dcb58c99ae8bd/users/589b6294d1864326bb9de198f27e4202/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:49.171123 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809ea3e-f96a-4d94-bb74-90badb2aa498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b975963254d43e6ab8dcb58c99ae8bd, user_id=589b6294d1864326bb9de198f27e4202, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:49.173802 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809ea3e-f96a-4d94-bb74-90badb2aa498 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:49.188168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1180/2346] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:33:49 2022] PUT /identity/v3/projects/8b975963254d43e6ab8dcb58c99ae8bd/users/589b6294d1864326bb9de198f27e4202/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:49.192245 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed871f13-1c98-46db-b645-5198c4210d17 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:49.203487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed871f13-1c98-46db-b645-5198c4210d17 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:49.245387 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:49.265446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bf01e-e862-4074-9274-d7fec65e6fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:49.266066 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bf01e-e862-4074-9274-d7fec65e6fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:49.266344 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bf01e-e862-4074-9274-d7fec65e6fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:49.266695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bf01e-e862-4074-9274-d7fec65e6fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:49.267414 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bf01e-e862-4074-9274-d7fec65e6fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:49.269021 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bf01e-e862-4074-9274-d7fec65e6fb8 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:49.282586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1167/2347] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:33:49.283557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809ea3e-f96a-4d94-bb74-90badb2aa498 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:49.294568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809ea3e-f96a-4d94-bb74-90badb2aa498 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:49.299400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a9bfb-fe6e-4b1c-9cec-d83ef1fc258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:49.300076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a9bfb-fe6e-4b1c-9cec-d83ef1fc258b admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:49.300355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a9bfb-fe6e-4b1c-9cec-d83ef1fc258b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:49.300630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a9bfb-fe6e-4b1c-9cec-d83ef1fc258b admin admin] PATH_INFO: `/v3/projects/8b975963254d43e6ab8dcb58c99ae8bd/users/589b6294d1864326bb9de198f27e4202/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:49.302610 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a9bfb-fe6e-4b1c-9cec-d83ef1fc258b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b975963254d43e6ab8dcb58c99ae8bd, user_id=589b6294d1864326bb9de198f27e4202, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:49.305819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a9bfb-fe6e-4b1c-9cec-d83ef1fc258b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:49.317042 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1181/2348] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:33:49 2022] PUT /identity/v3/projects/8b975963254d43e6ab8dcb58c99ae8bd/users/589b6294d1864326bb9de198f27e4202/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:33:49.329164 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f652d33-5aa4-4c8c-afed-890702629b08 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:49.329452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f652d33-5aa4-4c8c-afed-890702629b08 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:49.329731 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f652d33-5aa4-4c8c-afed-890702629b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:49.359786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-7f652d33-5aa4-4c8c-afed-890702629b08 None None] MFA Rules not processed for user `589b6294d1864326bb9de198f27e4202`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:49.361059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7f652d33-5aa4-4c8c-afed-890702629b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:49.434219 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1168/2349] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:33:49.445687 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a9bfb-fe6e-4b1c-9cec-d83ef1fc258b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:49.447478 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-526a9bfb-fe6e-4b1c-9cec-d83ef1fc258b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:49.507827 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a9bfb-fe6e-4b1c-9cec-d83ef1fc258b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:49.511507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2365a-dc59-49b7-bb6f-361ba4aa73aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:49.512125 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2365a-dc59-49b7-bb6f-361ba4aa73aa service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:49.512404 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2365a-dc59-49b7-bb6f-361ba4aa73aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:49.512675 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2365a-dc59-49b7-bb6f-361ba4aa73aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:49.521978 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2365a-dc59-49b7-bb6f-361ba4aa73aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:49.523598 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2365a-dc59-49b7-bb6f-361ba4aa73aa service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:49.533792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1182/2350] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:33:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:33:49.611053 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f652d33-5aa4-4c8c-afed-890702629b08 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:49.621383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f652d33-5aa4-4c8c-afed-890702629b08 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:49.625009 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e67a6-77af-4dd0-8494-2ad1e75e9f7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:49.625624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e67a6-77af-4dd0-8494-2ad1e75e9f7b service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:49.625909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e67a6-77af-4dd0-8494-2ad1e75e9f7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:49.626181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e67a6-77af-4dd0-8494-2ad1e75e9f7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:49.683616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e67a6-77af-4dd0-8494-2ad1e75e9f7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:49.685039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e67a6-77af-4dd0-8494-2ad1e75e9f7b service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:49.694331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1169/2351] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:33:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:33:52.405142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2365a-dc59-49b7-bb6f-361ba4aa73aa service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:52.425281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:52.468239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2365a-dc59-49b7-bb6f-361ba4aa73aa service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:52.472663 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32801237-7bb7-45fc-a317-38bae5a9f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:52.473298 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32801237-7bb7-45fc-a317-38bae5a9f244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:52.473576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32801237-7bb7-45fc-a317-38bae5a9f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:52.473847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32801237-7bb7-45fc-a317-38bae5a9f244 admin admin] PATH_INFO: `/v3/users/c4ad021541af49f38100ca8f2f21d84e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:52.475010 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32801237-7bb7-45fc-a317-38bae5a9f244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ad021541af49f38100ca8f2f21d84e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:52.476903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32801237-7bb7-45fc-a317-38bae5a9f244 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:52.520963 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-32801237-7bb7-45fc-a317-38bae5a9f244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ad021541af49f38100ca8f2f21d84e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:52.528461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-32801237-7bb7-45fc-a317-38bae5a9f244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ad021541af49f38100ca8f2f21d84e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:52.540096 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-32801237-7bb7-45fc-a317-38bae5a9f244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ad021541af49f38100ca8f2f21d84e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:52.540725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-32801237-7bb7-45fc-a317-38bae5a9f244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ad021541af49f38100ca8f2f21d84e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:52.547669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-32801237-7bb7-45fc-a317-38bae5a9f244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ad021541af49f38100ca8f2f21d84e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:52.553408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1183/2352] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:33:52 2022] DELETE /identity/v3/users/c4ad021541af49f38100ca8f2f21d84e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:52.557842 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2b769-2aec-46dd-b5c8-88334a7bb41f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:52.558330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2b769-2aec-46dd-b5c8-88334a7bb41f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:52.558464 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2b769-2aec-46dd-b5c8-88334a7bb41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:52.577221 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b8b2b769-2aec-46dd-b5c8-88334a7bb41f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:52.578447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b8b2b769-2aec-46dd-b5c8-88334a7bb41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:52.636817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1170/2353] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:52.647349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32801237-7bb7-45fc-a317-38bae5a9f244 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:52.648775 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-32801237-7bb7-45fc-a317-38bae5a9f244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:52.704909 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32801237-7bb7-45fc-a317-38bae5a9f244 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:52.709755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f429903-6d8e-488a-b02d-f1a9f1439631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:52.710369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f429903-6d8e-488a-b02d-f1a9f1439631 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:52.710682 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f429903-6d8e-488a-b02d-f1a9f1439631 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:52.710956 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f429903-6d8e-488a-b02d-f1a9f1439631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:52.720506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f429903-6d8e-488a-b02d-f1a9f1439631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:52.721927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f429903-6d8e-488a-b02d-f1a9f1439631 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:52.731137 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1184/2354] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:33:52.996716 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2b769-2aec-46dd-b5c8-88334a7bb41f None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:52.998283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b8b2b769-2aec-46dd-b5c8-88334a7bb41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:53.005456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:53.014548 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2b769-2aec-46dd-b5c8-88334a7bb41f None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:53.019896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:53.020742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:53.021288 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:53.021822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] PATH_INFO: `/v3/projects/e22fe43236f74b82bce15882f3ab36ed` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:53.023337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e22fe43236f74b82bce15882f3ab36ed)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:53.025269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:53.074347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e22fe43236f74b82bce15882f3ab36ed', 'request_id': 'req-4379e929-40e0-4c65-8482-4169d9422b56'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.081568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e22fe43236f74b82bce15882f3ab36ed', 'request_id': 'req-4379e929-40e0-4c65-8482-4169d9422b56'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.087074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e22fe43236f74b82bce15882f3ab36ed', 'request_id': 'req-4379e929-40e0-4c65-8482-4169d9422b56'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.098309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] The token cache is being invalidate because project e22fe43236f74b82bce15882f3ab36ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:33:53.098476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.098994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.101041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1171/2355] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:33:52 2022] DELETE /identity/v3/projects/e22fe43236f74b82bce15882f3ab36ed => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:53.105060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f429903-6d8e-488a-b02d-f1a9f1439631 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:53.114788 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f429903-6d8e-488a-b02d-f1a9f1439631 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:53.154345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:53.172163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe781da-9b01-407f-9d09-d0492195eb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:53.172803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe781da-9b01-407f-9d09-d0492195eb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:53.173086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe781da-9b01-407f-9d09-d0492195eb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:53.173364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe781da-9b01-407f-9d09-d0492195eb40 admin admin] PATH_INFO: `/v3/users/589b6294d1864326bb9de198f27e4202` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:53.174554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe781da-9b01-407f-9d09-d0492195eb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=589b6294d1864326bb9de198f27e4202)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:53.176471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe781da-9b01-407f-9d09-d0492195eb40 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:53.222856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4fe781da-9b01-407f-9d09-d0492195eb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589b6294d1864326bb9de198f27e4202'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.230613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4fe781da-9b01-407f-9d09-d0492195eb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589b6294d1864326bb9de198f27e4202'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.244261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4fe781da-9b01-407f-9d09-d0492195eb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589b6294d1864326bb9de198f27e4202'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.244921 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4fe781da-9b01-407f-9d09-d0492195eb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589b6294d1864326bb9de198f27e4202'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.251734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4fe781da-9b01-407f-9d09-d0492195eb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589b6294d1864326bb9de198f27e4202'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.257608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1185/2356] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:33:53 2022] DELETE /identity/v3/users/589b6294d1864326bb9de198f27e4202 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:53.518904 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:53.520334 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:53.542503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379e929-40e0-4c65-8482-4169d9422b56 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:53.598855 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1c864-9b6a-4835-90a5-c4f8ea93f346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:53.599529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1c864-9b6a-4835-90a5-c4f8ea93f346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:53.600308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1c864-9b6a-4835-90a5-c4f8ea93f346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:53.600584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1c864-9b6a-4835-90a5-c4f8ea93f346 admin admin] PATH_INFO: `/v3/projects/8b975963254d43e6ab8dcb58c99ae8bd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:53.601736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1c864-9b6a-4835-90a5-c4f8ea93f346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b975963254d43e6ab8dcb58c99ae8bd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:53.603671 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1c864-9b6a-4835-90a5-c4f8ea93f346 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:53.648305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-98e1c864-9b6a-4835-90a5-c4f8ea93f346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b975963254d43e6ab8dcb58c99ae8bd', 'request_id': 'req-98e1c864-9b6a-4835-90a5-c4f8ea93f346'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.655335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-98e1c864-9b6a-4835-90a5-c4f8ea93f346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b975963254d43e6ab8dcb58c99ae8bd', 'request_id': 'req-98e1c864-9b6a-4835-90a5-c4f8ea93f346'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.661063 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-98e1c864-9b6a-4835-90a5-c4f8ea93f346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b975963254d43e6ab8dcb58c99ae8bd', 'request_id': 'req-98e1c864-9b6a-4835-90a5-c4f8ea93f346'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.672872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-98e1c864-9b6a-4835-90a5-c4f8ea93f346 admin admin] The token cache is being invalidate because project 8b975963254d43e6ab8dcb58c99ae8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:33:53.673161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-98e1c864-9b6a-4835-90a5-c4f8ea93f346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.673819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-98e1c864-9b6a-4835-90a5-c4f8ea93f346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:53.675358 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1172/2357] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:33:53 2022] DELETE /identity/v3/projects/8b975963254d43e6ab8dcb58c99ae8bd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:53.680286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10005911-ec30-4c19-b8e0-9eb3502becae None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:53.680739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10005911-ec30-4c19-b8e0-9eb3502becae None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:53.680847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10005911-ec30-4c19-b8e0-9eb3502becae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:53.699895 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-10005911-ec30-4c19-b8e0-9eb3502becae None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:53.701095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-10005911-ec30-4c19-b8e0-9eb3502becae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:53.758601 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1186/2358] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:53.766521 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d69591-79c2-403f-a321-59eb055f8540 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:53.766810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d69591-79c2-403f-a321-59eb055f8540 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:53.767090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d69591-79c2-403f-a321-59eb055f8540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:53.791143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-33d69591-79c2-403f-a321-59eb055f8540 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:53.792356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-33d69591-79c2-403f-a321-59eb055f8540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:53.800301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1173/2359] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:53.804595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10005911-ec30-4c19-b8e0-9eb3502becae None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:53.814201 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10005911-ec30-4c19-b8e0-9eb3502becae None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:53.819432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131c1e3-88e8-44b8-818f-526713930036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:53.820033 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c1e3-88e8-44b8-818f-526713930036 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:53.820315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c1e3-88e8-44b8-818f-526713930036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:53.820589 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131c1e3-88e8-44b8-818f-526713930036 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:53.821277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131c1e3-88e8-44b8-818f-526713930036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:33:53.821584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131c1e3-88e8-44b8-818f-526713930036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:53.823221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131c1e3-88e8-44b8-818f-526713930036 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:53.835433 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1187/2360] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:33:53.839953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d69591-79c2-403f-a321-59eb055f8540 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:53.849279 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d69591-79c2-403f-a321-59eb055f8540 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:53.854379 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5676e-3404-42a1-b2ba-0c2806dfeadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:53.855009 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5676e-3404-42a1-b2ba-0c2806dfeadd admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:53.855292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5676e-3404-42a1-b2ba-0c2806dfeadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:53.855561 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5676e-3404-42a1-b2ba-0c2806dfeadd admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:53.856226 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5676e-3404-42a1-b2ba-0c2806dfeadd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:53.858129 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5676e-3404-42a1-b2ba-0c2806dfeadd admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:53.863332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:53.888436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1174/2361] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:33:53 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:33:53.891311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131c1e3-88e8-44b8-818f-526713930036 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:53.903504 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131c1e3-88e8-44b8-818f-526713930036 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:53.947871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:53.961103 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623680cf-f829-429a-9f4e-7da5c19f1946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:53.961825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623680cf-f829-429a-9f4e-7da5c19f1946 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:53.962107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623680cf-f829-429a-9f4e-7da5c19f1946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:53.962380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623680cf-f829-429a-9f4e-7da5c19f1946 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:53.963063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623680cf-f829-429a-9f4e-7da5c19f1946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:53.965280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623680cf-f829-429a-9f4e-7da5c19f1946 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:53.985428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1188/2362] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:33:53 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:33:53.989579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5676e-3404-42a1-b2ba-0c2806dfeadd admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:54.000566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5676e-3404-42a1-b2ba-0c2806dfeadd admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:54.005177 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e2069-13ac-4f04-bd15-c9e1c67b6574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:54.005787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e2069-13ac-4f04-bd15-c9e1c67b6574 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:54.006069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e2069-13ac-4f04-bd15-c9e1c67b6574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:54.006344 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e2069-13ac-4f04-bd15-c9e1c67b6574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:54.007071 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e2069-13ac-4f04-bd15-c9e1c67b6574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:54.008660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e2069-13ac-4f04-bd15-c9e1c67b6574 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:54.018274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1175/2363] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:33:54.022186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623680cf-f829-429a-9f4e-7da5c19f1946 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:54.032089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623680cf-f829-429a-9f4e-7da5c19f1946 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:54.036782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40423b0-eeb2-469c-8e74-2b8f645cbbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:54.037888 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40423b0-eeb2-469c-8e74-2b8f645cbbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:54.038170 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40423b0-eeb2-469c-8e74-2b8f645cbbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:54.038476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40423b0-eeb2-469c-8e74-2b8f645cbbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:54.039168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40423b0-eeb2-469c-8e74-2b8f645cbbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:54.040754 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40423b0-eeb2-469c-8e74-2b8f645cbbe1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:54.051195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1189/2364] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:33:54.055778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e2069-13ac-4f04-bd15-c9e1c67b6574 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:54.065799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e2069-13ac-4f04-bd15-c9e1c67b6574 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:54.070351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a93c16-1d8a-47b7-a293-81c8e62fd22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:54.071037 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a93c16-1d8a-47b7-a293-81c8e62fd22f admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:54.071320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a93c16-1d8a-47b7-a293-81c8e62fd22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:54.071598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a93c16-1d8a-47b7-a293-81c8e62fd22f admin admin] PATH_INFO: `/v3/projects/5ec92975c7524a9ba1453ee5e6e2b9db/users/80bdd6b0afdc4ee39f7155cf151f2b9b/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:54.086238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a93c16-1d8a-47b7-a293-81c8e62fd22f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec92975c7524a9ba1453ee5e6e2b9db, user_id=80bdd6b0afdc4ee39f7155cf151f2b9b, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:54.089189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a93c16-1d8a-47b7-a293-81c8e62fd22f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:54.103202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1176/2365] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:33:54 2022] PUT /identity/v3/projects/5ec92975c7524a9ba1453ee5e6e2b9db/users/80bdd6b0afdc4ee39f7155cf151f2b9b/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:54.114917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd17da-216c-47ce-adb3-5afd0f387473 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:54.115250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd17da-216c-47ce-adb3-5afd0f387473 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:54.116061 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd17da-216c-47ce-adb3-5afd0f387473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:54.143896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bbbd17da-216c-47ce-adb3-5afd0f387473 None None] MFA Rules not processed for user `80bdd6b0afdc4ee39f7155cf151f2b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:54.145106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bbbd17da-216c-47ce-adb3-5afd0f387473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:54.210648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1190/2366] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:54.215421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a93c16-1d8a-47b7-a293-81c8e62fd22f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:54.276472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a93c16-1d8a-47b7-a293-81c8e62fd22f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:54.281100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b461c-f2e9-4377-ad3b-5b6d9208e23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:54.281709 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b461c-f2e9-4377-ad3b-5b6d9208e23b admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:54.281999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b461c-f2e9-4377-ad3b-5b6d9208e23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:54.282278 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b461c-f2e9-4377-ad3b-5b6d9208e23b admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:54.282983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b461c-f2e9-4377-ad3b-5b6d9208e23b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:54.284882 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b461c-f2e9-4377-ad3b-5b6d9208e23b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:54.311072 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1177/2367] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:33:54 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:33:54.315293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd17da-216c-47ce-adb3-5afd0f387473 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:54.325846 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd17da-216c-47ce-adb3-5afd0f387473 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:54.381135 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11237f7-bd4a-4d5e-9ca5-e8ab06fcac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:54.381673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11237f7-bd4a-4d5e-9ca5-e8ab06fcac60 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:54.381957 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11237f7-bd4a-4d5e-9ca5-e8ab06fcac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:54.382235 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11237f7-bd4a-4d5e-9ca5-e8ab06fcac60 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:54.382925 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11237f7-bd4a-4d5e-9ca5-e8ab06fcac60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:54.384838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11237f7-bd4a-4d5e-9ca5-e8ab06fcac60 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:54.405541 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1191/2368] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:33:54 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:33:54.409550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b461c-f2e9-4377-ad3b-5b6d9208e23b admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:54.420399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b461c-f2e9-4377-ad3b-5b6d9208e23b admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:54.425054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db29f8-252a-45da-9839-e7f260abe13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:54.425582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db29f8-252a-45da-9839-e7f260abe13e admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:54.425867 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db29f8-252a-45da-9839-e7f260abe13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:54.426145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db29f8-252a-45da-9839-e7f260abe13e admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:54.426873 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db29f8-252a-45da-9839-e7f260abe13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:54.428472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db29f8-252a-45da-9839-e7f260abe13e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:54.438834 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1178/2369] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:33:54.442938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11237f7-bd4a-4d5e-9ca5-e8ab06fcac60 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:54.453123 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11237f7-bd4a-4d5e-9ca5-e8ab06fcac60 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:54.457824 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b358316-7978-417d-8171-d65ffff47568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:54.458525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b358316-7978-417d-8171-d65ffff47568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:54.459324 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b358316-7978-417d-8171-d65ffff47568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:54.459714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b358316-7978-417d-8171-d65ffff47568 admin admin] PATH_INFO: `/v3/projects/fc6fe0d52a534aeb8a7da4ae6a29fe63/users/9041a888d6ad4461af211e0b3fd01e94/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:54.475519 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b358316-7978-417d-8171-d65ffff47568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6fe0d52a534aeb8a7da4ae6a29fe63, user_id=9041a888d6ad4461af211e0b3fd01e94, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:54.478174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b358316-7978-417d-8171-d65ffff47568 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:54.491740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1192/2370] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:33:54 2022] PUT /identity/v3/projects/fc6fe0d52a534aeb8a7da4ae6a29fe63/users/9041a888d6ad4461af211e0b3fd01e94/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:54.495672 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db29f8-252a-45da-9839-e7f260abe13e admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:54.505712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db29f8-252a-45da-9839-e7f260abe13e admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:54.561249 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9128638-d270-4cbb-bc9e-190dd1ac2f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:54.561865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9128638-d270-4cbb-bc9e-190dd1ac2f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:54.562153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9128638-d270-4cbb-bc9e-190dd1ac2f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:54.562453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9128638-d270-4cbb-bc9e-190dd1ac2f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:54.563156 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9128638-d270-4cbb-bc9e-190dd1ac2f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:54.564742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9128638-d270-4cbb-bc9e-190dd1ac2f07 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:54.575129 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1179/2371] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:33:54.579279 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b358316-7978-417d-8171-d65ffff47568 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:54.590349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b358316-7978-417d-8171-d65ffff47568 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:54.595008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf98837-25e5-4a15-be8d-edf9b29e5432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:54.595670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf98837-25e5-4a15-be8d-edf9b29e5432 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:54.595955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf98837-25e5-4a15-be8d-edf9b29e5432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:54.596234 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf98837-25e5-4a15-be8d-edf9b29e5432 admin admin] PATH_INFO: `/v3/projects/fc6fe0d52a534aeb8a7da4ae6a29fe63/users/9041a888d6ad4461af211e0b3fd01e94/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:54.598148 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf98837-25e5-4a15-be8d-edf9b29e5432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6fe0d52a534aeb8a7da4ae6a29fe63, user_id=9041a888d6ad4461af211e0b3fd01e94, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:54.600943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf98837-25e5-4a15-be8d-edf9b29e5432 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:54.610891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1193/2372] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:33:54 2022] PUT /identity/v3/projects/fc6fe0d52a534aeb8a7da4ae6a29fe63/users/9041a888d6ad4461af211e0b3fd01e94/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:54.621180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f674508-3cf3-43bb-9738-ee0e91d50f62 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:54.621644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f674508-3cf3-43bb-9738-ee0e91d50f62 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:54.621754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f674508-3cf3-43bb-9738-ee0e91d50f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:54.649968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5f674508-3cf3-43bb-9738-ee0e91d50f62 None None] MFA Rules not processed for user `9041a888d6ad4461af211e0b3fd01e94`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:54.651149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5f674508-3cf3-43bb-9738-ee0e91d50f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:54.660991 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:54.719312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1180/2373] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:54.730879 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf98837-25e5-4a15-be8d-edf9b29e5432 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:54.732661 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3cf98837-25e5-4a15-be8d-edf9b29e5432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:54.743355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:54.790646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf98837-25e5-4a15-be8d-edf9b29e5432 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:54.794317 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db8da4-ef53-42c9-b343-44fbc766a4fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:54.794966 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db8da4-ef53-42c9-b343-44fbc766a4fe service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:54.795248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db8da4-ef53-42c9-b343-44fbc766a4fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:54.795523 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db8da4-ef53-42c9-b343-44fbc766a4fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:54.804612 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db8da4-ef53-42c9-b343-44fbc766a4fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:54.806055 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db8da4-ef53-42c9-b343-44fbc766a4fe service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:54.815802 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1194/2374] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:33:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:33:56.155456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f674508-3cf3-43bb-9738-ee0e91d50f62 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:56.219570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f674508-3cf3-43bb-9738-ee0e91d50f62 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:56.223970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086622b-b616-4fa4-8cde-73a02a5733c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:56.224598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086622b-b616-4fa4-8cde-73a02a5733c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:56.224877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086622b-b616-4fa4-8cde-73a02a5733c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:56.225149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086622b-b616-4fa4-8cde-73a02a5733c7 admin admin] PATH_INFO: `/v3/users/80bdd6b0afdc4ee39f7155cf151f2b9b` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:56.226383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086622b-b616-4fa4-8cde-73a02a5733c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80bdd6b0afdc4ee39f7155cf151f2b9b)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:56.228356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086622b-b616-4fa4-8cde-73a02a5733c7 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:56.273564 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4086622b-b616-4fa4-8cde-73a02a5733c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80bdd6b0afdc4ee39f7155cf151f2b9b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:56.280559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4086622b-b616-4fa4-8cde-73a02a5733c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80bdd6b0afdc4ee39f7155cf151f2b9b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:56.287383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4086622b-b616-4fa4-8cde-73a02a5733c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80bdd6b0afdc4ee39f7155cf151f2b9b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:56.288011 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4086622b-b616-4fa4-8cde-73a02a5733c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80bdd6b0afdc4ee39f7155cf151f2b9b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:56.299534 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-4086622b-b616-4fa4-8cde-73a02a5733c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80bdd6b0afdc4ee39f7155cf151f2b9b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:56.305493 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1181/2375] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:33:56 2022] DELETE /identity/v3/users/80bdd6b0afdc4ee39f7155cf151f2b9b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:56.310008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ec271-8f48-403a-b05d-9a74212685c9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:56.310484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ec271-8f48-403a-b05d-9a74212685c9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:56.310609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ec271-8f48-403a-b05d-9a74212685c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:56.329634 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ac3ec271-8f48-403a-b05d-9a74212685c9 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:56.330862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ac3ec271-8f48-403a-b05d-9a74212685c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:56.388340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1195/2376] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:56.398680 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086622b-b616-4fa4-8cde-73a02a5733c7 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:56.400069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4086622b-b616-4fa4-8cde-73a02a5733c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:56.430544 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:56.459613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086622b-b616-4fa4-8cde-73a02a5733c7 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:56.463717 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b327a-7a1e-42d1-9f8a-06d80b97b88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:56.464333 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b327a-7a1e-42d1-9f8a-06d80b97b88a service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:56.464611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b327a-7a1e-42d1-9f8a-06d80b97b88a service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:56.464881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b327a-7a1e-42d1-9f8a-06d80b97b88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:56.474043 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b327a-7a1e-42d1-9f8a-06d80b97b88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:56.475578 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b327a-7a1e-42d1-9f8a-06d80b97b88a service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:56.484918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1182/2377] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:33:56.755073 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ec271-8f48-403a-b05d-9a74212685c9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:56.757193 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ac3ec271-8f48-403a-b05d-9a74212685c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:56.770986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ec271-8f48-403a-b05d-9a74212685c9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:56.776009 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:56.776651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:56.776932 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:56.777206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] PATH_INFO: `/v3/projects/5ec92975c7524a9ba1453ee5e6e2b9db` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:56.778398 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec92975c7524a9ba1453ee5e6e2b9db)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:56.780336 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:56.827071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec92975c7524a9ba1453ee5e6e2b9db', 'request_id': 'req-752cafa5-62fb-4bd0-b705-e36167ba18b3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:56.833259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec92975c7524a9ba1453ee5e6e2b9db', 'request_id': 'req-752cafa5-62fb-4bd0-b705-e36167ba18b3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:56.841566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec92975c7524a9ba1453ee5e6e2b9db', 'request_id': 'req-752cafa5-62fb-4bd0-b705-e36167ba18b3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:56.852360 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] The token cache is being invalidate because project 5ec92975c7524a9ba1453ee5e6e2b9db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:33:56.852651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:56.853288 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:56.854904 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1196/2378] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:33:56 2022] DELETE /identity/v3/projects/5ec92975c7524a9ba1453ee5e6e2b9db => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:56.859131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b327a-7a1e-42d1-9f8a-06d80b97b88a service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:56.868866 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b327a-7a1e-42d1-9f8a-06d80b97b88a service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:56.925409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dafbde-4613-4333-a118-d224ab81c511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:56.926039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dafbde-4613-4333-a118-d224ab81c511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:56.926320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dafbde-4613-4333-a118-d224ab81c511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:56.926620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dafbde-4613-4333-a118-d224ab81c511 admin admin] PATH_INFO: `/v3/users/9041a888d6ad4461af211e0b3fd01e94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:56.927776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dafbde-4613-4333-a118-d224ab81c511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9041a888d6ad4461af211e0b3fd01e94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:56.929694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dafbde-4613-4333-a118-d224ab81c511 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:56.976841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e6dafbde-4613-4333-a118-d224ab81c511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9041a888d6ad4461af211e0b3fd01e94'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:56.984203 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e6dafbde-4613-4333-a118-d224ab81c511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9041a888d6ad4461af211e0b3fd01e94'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:56.991421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e6dafbde-4613-4333-a118-d224ab81c511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9041a888d6ad4461af211e0b3fd01e94'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:56.992099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e6dafbde-4613-4333-a118-d224ab81c511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9041a888d6ad4461af211e0b3fd01e94'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:57.003988 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e6dafbde-4613-4333-a118-d224ab81c511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9041a888d6ad4461af211e0b3fd01e94'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:57.010227 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1183/2379] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:33:56 2022] DELETE /identity/v3/users/9041a888d6ad4461af211e0b3fd01e94 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:57.275338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:57.276874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:57.291418 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cafa5-62fb-4bd0-b705-e36167ba18b3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:57.329099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:57.357280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea5c74-3e79-427b-bc3d-c83d0a16067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:57.357938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea5c74-3e79-427b-bc3d-c83d0a16067e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:57.358213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea5c74-3e79-427b-bc3d-c83d0a16067e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:57.358550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea5c74-3e79-427b-bc3d-c83d0a16067e admin admin] PATH_INFO: `/v3/projects/fc6fe0d52a534aeb8a7da4ae6a29fe63` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:57.359747 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea5c74-3e79-427b-bc3d-c83d0a16067e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6fe0d52a534aeb8a7da4ae6a29fe63)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:57.361861 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea5c74-3e79-427b-bc3d-c83d0a16067e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:57.410700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8fea5c74-3e79-427b-bc3d-c83d0a16067e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6fe0d52a534aeb8a7da4ae6a29fe63', 'request_id': 'req-8fea5c74-3e79-427b-bc3d-c83d0a16067e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:57.417095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8fea5c74-3e79-427b-bc3d-c83d0a16067e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6fe0d52a534aeb8a7da4ae6a29fe63', 'request_id': 'req-8fea5c74-3e79-427b-bc3d-c83d0a16067e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:57.424184 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8fea5c74-3e79-427b-bc3d-c83d0a16067e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6fe0d52a534aeb8a7da4ae6a29fe63', 'request_id': 'req-8fea5c74-3e79-427b-bc3d-c83d0a16067e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:57.434810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8fea5c74-3e79-427b-bc3d-c83d0a16067e admin admin] The token cache is being invalidate because project fc6fe0d52a534aeb8a7da4ae6a29fe63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:33:57.435093 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8fea5c74-3e79-427b-bc3d-c83d0a16067e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:57.435713 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8fea5c74-3e79-427b-bc3d-c83d0a16067e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:33:57.437208 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1197/2380] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:33:57 2022] DELETE /identity/v3/projects/fc6fe0d52a534aeb8a7da4ae6a29fe63 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:57.442119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700b379-9858-46b6-8d7f-fd27b8bdfa44 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:57.442619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700b379-9858-46b6-8d7f-fd27b8bdfa44 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:57.442717 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700b379-9858-46b6-8d7f-fd27b8bdfa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:57.463537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a700b379-9858-46b6-8d7f-fd27b8bdfa44 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:57.464773 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a700b379-9858-46b6-8d7f-fd27b8bdfa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:57.508154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:57.524734 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1184/2381] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:57.532732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e01e1-ca47-45f9-b145-35a81f075ada None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:57.533053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e01e1-ca47-45f9-b145-35a81f075ada None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:57.533328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e01e1-ca47-45f9-b145-35a81f075ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:57.553417 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-991e01e1-ca47-45f9-b145-35a81f075ada None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:57.554660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-991e01e1-ca47-45f9-b145-35a81f075ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:57.562449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1198/2382] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:57.566655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700b379-9858-46b6-8d7f-fd27b8bdfa44 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:57.576612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700b379-9858-46b6-8d7f-fd27b8bdfa44 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:57.581065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9c1ed-2469-4cbb-b5d6-600e0f4436fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:57.581670 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9c1ed-2469-4cbb-b5d6-600e0f4436fa admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:57.581945 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9c1ed-2469-4cbb-b5d6-600e0f4436fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:57.582215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9c1ed-2469-4cbb-b5d6-600e0f4436fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:57.582941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9c1ed-2469-4cbb-b5d6-600e0f4436fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:33:57.583247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9c1ed-2469-4cbb-b5d6-600e0f4436fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:57.585389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9c1ed-2469-4cbb-b5d6-600e0f4436fa admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:57.596787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1185/2383] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:33:57.600995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e01e1-ca47-45f9-b145-35a81f075ada None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:57.610646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e01e1-ca47-45f9-b145-35a81f075ada None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:57.615349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b7c03-a589-418c-89cb-c15ef544171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:57.615986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b7c03-a589-418c-89cb-c15ef544171f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:57.616269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b7c03-a589-418c-89cb-c15ef544171f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:57.616543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b7c03-a589-418c-89cb-c15ef544171f admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:57.617233 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b7c03-a589-418c-89cb-c15ef544171f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:57.619178 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b7c03-a589-418c-89cb-c15ef544171f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:57.647787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1199/2384] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:33:57 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:33:57.651748 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9c1ed-2469-4cbb-b5d6-600e0f4436fa admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:57.662189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9c1ed-2469-4cbb-b5d6-600e0f4436fa admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:57.717797 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a75bc-bff9-4cee-950a-1a90956b6178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:57.718433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a75bc-bff9-4cee-950a-1a90956b6178 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:57.718718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a75bc-bff9-4cee-950a-1a90956b6178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:57.718995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a75bc-bff9-4cee-950a-1a90956b6178 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:57.719656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a75bc-bff9-4cee-950a-1a90956b6178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:57.721547 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a75bc-bff9-4cee-950a-1a90956b6178 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:57.741700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1186/2385] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:33:57 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:33:57.745861 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b7c03-a589-418c-89cb-c15ef544171f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:57.756086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b7c03-a589-418c-89cb-c15ef544171f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:57.761454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94736722-74f1-4e09-b705-5e732ed4e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:57.762054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94736722-74f1-4e09-b705-5e732ed4e114 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:57.762336 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94736722-74f1-4e09-b705-5e732ed4e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:57.762639 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94736722-74f1-4e09-b705-5e732ed4e114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:57.763328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94736722-74f1-4e09-b705-5e732ed4e114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:57.764929 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94736722-74f1-4e09-b705-5e732ed4e114 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:57.776058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1200/2386] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:33:57.779897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a75bc-bff9-4cee-950a-1a90956b6178 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:57.789762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a75bc-bff9-4cee-950a-1a90956b6178 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:57.794386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa658fc-13f0-49a0-b0ed-55d251e17925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:57.795041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa658fc-13f0-49a0-b0ed-55d251e17925 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:57.795327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa658fc-13f0-49a0-b0ed-55d251e17925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:57.795604 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa658fc-13f0-49a0-b0ed-55d251e17925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:57.796290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa658fc-13f0-49a0-b0ed-55d251e17925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:57.797873 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa658fc-13f0-49a0-b0ed-55d251e17925 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:57.808235 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1187/2387] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:33:57.812191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94736722-74f1-4e09-b705-5e732ed4e114 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:57.822455 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94736722-74f1-4e09-b705-5e732ed4e114 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:57.827068 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dc03c-016a-43d6-b4f9-1e8eac993f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:57.827714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dc03c-016a-43d6-b4f9-1e8eac993f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:57.827993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dc03c-016a-43d6-b4f9-1e8eac993f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:57.828266 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dc03c-016a-43d6-b4f9-1e8eac993f0d admin admin] PATH_INFO: `/v3/projects/d84005a51f1a486e814bd7616914a5d0/users/8d2fe69ad1e646f3a2c9dc1f7994957e/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:57.843189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dc03c-016a-43d6-b4f9-1e8eac993f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84005a51f1a486e814bd7616914a5d0, user_id=8d2fe69ad1e646f3a2c9dc1f7994957e, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:57.845836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dc03c-016a-43d6-b4f9-1e8eac993f0d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:57.859691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1201/2388] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:33:57 2022] PUT /identity/v3/projects/d84005a51f1a486e814bd7616914a5d0/users/8d2fe69ad1e646f3a2c9dc1f7994957e/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:33:57.870838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79166b8b-7567-4666-8fb1-5614a26f74b6 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:57.871129 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79166b8b-7567-4666-8fb1-5614a26f74b6 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:57.871407 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79166b8b-7567-4666-8fb1-5614a26f74b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:57.899918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-79166b8b-7567-4666-8fb1-5614a26f74b6 None None] MFA Rules not processed for user `8d2fe69ad1e646f3a2c9dc1f7994957e`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:57.901118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-79166b8b-7567-4666-8fb1-5614a26f74b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:57.968857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1188/2389] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:57.973384 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dc03c-016a-43d6-b4f9-1e8eac993f0d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:58.033096 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dc03c-016a-43d6-b4f9-1e8eac993f0d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:58.037571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bcb0e-38c9-4821-9d1f-f2d33061ce25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:58.038205 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bcb0e-38c9-4821-9d1f-f2d33061ce25 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:58.039011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bcb0e-38c9-4821-9d1f-f2d33061ce25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:58.039284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bcb0e-38c9-4821-9d1f-f2d33061ce25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:58.039944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bcb0e-38c9-4821-9d1f-f2d33061ce25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:58.041828 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bcb0e-38c9-4821-9d1f-f2d33061ce25 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:58.046984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:58.069799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1202/2390] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:33:57 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:33:58.073999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79166b8b-7567-4666-8fb1-5614a26f74b6 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:58.085379 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79166b8b-7567-4666-8fb1-5614a26f74b6 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:58.125853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:58.142957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6418c47-717d-4824-9df9-5242941d9b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:58.143590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6418c47-717d-4824-9df9-5242941d9b1f admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:58.143876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6418c47-717d-4824-9df9-5242941d9b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:58.144157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6418c47-717d-4824-9df9-5242941d9b1f admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:58.144837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6418c47-717d-4824-9df9-5242941d9b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:58.146821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6418c47-717d-4824-9df9-5242941d9b1f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:58.170374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1189/2391] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:33:58 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:33:58.174694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bcb0e-38c9-4821-9d1f-f2d33061ce25 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:58.185324 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bcb0e-38c9-4821-9d1f-f2d33061ce25 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:58.191240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e338ee-4585-4154-af80-59b9145944ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:58.191856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e338ee-4585-4154-af80-59b9145944ce admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:58.192137 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e338ee-4585-4154-af80-59b9145944ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:58.192417 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e338ee-4585-4154-af80-59b9145944ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:58.193153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e338ee-4585-4154-af80-59b9145944ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:58.194805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e338ee-4585-4154-af80-59b9145944ce admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:58.211009 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1203/2392] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:33:58.212608 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6418c47-717d-4824-9df9-5242941d9b1f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:58.222982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6418c47-717d-4824-9df9-5242941d9b1f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:58.228367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87289846-00b8-4443-a11d-a5fd806d38be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:58.229029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87289846-00b8-4443-a11d-a5fd806d38be admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:58.229312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87289846-00b8-4443-a11d-a5fd806d38be admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:58.229616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87289846-00b8-4443-a11d-a5fd806d38be admin admin] PATH_INFO: `/v3/projects/fa942eda12494ea4aecee11c5fec6342/users/0cb4e5f4eb634dcab6a705f03c06c97b/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:58.246195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87289846-00b8-4443-a11d-a5fd806d38be admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa942eda12494ea4aecee11c5fec6342, user_id=0cb4e5f4eb634dcab6a705f03c06c97b, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:58.248908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87289846-00b8-4443-a11d-a5fd806d38be admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:58.262841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1190/2393] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:33:58 2022] PUT /identity/v3/projects/fa942eda12494ea4aecee11c5fec6342/users/0cb4e5f4eb634dcab6a705f03c06c97b/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:58.266887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e338ee-4585-4154-af80-59b9145944ce admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:58.277566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e338ee-4585-4154-af80-59b9145944ce admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:58.333408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ef102-8c01-4847-8168-d2c6e9eb9d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:58.334074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ef102-8c01-4847-8168-d2c6e9eb9d9c admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:58.334302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ef102-8c01-4847-8168-d2c6e9eb9d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:58.334675 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ef102-8c01-4847-8168-d2c6e9eb9d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:58.335890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ef102-8c01-4847-8168-d2c6e9eb9d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:58.337480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ef102-8c01-4847-8168-d2c6e9eb9d9c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:58.347532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1204/2394] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:33:58.351860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87289846-00b8-4443-a11d-a5fd806d38be admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:58.362029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87289846-00b8-4443-a11d-a5fd806d38be admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:58.366780 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6de0-92e8-4cff-bcf3-4b0604c471cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:58.367447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6de0-92e8-4cff-bcf3-4b0604c471cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:58.367719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6de0-92e8-4cff-bcf3-4b0604c471cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:58.367995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6de0-92e8-4cff-bcf3-4b0604c471cf admin admin] PATH_INFO: `/v3/projects/fa942eda12494ea4aecee11c5fec6342/users/0cb4e5f4eb634dcab6a705f03c06c97b/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:58.369928 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c6de0-92e8-4cff-bcf3-4b0604c471cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa942eda12494ea4aecee11c5fec6342, user_id=0cb4e5f4eb634dcab6a705f03c06c97b, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:58.372567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c6de0-92e8-4cff-bcf3-4b0604c471cf admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:58.383052 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1191/2395] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:33:58 2022] PUT /identity/v3/projects/fa942eda12494ea4aecee11c5fec6342/users/0cb4e5f4eb634dcab6a705f03c06c97b/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:33:58.394988 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35fbed-f62e-47c2-b2e5-a5f4a39f8c6b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:58.395284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35fbed-f62e-47c2-b2e5-a5f4a39f8c6b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:58.395600 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35fbed-f62e-47c2-b2e5-a5f4a39f8c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:58.423398 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8a35fbed-f62e-47c2-b2e5-a5f4a39f8c6b None None] MFA Rules not processed for user `0cb4e5f4eb634dcab6a705f03c06c97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:33:58.424605 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8a35fbed-f62e-47c2-b2e5-a5f4a39f8c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:58.492228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1205/2396] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:33:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:33:58.503546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6de0-92e8-4cff-bcf3-4b0604c471cf admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:58.505322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f78c6de0-92e8-4cff-bcf3-4b0604c471cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:58.561477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6de0-92e8-4cff-bcf3-4b0604c471cf admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:58.565107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa19d3-b8a6-4c2b-9702-d7784c1b1280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:58.565714 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa19d3-b8a6-4c2b-9702-d7784c1b1280 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:58.565995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa19d3-b8a6-4c2b-9702-d7784c1b1280 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:58.566274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa19d3-b8a6-4c2b-9702-d7784c1b1280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:58.575660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa19d3-b8a6-4c2b-9702-d7784c1b1280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:58.577090 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa19d3-b8a6-4c2b-9702-d7784c1b1280 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:58.587395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1192/2397] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:33:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:33:58.632431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35fbed-f62e-47c2-b2e5-a5f4a39f8c6b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:33:58.633436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8a35fbed-f62e-47c2-b2e5-a5f4a39f8c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:33:58.645434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35fbed-f62e-47c2-b2e5-a5f4a39f8c6b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:33:58.649702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0703473-b901-4ee3-a7b4-8a4e693cc7cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:33:58.650310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703473-b901-4ee3-a7b4-8a4e693cc7cf service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:33:58.650688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703473-b901-4ee3-a7b4-8a4e693cc7cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:33:58.650959 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703473-b901-4ee3-a7b4-8a4e693cc7cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:33:58.703669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:33:58.706346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0703473-b901-4ee3-a7b4-8a4e693cc7cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:33:58.707979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0703473-b901-4ee3-a7b4-8a4e693cc7cf service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:33:58.718044 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1206/2398] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:33:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:34:02.002101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa19d3-b8a6-4c2b-9702-d7784c1b1280 service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:02.063088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa19d3-b8a6-4c2b-9702-d7784c1b1280 service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:02.067582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8325d-c9de-41d0-9789-b135a167ae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:02.068213 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8325d-c9de-41d0-9789-b135a167ae84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:02.068493 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8325d-c9de-41d0-9789-b135a167ae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:02.068767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8325d-c9de-41d0-9789-b135a167ae84 admin admin] PATH_INFO: `/v3/users/8d2fe69ad1e646f3a2c9dc1f7994957e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:02.070507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8325d-c9de-41d0-9789-b135a167ae84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d2fe69ad1e646f3a2c9dc1f7994957e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:02.072503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8325d-c9de-41d0-9789-b135a167ae84 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:02.112785 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:02.118831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-43e8325d-c9de-41d0-9789-b135a167ae84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d2fe69ad1e646f3a2c9dc1f7994957e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.126803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-43e8325d-c9de-41d0-9789-b135a167ae84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d2fe69ad1e646f3a2c9dc1f7994957e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.133921 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-43e8325d-c9de-41d0-9789-b135a167ae84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d2fe69ad1e646f3a2c9dc1f7994957e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.134578 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-43e8325d-c9de-41d0-9789-b135a167ae84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d2fe69ad1e646f3a2c9dc1f7994957e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.146086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-43e8325d-c9de-41d0-9789-b135a167ae84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d2fe69ad1e646f3a2c9dc1f7994957e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.152038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1193/2399] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:34:02 2022] DELETE /identity/v3/users/8d2fe69ad1e646f3a2c9dc1f7994957e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:02.156623 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cd645-c5a3-4cf9-a87f-6991480459e3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:02.157128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cd645-c5a3-4cf9-a87f-6991480459e3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:02.157128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cd645-c5a3-4cf9-a87f-6991480459e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:02.180941 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-838cd645-c5a3-4cf9-a87f-6991480459e3 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:02.182155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-838cd645-c5a3-4cf9-a87f-6991480459e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:02.240577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1207/2400] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:02.250866 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8325d-c9de-41d0-9789-b135a167ae84 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:02.252262 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-43e8325d-c9de-41d0-9789-b135a167ae84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:02.308407 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8325d-c9de-41d0-9789-b135a167ae84 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:02.312060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79da27-3c01-4558-9b58-97e2ca7cb09f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:02.312674 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79da27-3c01-4558-9b58-97e2ca7cb09f service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:02.312959 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79da27-3c01-4558-9b58-97e2ca7cb09f service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:02.313238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79da27-3c01-4558-9b58-97e2ca7cb09f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:02.322123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79da27-3c01-4558-9b58-97e2ca7cb09f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:02.323574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79da27-3c01-4558-9b58-97e2ca7cb09f service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:02.332919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1194/2401] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:34:02.600356 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cd645-c5a3-4cf9-a87f-6991480459e3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:02.602279 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-838cd645-c5a3-4cf9-a87f-6991480459e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:02.614214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cd645-c5a3-4cf9-a87f-6991480459e3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:02.619223 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:02.619861 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:02.620141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:02.620416 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] PATH_INFO: `/v3/projects/d84005a51f1a486e814bd7616914a5d0` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:02.621721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84005a51f1a486e814bd7616914a5d0)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:02.623550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:02.670214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84005a51f1a486e814bd7616914a5d0', 'request_id': 'req-1e1e5370-6f34-4c3d-804a-9eeff7723038'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.676396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84005a51f1a486e814bd7616914a5d0', 'request_id': 'req-1e1e5370-6f34-4c3d-804a-9eeff7723038'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.683900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84005a51f1a486e814bd7616914a5d0', 'request_id': 'req-1e1e5370-6f34-4c3d-804a-9eeff7723038'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.694597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] The token cache is being invalidate because project d84005a51f1a486e814bd7616914a5d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:34:02.694882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.695511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.696995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1208/2402] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:34:02 2022] DELETE /identity/v3/projects/d84005a51f1a486e814bd7616914a5d0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:02.701002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79da27-3c01-4558-9b58-97e2ca7cb09f service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:02.711167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79da27-3c01-4558-9b58-97e2ca7cb09f service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:02.765160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b72579-6d7c-492f-885e-682ec54e3eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:02.765787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b72579-6d7c-492f-885e-682ec54e3eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:02.766063 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b72579-6d7c-492f-885e-682ec54e3eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:02.766331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b72579-6d7c-492f-885e-682ec54e3eee admin admin] PATH_INFO: `/v3/users/0cb4e5f4eb634dcab6a705f03c06c97b` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:02.767493 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b72579-6d7c-492f-885e-682ec54e3eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb4e5f4eb634dcab6a705f03c06c97b)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:02.769384 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b72579-6d7c-492f-885e-682ec54e3eee admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:02.813353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-96b72579-6d7c-492f-885e-682ec54e3eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb4e5f4eb634dcab6a705f03c06c97b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.820922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-96b72579-6d7c-492f-885e-682ec54e3eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb4e5f4eb634dcab6a705f03c06c97b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.827702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-96b72579-6d7c-492f-885e-682ec54e3eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb4e5f4eb634dcab6a705f03c06c97b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.828355 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-96b72579-6d7c-492f-885e-682ec54e3eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb4e5f4eb634dcab6a705f03c06c97b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.829488 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:02.843581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-96b72579-6d7c-492f-885e-682ec54e3eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb4e5f4eb634dcab6a705f03c06c97b'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:02.849480 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1195/2403] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:34:02 2022] DELETE /identity/v3/users/0cb4e5f4eb634dcab6a705f03c06c97b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:03.117703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:03.119165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:03.132747 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e5370-6f34-4c3d-804a-9eeff7723038 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:03.193638 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a60efd-96b1-4f16-9781-f487336ff3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:03.194297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a60efd-96b1-4f16-9781-f487336ff3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:03.194511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a60efd-96b1-4f16-9781-f487336ff3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:03.194792 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a60efd-96b1-4f16-9781-f487336ff3de admin admin] PATH_INFO: `/v3/projects/fa942eda12494ea4aecee11c5fec6342` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:03.195960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a60efd-96b1-4f16-9781-f487336ff3de admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa942eda12494ea4aecee11c5fec6342)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:03.197887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a60efd-96b1-4f16-9781-f487336ff3de admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:03.222862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:03.247434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a9a60efd-96b1-4f16-9781-f487336ff3de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa942eda12494ea4aecee11c5fec6342', 'request_id': 'req-a9a60efd-96b1-4f16-9781-f487336ff3de'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:03.253401 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a9a60efd-96b1-4f16-9781-f487336ff3de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa942eda12494ea4aecee11c5fec6342', 'request_id': 'req-a9a60efd-96b1-4f16-9781-f487336ff3de'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:03.260065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a9a60efd-96b1-4f16-9781-f487336ff3de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa942eda12494ea4aecee11c5fec6342', 'request_id': 'req-a9a60efd-96b1-4f16-9781-f487336ff3de'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:03.270717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a9a60efd-96b1-4f16-9781-f487336ff3de admin admin] The token cache is being invalidate because project fa942eda12494ea4aecee11c5fec6342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:34:03.271008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a9a60efd-96b1-4f16-9781-f487336ff3de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:03.271639 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a9a60efd-96b1-4f16-9781-f487336ff3de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:03.273626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1209/2404] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:34:03 2022] DELETE /identity/v3/projects/fa942eda12494ea4aecee11c5fec6342 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:03.278680 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddd0cb-ed57-46dc-8815-f80fce1fe09f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:03.279172 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddd0cb-ed57-46dc-8815-f80fce1fe09f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:03.279268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddd0cb-ed57-46dc-8815-f80fce1fe09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:03.298788 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-21ddd0cb-ed57-46dc-8815-f80fce1fe09f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:03.299984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-21ddd0cb-ed57-46dc-8815-f80fce1fe09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:03.358024 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1196/2405] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:03.367019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c84192-424d-4e16-b582-5975eac64962 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:03.367330 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c84192-424d-4e16-b582-5975eac64962 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:03.367609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c84192-424d-4e16-b582-5975eac64962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:03.387658 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-98c84192-424d-4e16-b582-5975eac64962 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:03.388938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-98c84192-424d-4e16-b582-5975eac64962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:03.397624 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1210/2406] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:03.401934 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddd0cb-ed57-46dc-8815-f80fce1fe09f None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:03.411759 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddd0cb-ed57-46dc-8815-f80fce1fe09f None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:03.416968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dc322-3cca-4684-99bd-78610b726d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:03.417579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dc322-3cca-4684-99bd-78610b726d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:03.417864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dc322-3cca-4684-99bd-78610b726d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:03.418173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dc322-3cca-4684-99bd-78610b726d61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:03.418909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dc322-3cca-4684-99bd-78610b726d61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:34:03.419218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dc322-3cca-4684-99bd-78610b726d61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:03.420819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dc322-3cca-4684-99bd-78610b726d61 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:03.432530 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1197/2407] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:34:03.436755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c84192-424d-4e16-b582-5975eac64962 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:03.446240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c84192-424d-4e16-b582-5975eac64962 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:03.451205 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5a96d-25ad-47e8-9da5-3603e3dd043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:03.451837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5a96d-25ad-47e8-9da5-3603e3dd043d admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:03.452140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5a96d-25ad-47e8-9da5-3603e3dd043d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:03.452419 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5a96d-25ad-47e8-9da5-3603e3dd043d admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:03.453098 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5a96d-25ad-47e8-9da5-3603e3dd043d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:03.455050 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5a96d-25ad-47e8-9da5-3603e3dd043d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:03.483889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1211/2408] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:34:03 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:34:03.488049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dc322-3cca-4684-99bd-78610b726d61 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:03.497899 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dc322-3cca-4684-99bd-78610b726d61 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:03.551634 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09025fa-1422-43ba-b01b-d7e4a6476163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:03.552238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09025fa-1422-43ba-b01b-d7e4a6476163 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:03.552517 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09025fa-1422-43ba-b01b-d7e4a6476163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:03.552801 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09025fa-1422-43ba-b01b-d7e4a6476163 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:03.553498 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09025fa-1422-43ba-b01b-d7e4a6476163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:03.555440 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09025fa-1422-43ba-b01b-d7e4a6476163 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:03.576902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1198/2409] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:34:03 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:34:03.580902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5a96d-25ad-47e8-9da5-3603e3dd043d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:03.591931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5a96d-25ad-47e8-9da5-3603e3dd043d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:03.596551 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74544149-1ea9-4db5-a972-48c751c20433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:03.597158 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74544149-1ea9-4db5-a972-48c751c20433 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:03.597439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74544149-1ea9-4db5-a972-48c751c20433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:03.597714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74544149-1ea9-4db5-a972-48c751c20433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:03.598428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74544149-1ea9-4db5-a972-48c751c20433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:03.600143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74544149-1ea9-4db5-a972-48c751c20433 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:03.609775 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1212/2410] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:34:03.613612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09025fa-1422-43ba-b01b-d7e4a6476163 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:03.623769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09025fa-1422-43ba-b01b-d7e4a6476163 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:03.628562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2266e-153f-40db-bd75-ea4fde3a1dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:03.629167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2266e-153f-40db-bd75-ea4fde3a1dbf admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:03.629453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2266e-153f-40db-bd75-ea4fde3a1dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:03.629730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2266e-153f-40db-bd75-ea4fde3a1dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:03.630448 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2266e-153f-40db-bd75-ea4fde3a1dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:03.632593 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2266e-153f-40db-bd75-ea4fde3a1dbf admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:03.643227 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1199/2411] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:34:03.647830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74544149-1ea9-4db5-a972-48c751c20433 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:03.657858 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74544149-1ea9-4db5-a972-48c751c20433 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:03.662619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086873c-8f71-46e9-b5f0-da94f3acca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:03.663287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086873c-8f71-46e9-b5f0-da94f3acca16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:03.663576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086873c-8f71-46e9-b5f0-da94f3acca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:03.663999 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086873c-8f71-46e9-b5f0-da94f3acca16 admin admin] PATH_INFO: `/v3/projects/18e177409aed46168aec16dc285209fb/users/177f0c9f45f748ba8fcedbc7693c8f8b/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:03.678424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086873c-8f71-46e9-b5f0-da94f3acca16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e177409aed46168aec16dc285209fb, user_id=177f0c9f45f748ba8fcedbc7693c8f8b, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:03.681082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086873c-8f71-46e9-b5f0-da94f3acca16 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:03.693453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1213/2412] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:34:03 2022] PUT /identity/v3/projects/18e177409aed46168aec16dc285209fb/users/177f0c9f45f748ba8fcedbc7693c8f8b/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:34:03.757790 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2710-00cb-48d8-a151-256ad0a7d7e6 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:03.757984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2710-00cb-48d8-a151-256ad0a7d7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:03.758244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2710-00cb-48d8-a151-256ad0a7d7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:03.786970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b76b2710-00cb-48d8-a151-256ad0a7d7e6 None None] MFA Rules not processed for user `177f0c9f45f748ba8fcedbc7693c8f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:03.788185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b76b2710-00cb-48d8-a151-256ad0a7d7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:03.820293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:03.852735 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1200/2413] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:03.857374 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086873c-8f71-46e9-b5f0-da94f3acca16 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:03.918660 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086873c-8f71-46e9-b5f0-da94f3acca16 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:03.923349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e29bb3-3ab2-4e8c-8fbf-e3499d5f1a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:03.923960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e29bb3-3ab2-4e8c-8fbf-e3499d5f1a7c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:03.924248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e29bb3-3ab2-4e8c-8fbf-e3499d5f1a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:03.924526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e29bb3-3ab2-4e8c-8fbf-e3499d5f1a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:03.925187 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e29bb3-3ab2-4e8c-8fbf-e3499d5f1a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:03.927120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e29bb3-3ab2-4e8c-8fbf-e3499d5f1a7c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:03.954782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1214/2414] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:34:03 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:34:03.958940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b2710-00cb-48d8-a151-256ad0a7d7e6 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:03.970052 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b2710-00cb-48d8-a151-256ad0a7d7e6 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:04.035049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f86fa0-2256-4eec-9480-5955457a9e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:04.035591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f86fa0-2256-4eec-9480-5955457a9e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:04.035876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f86fa0-2256-4eec-9480-5955457a9e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:04.036154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f86fa0-2256-4eec-9480-5955457a9e50 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:04.036830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f86fa0-2256-4eec-9480-5955457a9e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:04.038918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f86fa0-2256-4eec-9480-5955457a9e50 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:04.060040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1201/2415] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:34:03 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:34:04.064028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e29bb3-3ab2-4e8c-8fbf-e3499d5f1a7c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:04.074699 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e29bb3-3ab2-4e8c-8fbf-e3499d5f1a7c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:04.079242 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64658f-5aaa-4a18-bbf6-a36d90eebafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:04.079846 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64658f-5aaa-4a18-bbf6-a36d90eebafa admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:04.080127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64658f-5aaa-4a18-bbf6-a36d90eebafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:04.080402 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64658f-5aaa-4a18-bbf6-a36d90eebafa admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:04.081087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64658f-5aaa-4a18-bbf6-a36d90eebafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:04.082713 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64658f-5aaa-4a18-bbf6-a36d90eebafa admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:04.093306 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1215/2416] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:34:04.097260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f86fa0-2256-4eec-9480-5955457a9e50 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:04.107149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f86fa0-2256-4eec-9480-5955457a9e50 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:04.111761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad20da5-8169-425e-b871-4ee7ab89ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:04.112412 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20da5-8169-425e-b871-4ee7ab89ae44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:04.112697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20da5-8169-425e-b871-4ee7ab89ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:04.112975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20da5-8169-425e-b871-4ee7ab89ae44 admin admin] PATH_INFO: `/v3/projects/b9d12368b2604c33870f4def5197b5f8/users/a7d976a9ec044d2f9a156e21019e9608/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:04.127966 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad20da5-8169-425e-b871-4ee7ab89ae44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d12368b2604c33870f4def5197b5f8, user_id=a7d976a9ec044d2f9a156e21019e9608, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:04.130650 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad20da5-8169-425e-b871-4ee7ab89ae44 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:04.144112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1202/2417] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:34:04 2022] PUT /identity/v3/projects/b9d12368b2604c33870f4def5197b5f8/users/a7d976a9ec044d2f9a156e21019e9608/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:04.148115 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64658f-5aaa-4a18-bbf6-a36d90eebafa admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:04.158253 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64658f-5aaa-4a18-bbf6-a36d90eebafa admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:04.174829 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:04.218376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62e64f-a970-41c7-ae9d-0d7f035fc55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:04.219093 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62e64f-a970-41c7-ae9d-0d7f035fc55b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:04.219380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62e64f-a970-41c7-ae9d-0d7f035fc55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:04.219661 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62e64f-a970-41c7-ae9d-0d7f035fc55b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:04.220354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62e64f-a970-41c7-ae9d-0d7f035fc55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:04.221954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62e64f-a970-41c7-ae9d-0d7f035fc55b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:04.232277 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1216/2418] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:34:04.236478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad20da5-8169-425e-b871-4ee7ab89ae44 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:04.247025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad20da5-8169-425e-b871-4ee7ab89ae44 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:04.251744 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a2523-08e9-474f-bac6-e7f78c224891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:04.252328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a2523-08e9-474f-bac6-e7f78c224891 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:04.252614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a2523-08e9-474f-bac6-e7f78c224891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:04.252893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a2523-08e9-474f-bac6-e7f78c224891 admin admin] PATH_INFO: `/v3/projects/b9d12368b2604c33870f4def5197b5f8/users/a7d976a9ec044d2f9a156e21019e9608/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:04.254900 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a2523-08e9-474f-bac6-e7f78c224891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d12368b2604c33870f4def5197b5f8, user_id=a7d976a9ec044d2f9a156e21019e9608, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:04.257588 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a2523-08e9-474f-bac6-e7f78c224891 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:04.267626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1203/2419] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:34:04 2022] PUT /identity/v3/projects/b9d12368b2604c33870f4def5197b5f8/users/a7d976a9ec044d2f9a156e21019e9608/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:04.278637 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a05a83-ada6-4742-8fae-50c89287e965 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:04.278958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a05a83-ada6-4742-8fae-50c89287e965 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:04.279263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a05a83-ada6-4742-8fae-50c89287e965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:04.306992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-81a05a83-ada6-4742-8fae-50c89287e965 None None] MFA Rules not processed for user `a7d976a9ec044d2f9a156e21019e9608`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:04.308136 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-81a05a83-ada6-4742-8fae-50c89287e965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:04.374151 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1217/2420] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:04.385163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a2523-08e9-474f-bac6-e7f78c224891 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:04.386877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-bc0a2523-08e9-474f-bac6-e7f78c224891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:04.442021 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a2523-08e9-474f-bac6-e7f78c224891 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:04.446202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d1606-2c78-41c0-92b8-9384818ad7c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:04.446841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d1606-2c78-41c0-92b8-9384818ad7c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:04.447128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d1606-2c78-41c0-92b8-9384818ad7c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:04.447406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d1606-2c78-41c0-92b8-9384818ad7c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:04.456576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d1606-2c78-41c0-92b8-9384818ad7c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:04.458002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d1606-2c78-41c0-92b8-9384818ad7c1 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:04.468413 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1204/2421] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:34:04 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:34:04.602627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a05a83-ada6-4742-8fae-50c89287e965 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:04.662923 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a05a83-ada6-4742-8fae-50c89287e965 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:04.667534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dd854-5b12-4c1a-9b38-d4cd26334822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:04.668177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dd854-5b12-4c1a-9b38-d4cd26334822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:04.668459 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dd854-5b12-4c1a-9b38-d4cd26334822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:04.668735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dd854-5b12-4c1a-9b38-d4cd26334822 admin admin] PATH_INFO: `/v3/users/177f0c9f45f748ba8fcedbc7693c8f8b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:04.669910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dd854-5b12-4c1a-9b38-d4cd26334822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=177f0c9f45f748ba8fcedbc7693c8f8b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:04.671951 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dd854-5b12-4c1a-9b38-d4cd26334822 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:04.715751 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:04.718639 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d12dd854-5b12-4c1a-9b38-d4cd26334822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177f0c9f45f748ba8fcedbc7693c8f8b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:04.726718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d12dd854-5b12-4c1a-9b38-d4cd26334822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177f0c9f45f748ba8fcedbc7693c8f8b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:04.738637 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d12dd854-5b12-4c1a-9b38-d4cd26334822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177f0c9f45f748ba8fcedbc7693c8f8b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:04.739259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d12dd854-5b12-4c1a-9b38-d4cd26334822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177f0c9f45f748ba8fcedbc7693c8f8b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:04.746576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d12dd854-5b12-4c1a-9b38-d4cd26334822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177f0c9f45f748ba8fcedbc7693c8f8b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:04.752287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1218/2422] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:34:04 2022] DELETE /identity/v3/users/177f0c9f45f748ba8fcedbc7693c8f8b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:04.757407 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126e13a-530f-4f0e-a400-181b5eea2d01 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:04.757689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126e13a-530f-4f0e-a400-181b5eea2d01 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:04.757965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126e13a-530f-4f0e-a400-181b5eea2d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:04.776508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-9126e13a-530f-4f0e-a400-181b5eea2d01 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:04.777737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9126e13a-530f-4f0e-a400-181b5eea2d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:04.802366 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:04.836665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1205/2423] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:04.847286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dd854-5b12-4c1a-9b38-d4cd26334822 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:04.848696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d12dd854-5b12-4c1a-9b38-d4cd26334822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:04.904591 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dd854-5b12-4c1a-9b38-d4cd26334822 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:04.908294 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f0b77-5428-4442-81f5-541393ab4b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:04.908859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f0b77-5428-4442-81f5-541393ab4b83 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:04.909139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f0b77-5428-4442-81f5-541393ab4b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:04.909413 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f0b77-5428-4442-81f5-541393ab4b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:04.918445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f0b77-5428-4442-81f5-541393ab4b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:04.919868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f0b77-5428-4442-81f5-541393ab4b83 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:04.929692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1219/2424] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:34:05.200421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126e13a-530f-4f0e-a400-181b5eea2d01 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:05.201877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9126e13a-530f-4f0e-a400-181b5eea2d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:05.214782 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126e13a-530f-4f0e-a400-181b5eea2d01 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:05.219398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:05.220067 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:05.220348 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:05.220622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] PATH_INFO: `/v3/projects/18e177409aed46168aec16dc285209fb` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:05.221807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e177409aed46168aec16dc285209fb)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:05.223762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:05.274574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e177409aed46168aec16dc285209fb', 'request_id': 'req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.281597 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e177409aed46168aec16dc285209fb', 'request_id': 'req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.286978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e177409aed46168aec16dc285209fb', 'request_id': 'req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.297569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] The token cache is being invalidate because project 18e177409aed46168aec16dc285209fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:34:05.297855 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.298504 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.299996 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1206/2425] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:34:05 2022] DELETE /identity/v3/projects/18e177409aed46168aec16dc285209fb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:05.304085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f0b77-5428-4442-81f5-541393ab4b83 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:05.313731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f0b77-5428-4442-81f5-541393ab4b83 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:05.370201 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58402e4-7a8c-4960-b0bf-55a387fc94bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:05.370862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58402e4-7a8c-4960-b0bf-55a387fc94bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:05.371143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58402e4-7a8c-4960-b0bf-55a387fc94bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:05.371417 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58402e4-7a8c-4960-b0bf-55a387fc94bf admin admin] PATH_INFO: `/v3/users/a7d976a9ec044d2f9a156e21019e9608` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:05.372656 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58402e4-7a8c-4960-b0bf-55a387fc94bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d976a9ec044d2f9a156e21019e9608)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:05.374582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58402e4-7a8c-4960-b0bf-55a387fc94bf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:05.420393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c58402e4-7a8c-4960-b0bf-55a387fc94bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d976a9ec044d2f9a156e21019e9608'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.429090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c58402e4-7a8c-4960-b0bf-55a387fc94bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d976a9ec044d2f9a156e21019e9608'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.439667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:05.445532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c58402e4-7a8c-4960-b0bf-55a387fc94bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d976a9ec044d2f9a156e21019e9608'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.446263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c58402e4-7a8c-4960-b0bf-55a387fc94bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d976a9ec044d2f9a156e21019e9608'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.454364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c58402e4-7a8c-4960-b0bf-55a387fc94bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d976a9ec044d2f9a156e21019e9608'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.460404 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1220/2426] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:34:05 2022] DELETE /identity/v3/users/a7d976a9ec044d2f9a156e21019e9608 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:05.724458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:05.726012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:05.739201 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecd47d-ed55-4c70-9003-c5c8fc8fc209 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:05.802947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385fdba-2cfd-43b7-a7da-1df4e230c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:05.804184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385fdba-2cfd-43b7-a7da-1df4e230c758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:05.804470 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385fdba-2cfd-43b7-a7da-1df4e230c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:05.804748 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385fdba-2cfd-43b7-a7da-1df4e230c758 admin admin] PATH_INFO: `/v3/projects/b9d12368b2604c33870f4def5197b5f8` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:05.805901 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385fdba-2cfd-43b7-a7da-1df4e230c758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9d12368b2604c33870f4def5197b5f8)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:05.807892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385fdba-2cfd-43b7-a7da-1df4e230c758 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:05.855540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2385fdba-2cfd-43b7-a7da-1df4e230c758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d12368b2604c33870f4def5197b5f8', 'request_id': 'req-2385fdba-2cfd-43b7-a7da-1df4e230c758'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.863594 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2385fdba-2cfd-43b7-a7da-1df4e230c758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d12368b2604c33870f4def5197b5f8', 'request_id': 'req-2385fdba-2cfd-43b7-a7da-1df4e230c758'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.864836 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:05.871092 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2385fdba-2cfd-43b7-a7da-1df4e230c758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d12368b2604c33870f4def5197b5f8', 'request_id': 'req-2385fdba-2cfd-43b7-a7da-1df4e230c758'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.882874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2385fdba-2cfd-43b7-a7da-1df4e230c758 admin admin] The token cache is being invalidate because project b9d12368b2604c33870f4def5197b5f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:34:05.883163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2385fdba-2cfd-43b7-a7da-1df4e230c758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.883800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2385fdba-2cfd-43b7-a7da-1df4e230c758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:05.885305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1207/2427] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:34:05 2022] DELETE /identity/v3/projects/b9d12368b2604c33870f4def5197b5f8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:05.890146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc409-ee9f-40ed-bf9a-1de1b70a091d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:05.890461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc409-ee9f-40ed-bf9a-1de1b70a091d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:05.890743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc409-ee9f-40ed-bf9a-1de1b70a091d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:05.909745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cb8bc409-ee9f-40ed-bf9a-1de1b70a091d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:05.910907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cb8bc409-ee9f-40ed-bf9a-1de1b70a091d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:05.971105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1221/2428] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:05.981329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f462674-8c31-4a53-afdb-d60cc05b66d9 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:05.981619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f462674-8c31-4a53-afdb-d60cc05b66d9 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:05.981895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f462674-8c31-4a53-afdb-d60cc05b66d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:06.001399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-3f462674-8c31-4a53-afdb-d60cc05b66d9 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:06.002625 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3f462674-8c31-4a53-afdb-d60cc05b66d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:06.011120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1208/2429] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:06.015347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bc409-ee9f-40ed-bf9a-1de1b70a091d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:06.025635 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bc409-ee9f-40ed-bf9a-1de1b70a091d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:06.030250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233f2bf-234d-469d-b9f1-d14679822542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:06.030887 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233f2bf-234d-469d-b9f1-d14679822542 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:06.031171 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233f2bf-234d-469d-b9f1-d14679822542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:06.031448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233f2bf-234d-469d-b9f1-d14679822542 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:06.032143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233f2bf-234d-469d-b9f1-d14679822542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:34:06.032451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233f2bf-234d-469d-b9f1-d14679822542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:06.034041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233f2bf-234d-469d-b9f1-d14679822542 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:06.045788 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1222/2430] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:34:06.050197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f462674-8c31-4a53-afdb-d60cc05b66d9 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:06.059710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f462674-8c31-4a53-afdb-d60cc05b66d9 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:06.064427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4ae48-c47d-4c67-a410-8f96a92e347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:06.065040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4ae48-c47d-4c67-a410-8f96a92e347e admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:06.065325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4ae48-c47d-4c67-a410-8f96a92e347e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:06.065609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4ae48-c47d-4c67-a410-8f96a92e347e admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:06.066270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4ae48-c47d-4c67-a410-8f96a92e347e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:06.068219 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4ae48-c47d-4c67-a410-8f96a92e347e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:06.096951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1209/2431] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:34:06 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:34:06.101059 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233f2bf-234d-469d-b9f1-d14679822542 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:06.114272 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233f2bf-234d-469d-b9f1-d14679822542 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:06.170960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b20e0-632a-496f-b07a-28aa6574ee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:06.171497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b20e0-632a-496f-b07a-28aa6574ee86 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:06.171781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b20e0-632a-496f-b07a-28aa6574ee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:06.172057 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b20e0-632a-496f-b07a-28aa6574ee86 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:06.172816 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b20e0-632a-496f-b07a-28aa6574ee86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:06.174805 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b20e0-632a-496f-b07a-28aa6574ee86 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:06.196248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1223/2432] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:34:06 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:34:06.200534 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4ae48-c47d-4c67-a410-8f96a92e347e admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:06.211807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4ae48-c47d-4c67-a410-8f96a92e347e admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:06.216672 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f55116-269f-4a94-a735-4232bbb8156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:06.217308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f55116-269f-4a94-a735-4232bbb8156e admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:06.217589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f55116-269f-4a94-a735-4232bbb8156e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:06.217862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f55116-269f-4a94-a735-4232bbb8156e admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:06.218591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f55116-269f-4a94-a735-4232bbb8156e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:06.220175 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f55116-269f-4a94-a735-4232bbb8156e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:06.230065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1210/2433] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:34:06.234127 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b20e0-632a-496f-b07a-28aa6574ee86 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:06.244450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b20e0-632a-496f-b07a-28aa6574ee86 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:06.249087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11df7e8-0b03-4125-a672-60043f76a7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:06.249688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11df7e8-0b03-4125-a672-60043f76a7fc admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:06.249975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11df7e8-0b03-4125-a672-60043f76a7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:06.250253 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11df7e8-0b03-4125-a672-60043f76a7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:06.250990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11df7e8-0b03-4125-a672-60043f76a7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:06.252618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11df7e8-0b03-4125-a672-60043f76a7fc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:06.263670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1224/2434] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:34:06.268000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f55116-269f-4a94-a735-4232bbb8156e admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:06.278230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f55116-269f-4a94-a735-4232bbb8156e admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:06.282894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b33160-0038-44f0-bdf3-6f89184d9480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:06.283550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33160-0038-44f0-bdf3-6f89184d9480 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:06.283865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33160-0038-44f0-bdf3-6f89184d9480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:06.284143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33160-0038-44f0-bdf3-6f89184d9480 admin admin] PATH_INFO: `/v3/projects/feb4273288184f04b98e10855a4e996c/users/54f8b61d76304f8cbff5ef1a5016271b/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:06.298431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b33160-0038-44f0-bdf3-6f89184d9480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb4273288184f04b98e10855a4e996c, user_id=54f8b61d76304f8cbff5ef1a5016271b, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:06.301096 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b33160-0038-44f0-bdf3-6f89184d9480 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:06.314164 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1211/2435] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:34:06 2022] PUT /identity/v3/projects/feb4273288184f04b98e10855a4e996c/users/54f8b61d76304f8cbff5ef1a5016271b/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:06.325870 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a2ef3-3a53-4ae8-92eb-08e498fe2365 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:06.326351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a2ef3-3a53-4ae8-92eb-08e498fe2365 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:06.326485 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a2ef3-3a53-4ae8-92eb-08e498fe2365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:06.353271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c09a2ef3-3a53-4ae8-92eb-08e498fe2365 None None] MFA Rules not processed for user `54f8b61d76304f8cbff5ef1a5016271b`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:06.354490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c09a2ef3-3a53-4ae8-92eb-08e498fe2365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:06.392058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:06.418948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1225/2436] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:06 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:06.431424 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b33160-0038-44f0-bdf3-6f89184d9480 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:06.433072 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d5b33160-0038-44f0-bdf3-6f89184d9480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:06.490439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b33160-0038-44f0-bdf3-6f89184d9480 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:06.494597 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d723d-dd74-462c-ae58-5d81395f373c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:06.495214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d723d-dd74-462c-ae58-5d81395f373c service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:06.495495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d723d-dd74-462c-ae58-5d81395f373c service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:06.495771 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d723d-dd74-462c-ae58-5d81395f373c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:06.503920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d723d-dd74-462c-ae58-5d81395f373c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:06.505337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d723d-dd74-462c-ae58-5d81395f373c service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:06.514671 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1212/2437] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:34:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:34:11.483240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a2ef3-3a53-4ae8-92eb-08e498fe2365 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:11.544128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a2ef3-3a53-4ae8-92eb-08e498fe2365 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:11.548614 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8af7a-e9ff-454f-a5fb-878e702f11dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:11.549241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8af7a-e9ff-454f-a5fb-878e702f11dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:11.549519 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8af7a-e9ff-454f-a5fb-878e702f11dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:11.549790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8af7a-e9ff-454f-a5fb-878e702f11dd admin admin] PATH_INFO: `/v3/users/54f8b61d76304f8cbff5ef1a5016271b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:11.550946 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8af7a-e9ff-454f-a5fb-878e702f11dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f8b61d76304f8cbff5ef1a5016271b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:11.552851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8af7a-e9ff-454f-a5fb-878e702f11dd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:11.596974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9ec8af7a-e9ff-454f-a5fb-878e702f11dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f8b61d76304f8cbff5ef1a5016271b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:11.604891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9ec8af7a-e9ff-454f-a5fb-878e702f11dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f8b61d76304f8cbff5ef1a5016271b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:11.617589 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9ec8af7a-e9ff-454f-a5fb-878e702f11dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f8b61d76304f8cbff5ef1a5016271b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:11.618226 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9ec8af7a-e9ff-454f-a5fb-878e702f11dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f8b61d76304f8cbff5ef1a5016271b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:11.625175 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9ec8af7a-e9ff-454f-a5fb-878e702f11dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f8b61d76304f8cbff5ef1a5016271b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:11.631067 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1226/2438] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:34:11 2022] DELETE /identity/v3/users/54f8b61d76304f8cbff5ef1a5016271b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:11.636080 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7335b9-c296-4e67-96cc-142fba665763 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:11.636532 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7335b9-c296-4e67-96cc-142fba665763 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:11.636654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7335b9-c296-4e67-96cc-142fba665763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:11.655108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-da7335b9-c296-4e67-96cc-142fba665763 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:11.656313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-da7335b9-c296-4e67-96cc-142fba665763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:11.721298 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1213/2439] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:11.728258 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8af7a-e9ff-454f-a5fb-878e702f11dd admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:11.729692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9ec8af7a-e9ff-454f-a5fb-878e702f11dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:11.786801 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8af7a-e9ff-454f-a5fb-878e702f11dd admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:11.796265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000d222-b044-44ac-86bd-61c269e4fc86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:11.796890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000d222-b044-44ac-86bd-61c269e4fc86 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:11.797164 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000d222-b044-44ac-86bd-61c269e4fc86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:11.797434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000d222-b044-44ac-86bd-61c269e4fc86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:11.806963 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000d222-b044-44ac-86bd-61c269e4fc86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:11.808397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000d222-b044-44ac-86bd-61c269e4fc86 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:11.813285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:11.819516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1227/2440] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:34:12.087982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7335b9-c296-4e67-96cc-142fba665763 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:12.090202 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-da7335b9-c296-4e67-96cc-142fba665763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:12.106181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7335b9-c296-4e67-96cc-142fba665763 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:12.110908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:12.111770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:12.112057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:12.112330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99 admin admin] PATH_INFO: `/v3/projects/feb4273288184f04b98e10855a4e996c` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:12.113613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb4273288184f04b98e10855a4e996c)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:12.115426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:12.137401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:12.163959 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb4273288184f04b98e10855a4e996c', 'request_id': 'req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:12.171072 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb4273288184f04b98e10855a4e996c', 'request_id': 'req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:12.176698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb4273288184f04b98e10855a4e996c', 'request_id': 'req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:12.188806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99 admin admin] The token cache is being invalidate because project feb4273288184f04b98e10855a4e996c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:34:12.189097 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:12.189733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c0868d9b-0940-4d4e-a3ce-5d0bd4d02f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:34:12.191292 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1214/2441] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:34:12 2022] DELETE /identity/v3/projects/feb4273288184f04b98e10855a4e996c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:12.196862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc8b2-85ba-432f-adf8-0eedbfbca2fd None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:12.197173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc8b2-85ba-432f-adf8-0eedbfbca2fd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:12.197439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc8b2-85ba-432f-adf8-0eedbfbca2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:12.217280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-eb5dc8b2-85ba-432f-adf8-0eedbfbca2fd None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:12.218515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-eb5dc8b2-85ba-432f-adf8-0eedbfbca2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:12.277631 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1228/2442] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:12.285820 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a0d80-8abc-4458-9fae-78e525362344 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:12.286114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a0d80-8abc-4458-9fae-78e525362344 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:12.286438 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a0d80-8abc-4458-9fae-78e525362344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:12.306881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5a8a0d80-8abc-4458-9fae-78e525362344 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:12.308082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5a8a0d80-8abc-4458-9fae-78e525362344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:12.316186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1215/2443] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:12.320918 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dc8b2-85ba-432f-adf8-0eedbfbca2fd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:12.330635 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dc8b2-85ba-432f-adf8-0eedbfbca2fd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:12.335296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78251132-a4a5-4080-abe3-1d525f105616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:12.335900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251132-a4a5-4080-abe3-1d525f105616 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:12.336186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251132-a4a5-4080-abe3-1d525f105616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:12.336491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251132-a4a5-4080-abe3-1d525f105616 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:12.337215 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78251132-a4a5-4080-abe3-1d525f105616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:34:12.337524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78251132-a4a5-4080-abe3-1d525f105616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:12.339420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78251132-a4a5-4080-abe3-1d525f105616 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:12.350909 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1229/2444] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:34:12.355149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a0d80-8abc-4458-9fae-78e525362344 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:12.364393 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a0d80-8abc-4458-9fae-78e525362344 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:12.369465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06644c8-2e76-4c03-a4bf-82aa5f8aceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:12.370064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06644c8-2e76-4c03-a4bf-82aa5f8aceb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:12.370343 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06644c8-2e76-4c03-a4bf-82aa5f8aceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:12.370650 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06644c8-2e76-4c03-a4bf-82aa5f8aceb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:12.371306 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06644c8-2e76-4c03-a4bf-82aa5f8aceb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:12.373192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06644c8-2e76-4c03-a4bf-82aa5f8aceb8 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:12.400497 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1216/2445] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:34:12 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:34:12.404574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78251132-a4a5-4080-abe3-1d525f105616 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:12.414599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78251132-a4a5-4080-abe3-1d525f105616 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:12.470726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70786c2d-0539-4393-a302-15d0deb7b71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:12.471346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70786c2d-0539-4393-a302-15d0deb7b71d admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:12.471635 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70786c2d-0539-4393-a302-15d0deb7b71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:12.471906 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70786c2d-0539-4393-a302-15d0deb7b71d admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:12.472564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70786c2d-0539-4393-a302-15d0deb7b71d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:12.474495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70786c2d-0539-4393-a302-15d0deb7b71d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:12.495631 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1230/2446] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:34:12 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:34:12.499518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06644c8-2e76-4c03-a4bf-82aa5f8aceb8 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:12.510382 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06644c8-2e76-4c03-a4bf-82aa5f8aceb8 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:12.515004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271a117-eebf-446a-aa5b-0c5dda62450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:12.515609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271a117-eebf-446a-aa5b-0c5dda62450f admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:12.515895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271a117-eebf-446a-aa5b-0c5dda62450f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:12.516201 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271a117-eebf-446a-aa5b-0c5dda62450f admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:12.516899 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271a117-eebf-446a-aa5b-0c5dda62450f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:12.518587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271a117-eebf-446a-aa5b-0c5dda62450f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:12.528356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1217/2447] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:34:12.532100 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70786c2d-0539-4393-a302-15d0deb7b71d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:12.542601 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70786c2d-0539-4393-a302-15d0deb7b71d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:12.548411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630167-e144-4db8-a11f-1b20d69c59fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:12.549019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630167-e144-4db8-a11f-1b20d69c59fc admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:12.549304 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630167-e144-4db8-a11f-1b20d69c59fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:12.549581 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630167-e144-4db8-a11f-1b20d69c59fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:12.550275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630167-e144-4db8-a11f-1b20d69c59fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:12.551903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630167-e144-4db8-a11f-1b20d69c59fc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:12.566962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1231/2448] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:34:12.571606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271a117-eebf-446a-aa5b-0c5dda62450f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:12.581425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271a117-eebf-446a-aa5b-0c5dda62450f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:12.585999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c304bb-18db-492e-974c-5909e08cf49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:12.586681 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c304bb-18db-492e-974c-5909e08cf49d admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:12.586962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c304bb-18db-492e-974c-5909e08cf49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:12.587236 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c304bb-18db-492e-974c-5909e08cf49d admin admin] PATH_INFO: `/v3/projects/f2bf768cef8849d3b2960a532462d1a0/users/edab125fd6ea4d2391ccae33e4e732ef/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:12.602560 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c304bb-18db-492e-974c-5909e08cf49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2bf768cef8849d3b2960a532462d1a0, user_id=edab125fd6ea4d2391ccae33e4e732ef, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:12.605212 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c304bb-18db-492e-974c-5909e08cf49d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:12.618628 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1218/2449] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:34:12 2022] PUT /identity/v3/projects/f2bf768cef8849d3b2960a532462d1a0/users/edab125fd6ea4d2391ccae33e4e732ef/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:12.623693 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e169752-481c-455f-a8d5-e19fd7f866b4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:12.623988 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e169752-481c-455f-a8d5-e19fd7f866b4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:12.624267 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e169752-481c-455f-a8d5-e19fd7f866b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:12.642852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8e169752-481c-455f-a8d5-e19fd7f866b4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:12.644053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8e169752-481c-455f-a8d5-e19fd7f866b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:12.701920 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1232/2450] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:12.711538 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c304bb-18db-492e-974c-5909e08cf49d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:12.713213 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e3c304bb-18db-492e-974c-5909e08cf49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:12.772328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c304bb-18db-492e-974c-5909e08cf49d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:12.776280 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6ea2b-e27a-47da-a254-fdd1abc6082f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:12.776897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6ea2b-e27a-47da-a254-fdd1abc6082f service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:12.777179 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6ea2b-e27a-47da-a254-fdd1abc6082f service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:12.777457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6ea2b-e27a-47da-a254-fdd1abc6082f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:12.786520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6ea2b-e27a-47da-a254-fdd1abc6082f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:12.788457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6ea2b-e27a-47da-a254-fdd1abc6082f service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:12.797962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1219/2451] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:34:16.831764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58a9e9-853d-44f4-9fcd-b4fcf4667184 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:16.832242 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58a9e9-853d-44f4-9fcd-b4fcf4667184 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:16.832353 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58a9e9-853d-44f4-9fcd-b4fcf4667184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:16.847363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:16.864150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bf58a9e9-853d-44f4-9fcd-b4fcf4667184 None None] MFA Rules not processed for user `edab125fd6ea4d2391ccae33e4e732ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:16.865267 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bf58a9e9-853d-44f4-9fcd-b4fcf4667184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:16.933852 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1233/2452] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:16.937872 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6ea2b-e27a-47da-a254-fdd1abc6082f service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:16.947975 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6ea2b-e27a-47da-a254-fdd1abc6082f service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:16.952632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed725e-588e-4fb1-8509-97e8073d2341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:16.953251 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed725e-588e-4fb1-8509-97e8073d2341 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:16.953537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed725e-588e-4fb1-8509-97e8073d2341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:16.953814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed725e-588e-4fb1-8509-97e8073d2341 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:16.954515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed725e-588e-4fb1-8509-97e8073d2341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:16.956421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed725e-588e-4fb1-8509-97e8073d2341 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:16.988558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1220/2453] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:34:16 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:34:16.989812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58a9e9-853d-44f4-9fcd-b4fcf4667184 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:17.001186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58a9e9-853d-44f4-9fcd-b4fcf4667184 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:17.059141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d915456-6eed-4fb3-8bdb-053302c8c09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:17.059768 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d915456-6eed-4fb3-8bdb-053302c8c09c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:17.060054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d915456-6eed-4fb3-8bdb-053302c8c09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:17.060332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d915456-6eed-4fb3-8bdb-053302c8c09c admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:17.061001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d915456-6eed-4fb3-8bdb-053302c8c09c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:17.063070 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d915456-6eed-4fb3-8bdb-053302c8c09c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:17.086196 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1234/2454] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:34:16 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:34:17.090393 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed725e-588e-4fb1-8509-97e8073d2341 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:17.101460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed725e-588e-4fb1-8509-97e8073d2341 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:17.106531 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857856f-4f0d-41d0-b434-08bec1f0feca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:17.107150 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857856f-4f0d-41d0-b434-08bec1f0feca admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:17.107547 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857856f-4f0d-41d0-b434-08bec1f0feca admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:17.107861 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857856f-4f0d-41d0-b434-08bec1f0feca admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:17.108523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857856f-4f0d-41d0-b434-08bec1f0feca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:17.110124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857856f-4f0d-41d0-b434-08bec1f0feca admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:17.121331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1221/2455] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:34:17.125893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d915456-6eed-4fb3-8bdb-053302c8c09c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:17.137239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d915456-6eed-4fb3-8bdb-053302c8c09c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:17.141910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32ddf4-ae21-4c0d-8927-0c2a62d8d177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:17.142602 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ddf4-ae21-4c0d-8927-0c2a62d8d177 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:17.142881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ddf4-ae21-4c0d-8927-0c2a62d8d177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:17.143150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ddf4-ae21-4c0d-8927-0c2a62d8d177 admin admin] PATH_INFO: `/v3/projects/a64e7657f80144a1974586e9e7f1f533/users/f6e212008fbe4eb9a41049dfab81c5a6/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:17.160112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32ddf4-ae21-4c0d-8927-0c2a62d8d177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64e7657f80144a1974586e9e7f1f533, user_id=f6e212008fbe4eb9a41049dfab81c5a6, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:17.162883 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32ddf4-ae21-4c0d-8927-0c2a62d8d177 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:17.182193 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1235/2456] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:34:17 2022] PUT /identity/v3/projects/a64e7657f80144a1974586e9e7f1f533/users/f6e212008fbe4eb9a41049dfab81c5a6/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:17.186336 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857856f-4f0d-41d0-b434-08bec1f0feca admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:17.197191 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857856f-4f0d-41d0-b434-08bec1f0feca admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:17.208209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:17.264622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc444d1-ce2b-46f5-8006-db3852be12f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:17.265263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc444d1-ce2b-46f5-8006-db3852be12f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:17.265548 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc444d1-ce2b-46f5-8006-db3852be12f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:17.265823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc444d1-ce2b-46f5-8006-db3852be12f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:17.266560 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc444d1-ce2b-46f5-8006-db3852be12f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:17.268211 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc444d1-ce2b-46f5-8006-db3852be12f5 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:17.279114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1222/2457] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:34:17.283405 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32ddf4-ae21-4c0d-8927-0c2a62d8d177 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:17.293940 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32ddf4-ae21-4c0d-8927-0c2a62d8d177 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:17.298663 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b778402-e943-47e6-862a-ce80cd77e2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:17.299332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b778402-e943-47e6-862a-ce80cd77e2fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:17.299618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b778402-e943-47e6-862a-ce80cd77e2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:17.299894 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b778402-e943-47e6-862a-ce80cd77e2fc admin admin] PATH_INFO: `/v3/projects/a64e7657f80144a1974586e9e7f1f533/users/f6e212008fbe4eb9a41049dfab81c5a6/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:17.302062 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b778402-e943-47e6-862a-ce80cd77e2fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64e7657f80144a1974586e9e7f1f533, user_id=f6e212008fbe4eb9a41049dfab81c5a6, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:17.304781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b778402-e943-47e6-862a-ce80cd77e2fc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:17.316159 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1236/2458] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:34:17 2022] PUT /identity/v3/projects/a64e7657f80144a1974586e9e7f1f533/users/f6e212008fbe4eb9a41049dfab81c5a6/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:34:21.645097 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcb008-d621-4e55-b5be-b286abc4a191 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:21.645633 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcb008-d621-4e55-b5be-b286abc4a191 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:21.645633 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcb008-d621-4e55-b5be-b286abc4a191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:21.675921 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-f0fcb008-d621-4e55-b5be-b286abc4a191 None None] MFA Rules not processed for user `f6e212008fbe4eb9a41049dfab81c5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:21.677168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f0fcb008-d621-4e55-b5be-b286abc4a191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:21.755069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1223/2459] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:21.772742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b778402-e943-47e6-862a-ce80cd77e2fc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:21.774927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1b778402-e943-47e6-862a-ce80cd77e2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:21.837865 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:21.864865 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b778402-e943-47e6-862a-ce80cd77e2fc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:21.872390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6d83b-7f9f-4b13-86cf-d59c804844e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:21.873047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6d83b-7f9f-4b13-86cf-d59c804844e2 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:21.873331 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6d83b-7f9f-4b13-86cf-d59c804844e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:21.873613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6d83b-7f9f-4b13-86cf-d59c804844e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:21.936713 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6d83b-7f9f-4b13-86cf-d59c804844e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:21.940032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6d83b-7f9f-4b13-86cf-d59c804844e2 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:21.963440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1237/2460] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:34:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:34:22.830328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcb008-d621-4e55-b5be-b286abc4a191 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:22.831764 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f0fcb008-d621-4e55-b5be-b286abc4a191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:22.911054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcb008-d621-4e55-b5be-b286abc4a191 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:22.918034 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3490590-011f-4817-8088-7320103a53f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2448489cc4ad1a6fd3096ebd3f746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:22.918520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3490590-011f-4817-8088-7320103a53f1 service placement] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:22.918810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3490590-011f-4817-8088-7320103a53f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:22.919231 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3490590-011f-4817-8088-7320103a53f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:22.921585 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e3490590-011f-4817-8088-7320103a53f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:22.936649 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3490590-011f-4817-8088-7320103a53f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:22.938685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3490590-011f-4817-8088-7320103a53f1 service placement] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:22.950512 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1224/2461] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:34:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:34:23.051902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2385c67-d805-424a-92ba-f373727a3f37 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:23.051902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2385c67-d805-424a-92ba-f373727a3f37 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:23.052381 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2385c67-d805-424a-92ba-f373727a3f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:23.072764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b2385c67-d805-424a-92ba-f373727a3f37 None None] MFA Rules not processed for user `edab125fd6ea4d2391ccae33e4e732ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:34:23.074213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b2385c67-d805-424a-92ba-f373727a3f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:23.081060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1238/2462] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:34:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:34:32.946083 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:33.065479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=37 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:34:48.062064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3490590-011f-4817-8088-7320103a53f1 service placement] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:34:48.063478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e3490590-011f-4817-8088-7320103a53f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:48.119159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3490590-011f-4817-8088-7320103a53f1 service placement] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:34:48.122700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0db7a-352a-4a62-9e23-3b49a969fd0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:34:48.123305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0db7a-352a-4a62-9e23-3b49a969fd0f service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:34:48.123581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0db7a-352a-4a62-9e23-3b49a969fd0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:34:48.123848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0db7a-352a-4a62-9e23-3b49a969fd0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:34:48.125562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6ba0db7a-352a-4a62-9e23-3b49a969fd0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:34:48.134762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0db7a-352a-4a62-9e23-3b49a969fd0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:34:48.136166 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0db7a-352a-4a62-9e23-3b49a969fd0f service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:34:48.143952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1225/2463] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:34:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:34:58.140496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=26 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:35:02.873143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2385c67-d805-424a-92ba-f373727a3f37 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:35:02.882969 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2385c67-d805-424a-92ba-f373727a3f37 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:35:02.886694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69439965-52e6-4893-858e-f94a9c5963b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:35:02.887950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439965-52e6-4893-858e-f94a9c5963b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:35:02.887950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439965-52e6-4893-858e-f94a9c5963b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:35:02.887950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439965-52e6-4893-858e-f94a9c5963b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:35:02.897302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69439965-52e6-4893-858e-f94a9c5963b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:35:02.898888 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69439965-52e6-4893-858e-f94a9c5963b0 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:35:02.909021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1239/2464] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:35:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:35:07.503762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7b0b-1c2f-4596-9dfb-e3d967b1fb52 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:35:07.504266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7b0b-1c2f-4596-9dfb-e3d967b1fb52 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:35:07.504376 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7b0b-1c2f-4596-9dfb-e3d967b1fb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:35:07.533433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-414e7b0b-1c2f-4596-9dfb-e3d967b1fb52 None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:35:07.534651 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-414e7b0b-1c2f-4596-9dfb-e3d967b1fb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:35:07.587555 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1226/2465] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:35:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:35:07.635539 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69439965-52e6-4893-858e-f94a9c5963b0 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:35:07.636997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-69439965-52e6-4893-858e-f94a9c5963b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:35:07.705825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69439965-52e6-4893-858e-f94a9c5963b0 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:35:07.710731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4d0ef-67fc-4f58-b578-d346ab58c955 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:35:07.711330 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4d0ef-67fc-4f58-b578-d346ab58c955 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:35:07.711608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4d0ef-67fc-4f58-b578-d346ab58c955 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:35:07.711879 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4d0ef-67fc-4f58-b578-d346ab58c955 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:35:07.720507 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4d0ef-67fc-4f58-b578-d346ab58c955 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:35:07.722023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4d0ef-67fc-4f58-b578-d346ab58c955 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:35:07.730349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1240/2466] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:35:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:35:17.583096 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=29 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:35:17.726800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=38 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:35:27.993727 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7b0b-1c2f-4596-9dfb-e3d967b1fb52 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:35:27.995197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-414e7b0b-1c2f-4596-9dfb-e3d967b1fb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:35:28.053005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7b0b-1c2f-4596-9dfb-e3d967b1fb52 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:35:28.056451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a23af-6473-49e0-8770-7d23393d9e74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce7db16c4904fb1b75ac7910f4470f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:35:28.057064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a23af-6473-49e0-8770-7d23393d9e74 service glance] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:35:28.057339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a23af-6473-49e0-8770-7d23393d9e74 service glance] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:35:28.057614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a23af-6473-49e0-8770-7d23393d9e74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:35:28.060124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-af3a23af-6473-49e0-8770-7d23393d9e74 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:35:28.074001 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a23af-6473-49e0-8770-7d23393d9e74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:35:28.075393 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a23af-6473-49e0-8770-7d23393d9e74 service glance] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:35:28.086542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1227/2467] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:35:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:35:28.157117 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4d0ef-67fc-4f58-b578-d346ab58c955 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:35:28.166790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4d0ef-67fc-4f58-b578-d346ab58c955 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:35:28.170948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d88ed-bbb3-4e53-a2e8-90052b439eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:35:28.171543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d88ed-bbb3-4e53-a2e8-90052b439eaa service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:35:28.171820 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d88ed-bbb3-4e53-a2e8-90052b439eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:35:28.172090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d88ed-bbb3-4e53-a2e8-90052b439eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:35:28.173849 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c53d88ed-bbb3-4e53-a2e8-90052b439eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:35:28.182913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d88ed-bbb3-4e53-a2e8-90052b439eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:35:28.184348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d88ed-bbb3-4e53-a2e8-90052b439eaa service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:35:28.192335 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1241/2468] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:35:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:35:28.264999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a23af-6473-49e0-8770-7d23393d9e74 service glance] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:35:28.274614 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a23af-6473-49e0-8770-7d23393d9e74 service glance] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:35:28.278732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d95ea-2f9f-4f55-aac6-add0f37a782d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:35:28.279343 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d95ea-2f9f-4f55-aac6-add0f37a782d service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:35:28.279626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d95ea-2f9f-4f55-aac6-add0f37a782d service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:35:28.279902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d95ea-2f9f-4f55-aac6-add0f37a782d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:35:28.281700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4c6d95ea-2f9f-4f55-aac6-add0f37a782d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:35:28.295607 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d95ea-2f9f-4f55-aac6-add0f37a782d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:35:28.297018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d95ea-2f9f-4f55-aac6-add0f37a782d service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:35:28.307804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1228/2469] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:35:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:35:30.865520 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bfb91-41a0-4806-a6fd-e935e79a1d74 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:35:30.866008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bfb91-41a0-4806-a6fd-e935e79a1d74 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:35:30.866152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bfb91-41a0-4806-a6fd-e935e79a1d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:35:30.887082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d13bfb91-41a0-4806-a6fd-e935e79a1d74 None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:35:30.888302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d13bfb91-41a0-4806-a6fd-e935e79a1d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:35:30.899829 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1242/2470] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:35:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:35:30.914674 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d95ea-2f9f-4f55-aac6-add0f37a782d service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:35:30.926778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d95ea-2f9f-4f55-aac6-add0f37a782d service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:35:30.931950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd13859-a928-433f-a791-8936bd9e0abe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:35:30.932568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd13859-a928-433f-a791-8936bd9e0abe service swift] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:35:30.932852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd13859-a928-433f-a791-8936bd9e0abe service swift] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:35:30.933131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd13859-a928-433f-a791-8936bd9e0abe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:35:30.941464 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd13859-a928-433f-a791-8936bd9e0abe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:35:30.943186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd13859-a928-433f-a791-8936bd9e0abe service swift] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:35:30.951717 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1229/2471] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:35:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:35:38.687235 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bfb91-41a0-4806-a6fd-e935e79a1d74 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:35:38.697200 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bfb91-41a0-4806-a6fd-e935e79a1d74 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:35:38.701430 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e569e46-e6a6-4c72-b0e4-e06cfefd2640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:35:38.702048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e569e46-e6a6-4c72-b0e4-e06cfefd2640 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:35:38.702329 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e569e46-e6a6-4c72-b0e4-e06cfefd2640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:35:38.702634 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e569e46-e6a6-4c72-b0e4-e06cfefd2640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:35:38.704383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0e569e46-e6a6-4c72-b0e4-e06cfefd2640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:35:38.719497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e569e46-e6a6-4c72-b0e4-e06cfefd2640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:35:38.720871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e569e46-e6a6-4c72-b0e4-e06cfefd2640 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:35:38.731916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1243/2472] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:35:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:35:40.947936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=38 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:35:44.709884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd13859-a928-433f-a791-8936bd9e0abe service swift] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:35:44.719517 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd13859-a928-433f-a791-8936bd9e0abe service swift] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:35:44.723231 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b8ddc-8c1f-4668-a871-59ab83151b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:35:44.723837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b8ddc-8c1f-4668-a871-59ab83151b2d service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:35:44.724119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b8ddc-8c1f-4668-a871-59ab83151b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:35:44.724393 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b8ddc-8c1f-4668-a871-59ab83151b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:35:44.726122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7e6b8ddc-8c1f-4668-a871-59ab83151b2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:35:44.740159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b8ddc-8c1f-4668-a871-59ab83151b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:35:44.741698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b8ddc-8c1f-4668-a871-59ab83151b2d service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:35:44.753992 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1230/2473] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:35:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:35:48.727068 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=15 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:35:54.748738 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=6 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:35:58.888259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775a582-3c0f-48b5-a416-8d326ab96787 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:35:58.888752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775a582-3c0f-48b5-a416-8d326ab96787 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:35:58.888859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775a582-3c0f-48b5-a416-8d326ab96787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:35:58.910666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2775a582-3c0f-48b5-a416-8d326ab96787 None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:35:58.911880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2775a582-3c0f-48b5-a416-8d326ab96787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:35:58.919633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1244/2474] 10.222.0.27 () {58 vars in 967 bytes} [Thu Aug 4 22:35:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:35:58.940566 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b8ddc-8c1f-4668-a871-59ab83151b2d service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:35:58.952639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b8ddc-8c1f-4668-a871-59ab83151b2d service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:35:58.958909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c24fc-01b7-40d8-92a1-f2c05ef2186b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:35:58.960205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c24fc-01b7-40d8-92a1-f2c05ef2186b service swift] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:35:58.962269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c24fc-01b7-40d8-92a1-f2c05ef2186b service swift] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:35:58.962754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c24fc-01b7-40d8-92a1-f2c05ef2186b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:35:58.974363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c24fc-01b7-40d8-92a1-f2c05ef2186b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:35:58.976060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c24fc-01b7-40d8-92a1-f2c05ef2186b service swift] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:35:58.986758 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1231/2475] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:35:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:36:01.900517 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766349d3-2e5f-4ca0-99f3-80e183c5a030 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:01.900988 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766349d3-2e5f-4ca0-99f3-80e183c5a030 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:01.901108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766349d3-2e5f-4ca0-99f3-80e183c5a030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:01.920922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-766349d3-2e5f-4ca0-99f3-80e183c5a030 None None] MFA Rules not processed for user `bf807d1c7e6244edbf3f4d8fae5fe67d`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:01.922125 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-766349d3-2e5f-4ca0-99f3-80e183c5a030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:01.975165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1245/2476] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:07.005294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c24fc-01b7-40d8-92a1-f2c05ef2186b service swift] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:07.014606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c24fc-01b7-40d8-92a1-f2c05ef2186b service swift] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:07.018536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7f5b9-f20f-4d7f-8dcd-3768a5e611d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:07.019140 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7f5b9-f20f-4d7f-8dcd-3768a5e611d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:07.019419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7f5b9-f20f-4d7f-8dcd-3768a5e611d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:07.019691 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7f5b9-f20f-4d7f-8dcd-3768a5e611d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:07.021410 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5de7f5b9-f20f-4d7f-8dcd-3768a5e611d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:07.030603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7f5b9-f20f-4d7f-8dcd-3768a5e611d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:07.032007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7f5b9-f20f-4d7f-8dcd-3768a5e611d3 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:07.039985 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1232/2477] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:36:11.968819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=28 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:17.036283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=12 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:22.471603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766349d3-2e5f-4ca0-99f3-80e183c5a030 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:22.482089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766349d3-2e5f-4ca0-99f3-80e183c5a030 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:22.485663 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66888bcc-b64f-441e-9d8e-6b3d607b1923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:22.486269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888bcc-b64f-441e-9d8e-6b3d607b1923 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:22.486574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888bcc-b64f-441e-9d8e-6b3d607b1923 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:22.486848 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888bcc-b64f-441e-9d8e-6b3d607b1923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:22.488583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-66888bcc-b64f-441e-9d8e-6b3d607b1923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:22.549228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66888bcc-b64f-441e-9d8e-6b3d607b1923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:22.550690 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66888bcc-b64f-441e-9d8e-6b3d607b1923 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:22.560670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1246/2478] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:36:25.651569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320cd80-bd50-49e9-97cc-a5c8a4be992e None None] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:25.652063 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320cd80-bd50-49e9-97cc-a5c8a4be992e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:25.652162 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320cd80-bd50-49e9-97cc-a5c8a4be992e None None] PATH_INFO: `/` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:25.654296 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1233/2479] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 4 22:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:36:25.682614 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2764-34b3-4316-9dd7-485d060ab81e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:25.683163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2764-34b3-4316-9dd7-485d060ab81e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:25.683302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd2764-34b3-4316-9dd7-485d060ab81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:25.718051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320cd80-bd50-49e9-97cc-a5c8a4be992e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:25.720157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7320cd80-bd50-49e9-97cc-a5c8a4be992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:25.726000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5fcd2764-34b3-4316-9dd7-485d060ab81e None None] MFA Rules not processed for user `94b2448489cc4ad1a6fd3096ebd3f746`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:25.727342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5fcd2764-34b3-4316-9dd7-485d060ab81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:25.736424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1247/2480] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 4 22:36:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:25.738059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320cd80-bd50-49e9-97cc-a5c8a4be992e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:25.743262 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303a1ce-74fb-41a1-9ad8-86475dec7f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:25.743726 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303a1ce-74fb-41a1-9ad8-86475dec7f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:25.744015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303a1ce-74fb-41a1-9ad8-86475dec7f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:25.744301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303a1ce-74fb-41a1-9ad8-86475dec7f88 admin admin] PATH_INFO: `/v3/users/951b36037e3a413ba8e43487fce4f651` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:25.748483 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd2764-34b3-4316-9dd7-485d060ab81e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:25.758845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303a1ce-74fb-41a1-9ad8-86475dec7f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=951b36037e3a413ba8e43487fce4f651)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:25.759067 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd2764-34b3-4316-9dd7-485d060ab81e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:25.760763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303a1ce-74fb-41a1-9ad8-86475dec7f88 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:25.764937 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a0bd4-a0a0-47f2-a0e7-87c29f35cd73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2448489cc4ad1a6fd3096ebd3f746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:25.766210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a0bd4-a0a0-47f2-a0e7-87c29f35cd73 service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:25.766210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a0bd4-a0a0-47f2-a0e7-87c29f35cd73 service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:25.766210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a0bd4-a0a0-47f2-a0e7-87c29f35cd73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:25.775871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a0bd4-a0a0-47f2-a0e7-87c29f35cd73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:25.777543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a0bd4-a0a0-47f2-a0e7-87c29f35cd73 service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:25.788179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1248/2481] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:36:25.809862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b303a1ce-74fb-41a1-9ad8-86475dec7f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951b36037e3a413ba8e43487fce4f651'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:25.817990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b303a1ce-74fb-41a1-9ad8-86475dec7f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951b36037e3a413ba8e43487fce4f651'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:25.825764 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b303a1ce-74fb-41a1-9ad8-86475dec7f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951b36037e3a413ba8e43487fce4f651'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:25.826457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b303a1ce-74fb-41a1-9ad8-86475dec7f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951b36037e3a413ba8e43487fce4f651'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:25.838038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b303a1ce-74fb-41a1-9ad8-86475dec7f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951b36037e3a413ba8e43487fce4f651'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:25.844681 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1234/2482] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:36:25 2022] DELETE /identity/v3/users/951b36037e3a413ba8e43487fce4f651 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:36:26.019307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a0bd4-a0a0-47f2-a0e7-87c29f35cd73 service placement] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:26.031210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a0bd4-a0a0-47f2-a0e7-87c29f35cd73 service placement] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:26.088128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:26.088689 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:26.088974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:26.089506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5 admin admin] PATH_INFO: `/v3/projects/9408aeeede0b4f2882dbc6178c80019a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:26.100306 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9408aeeede0b4f2882dbc6178c80019a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:26.102243 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:26.147264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9408aeeede0b4f2882dbc6178c80019a', 'request_id': 'req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:26.154265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9408aeeede0b4f2882dbc6178c80019a', 'request_id': 'req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:26.155989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:26.162845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9408aeeede0b4f2882dbc6178c80019a', 'request_id': 'req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:26.173868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5 admin admin] The token cache is being invalidate because project 9408aeeede0b4f2882dbc6178c80019a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:36:26.174153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:26.174797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3a3851a7-8ac3-4802-bc2c-2c8e8ecb15e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:26.176301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1249/2483] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:36:26 2022] DELETE /identity/v3/projects/9408aeeede0b4f2882dbc6178c80019a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:26.181201 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e68c1d-9e76-475f-9d86-70b8bff98799 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:26.181520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e68c1d-9e76-475f-9d86-70b8bff98799 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:26.181817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e68c1d-9e76-475f-9d86-70b8bff98799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:26.200766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c0e68c1d-9e76-475f-9d86-70b8bff98799 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:26.201951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c0e68c1d-9e76-475f-9d86-70b8bff98799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:26.263388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1235/2484] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:26.271254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9174-e62d-4d32-808c-03e340689950 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:26.271544 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9174-e62d-4d32-808c-03e340689950 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:26.271820 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9174-e62d-4d32-808c-03e340689950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:26.291351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e78b9174-e62d-4d32-808c-03e340689950 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:26.292810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e78b9174-e62d-4d32-808c-03e340689950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:26.301024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1250/2485] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:26.305344 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e68c1d-9e76-475f-9d86-70b8bff98799 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:26.315186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e68c1d-9e76-475f-9d86-70b8bff98799 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:26.319830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2734e-4b4a-4fb9-a7f3-8ef0f217b412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:26.320442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2734e-4b4a-4fb9-a7f3-8ef0f217b412 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:26.320724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2734e-4b4a-4fb9-a7f3-8ef0f217b412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:26.321002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2734e-4b4a-4fb9-a7f3-8ef0f217b412 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:26.321698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2734e-4b4a-4fb9-a7f3-8ef0f217b412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:36:26.322016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2734e-4b4a-4fb9-a7f3-8ef0f217b412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:26.323640 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b2734e-4b4a-4fb9-a7f3-8ef0f217b412 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:26.335715 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1236/2486] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:36:26.340213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b9174-e62d-4d32-808c-03e340689950 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:26.349295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b9174-e62d-4d32-808c-03e340689950 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:26.353944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e43cc-6323-4c64-99ed-daf896a89bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:26.354582 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e43cc-6323-4c64-99ed-daf896a89bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:26.354869 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e43cc-6323-4c64-99ed-daf896a89bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:26.355146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e43cc-6323-4c64-99ed-daf896a89bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:26.356323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e43cc-6323-4c64-99ed-daf896a89bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:26.358218 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e43cc-6323-4c64-99ed-daf896a89bc1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:26.399292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1251/2487] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:36:26 2022] POST /identity/v3/projects => generated 405 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:26.404119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2734e-4b4a-4fb9-a7f3-8ef0f217b412 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:26.414206 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2734e-4b4a-4fb9-a7f3-8ef0f217b412 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:26.464045 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:26.477595 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b307af8-d547-4bfa-a6c0-3a5e18f2045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:26.478214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b307af8-d547-4bfa-a6c0-3a5e18f2045a admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:26.478516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b307af8-d547-4bfa-a6c0-3a5e18f2045a admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:26.478788 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b307af8-d547-4bfa-a6c0-3a5e18f2045a admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:26.479450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b307af8-d547-4bfa-a6c0-3a5e18f2045a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:26.481392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b307af8-d547-4bfa-a6c0-3a5e18f2045a admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:26.501315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1237/2488] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:36:26 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:26.505920 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e43cc-6323-4c64-99ed-daf896a89bc1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:26.518599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e43cc-6323-4c64-99ed-daf896a89bc1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:26.523575 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f1c5d-d723-4cab-b020-8cd4b59154c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:26.524190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f1c5d-d723-4cab-b020-8cd4b59154c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:26.524474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f1c5d-d723-4cab-b020-8cd4b59154c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:26.524752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f1c5d-d723-4cab-b020-8cd4b59154c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:26.525445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f1c5d-d723-4cab-b020-8cd4b59154c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:26.527112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f1c5d-d723-4cab-b020-8cd4b59154c5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:26.538142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1252/2489] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:26.542305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b307af8-d547-4bfa-a6c0-3a5e18f2045a admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:26.553278 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b307af8-d547-4bfa-a6c0-3a5e18f2045a admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:26.558195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824fc86-d681-4f97-9604-a72c604a4c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:26.558869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824fc86-d681-4f97-9604-a72c604a4c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:26.559157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824fc86-d681-4f97-9604-a72c604a4c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:26.559435 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824fc86-d681-4f97-9604-a72c604a4c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:26.560129 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824fc86-d681-4f97-9604-a72c604a4c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:26.561735 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824fc86-d681-4f97-9604-a72c604a4c35 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:26.572332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1238/2490] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:26.576957 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f1c5d-d723-4cab-b020-8cd4b59154c5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:26.587252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f1c5d-d723-4cab-b020-8cd4b59154c5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:26.593023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e28bbe-4b7e-4908-9016-f97d4f463367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:26.593315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e28bbe-4b7e-4908-9016-f97d4f463367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:26.593593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e28bbe-4b7e-4908-9016-f97d4f463367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:26.593919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e28bbe-4b7e-4908-9016-f97d4f463367 admin admin] PATH_INFO: `/v3/projects/e47e1e8dbdb443a6ac114aed2ced597e/users/cc05fac2520a4b9a89cb7c4f5d85b4cd/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:26.608267 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e28bbe-4b7e-4908-9016-f97d4f463367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47e1e8dbdb443a6ac114aed2ced597e, user_id=cc05fac2520a4b9a89cb7c4f5d85b4cd, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:26.610930 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e28bbe-4b7e-4908-9016-f97d4f463367 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:26.623847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1253/2491] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:36:26 2022] PUT /identity/v3/projects/e47e1e8dbdb443a6ac114aed2ced597e/users/cc05fac2520a4b9a89cb7c4f5d85b4cd/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:26.629082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb4a66-a11d-43ad-8516-95dbd3646b6b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:26.629378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb4a66-a11d-43ad-8516-95dbd3646b6b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:26.629660 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb4a66-a11d-43ad-8516-95dbd3646b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:26.650352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-35bb4a66-a11d-43ad-8516-95dbd3646b6b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:26.651577 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-35bb4a66-a11d-43ad-8516-95dbd3646b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:26.708658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1239/2492] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:26.719128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e28bbe-4b7e-4908-9016-f97d4f463367 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:26.720995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-29e28bbe-4b7e-4908-9016-f97d4f463367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:26.776953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e28bbe-4b7e-4908-9016-f97d4f463367 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:26.781199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14119a4-b5f8-43e6-89b8-cf00f651adb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:26.781811 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14119a4-b5f8-43e6-89b8-cf00f651adb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:26.782095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14119a4-b5f8-43e6-89b8-cf00f651adb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:26.782371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14119a4-b5f8-43e6-89b8-cf00f651adb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:26.791572 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14119a4-b5f8-43e6-89b8-cf00f651adb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:26.793592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14119a4-b5f8-43e6-89b8-cf00f651adb1 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:26.803024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1254/2493] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:36:27.424541 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338d8f4-fafd-4dc9-b123-72c75cb0fbb6 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:27.425218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338d8f4-fafd-4dc9-b123-72c75cb0fbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:27.428632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338d8f4-fafd-4dc9-b123-72c75cb0fbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:27.468727 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-5338d8f4-fafd-4dc9-b123-72c75cb0fbb6 None None] MFA Rules not processed for user `cc05fac2520a4b9a89cb7c4f5d85b4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:27.469570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5338d8f4-fafd-4dc9-b123-72c75cb0fbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:27.535568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1240/2494] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:27.540244 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14119a4-b5f8-43e6-89b8-cf00f651adb1 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:27.550473 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14119a4-b5f8-43e6-89b8-cf00f651adb1 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:27.554956 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3b179-3423-48aa-b354-7bac4aed239d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:27.555564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3b179-3423-48aa-b354-7bac4aed239d admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:27.555846 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3b179-3423-48aa-b354-7bac4aed239d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:27.556119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3b179-3423-48aa-b354-7bac4aed239d admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:27.556774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3b179-3423-48aa-b354-7bac4aed239d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:27.558719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3b179-3423-48aa-b354-7bac4aed239d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:27.585762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1255/2495] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:36:27 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:27.590683 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338d8f4-fafd-4dc9-b123-72c75cb0fbb6 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:27.601610 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338d8f4-fafd-4dc9-b123-72c75cb0fbb6 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:27.653327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:27.660700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba7f4-2e13-4d4d-a613-564027c5b24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:27.661323 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba7f4-2e13-4d4d-a613-564027c5b24a admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:27.661604 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba7f4-2e13-4d4d-a613-564027c5b24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:27.661879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efba7f4-2e13-4d4d-a613-564027c5b24a admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:27.662599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efba7f4-2e13-4d4d-a613-564027c5b24a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:27.664558 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efba7f4-2e13-4d4d-a613-564027c5b24a admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:27.685807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1241/2496] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:36:27 2022] POST /identity/v3/users => generated 308 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:27.689999 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3b179-3423-48aa-b354-7bac4aed239d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:27.700445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3b179-3423-48aa-b354-7bac4aed239d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:27.705029 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e5cc-b069-4f30-8938-036dfe46aa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:27.705636 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e5cc-b069-4f30-8938-036dfe46aa0b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:27.705923 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e5cc-b069-4f30-8938-036dfe46aa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:27.706201 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4e5cc-b069-4f30-8938-036dfe46aa0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:27.706939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4e5cc-b069-4f30-8938-036dfe46aa0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:27.708533 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4e5cc-b069-4f30-8938-036dfe46aa0b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:27.719742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1256/2497] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:27.723981 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba7f4-2e13-4d4d-a613-564027c5b24a admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:27.737996 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efba7f4-2e13-4d4d-a613-564027c5b24a admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:27.742679 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ee085-bf18-4c81-a396-cf52310f920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:27.743344 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ee085-bf18-4c81-a396-cf52310f920d admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:27.743630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ee085-bf18-4c81-a396-cf52310f920d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:27.743907 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ee085-bf18-4c81-a396-cf52310f920d admin admin] PATH_INFO: `/v3/projects/d001736425ea4dd7909cfbcbec7fac90/users/eeaf4c24a8a94bd8b3f5a005d4398a3e/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:27.758467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ee085-bf18-4c81-a396-cf52310f920d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d001736425ea4dd7909cfbcbec7fac90, user_id=eeaf4c24a8a94bd8b3f5a005d4398a3e, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:27.761128 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ee085-bf18-4c81-a396-cf52310f920d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:27.774306 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1242/2498] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:36:27 2022] PUT /identity/v3/projects/d001736425ea4dd7909cfbcbec7fac90/users/eeaf4c24a8a94bd8b3f5a005d4398a3e/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:27.778867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e5cc-b069-4f30-8938-036dfe46aa0b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:27.788645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4e5cc-b069-4f30-8938-036dfe46aa0b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:27.825548 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:27.846745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884895cc-6a5d-49bc-98cf-c59fd81ef25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:27.847363 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884895cc-6a5d-49bc-98cf-c59fd81ef25f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:27.847647 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884895cc-6a5d-49bc-98cf-c59fd81ef25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:27.847924 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884895cc-6a5d-49bc-98cf-c59fd81ef25f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:27.848635 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884895cc-6a5d-49bc-98cf-c59fd81ef25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:27.850222 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884895cc-6a5d-49bc-98cf-c59fd81ef25f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:27.859890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1257/2499] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:27.864123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ee085-bf18-4c81-a396-cf52310f920d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:27.874462 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ee085-bf18-4c81-a396-cf52310f920d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:27.879119 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb8dd7-0608-45e9-8f79-bbcb00773d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:27.879826 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb8dd7-0608-45e9-8f79-bbcb00773d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:27.880111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb8dd7-0608-45e9-8f79-bbcb00773d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:27.880384 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb8dd7-0608-45e9-8f79-bbcb00773d19 admin admin] PATH_INFO: `/v3/projects/d001736425ea4dd7909cfbcbec7fac90/users/eeaf4c24a8a94bd8b3f5a005d4398a3e/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:27.882332 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb8dd7-0608-45e9-8f79-bbcb00773d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d001736425ea4dd7909cfbcbec7fac90, user_id=eeaf4c24a8a94bd8b3f5a005d4398a3e, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:27.885022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb8dd7-0608-45e9-8f79-bbcb00773d19 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:27.895724 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1243/2500] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:36:27 2022] PUT /identity/v3/projects/d001736425ea4dd7909cfbcbec7fac90/users/eeaf4c24a8a94bd8b3f5a005d4398a3e/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:28.523623 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abb822-c7dd-472d-944b-e73142216784 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:28.523917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abb822-c7dd-472d-944b-e73142216784 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:28.524195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abb822-c7dd-472d-944b-e73142216784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:28.553147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c3abb822-c7dd-472d-944b-e73142216784 None None] MFA Rules not processed for user `eeaf4c24a8a94bd8b3f5a005d4398a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:28.554354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c3abb822-c7dd-472d-944b-e73142216784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:28.626178 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1258/2501] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:28 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:29.644497 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb8dd7-0608-45e9-8f79-bbcb00773d19 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:29.707386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb8dd7-0608-45e9-8f79-bbcb00773d19 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:29.711883 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eef1ef-f144-487a-89fe-39b8c49f460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:29.712518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eef1ef-f144-487a-89fe-39b8c49f460d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:29.712803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eef1ef-f144-487a-89fe-39b8c49f460d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:29.713082 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eef1ef-f144-487a-89fe-39b8c49f460d admin admin] PATH_INFO: `/v3/users/cc05fac2520a4b9a89cb7c4f5d85b4cd` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:29.714237 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eef1ef-f144-487a-89fe-39b8c49f460d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc05fac2520a4b9a89cb7c4f5d85b4cd)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:29.716457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eef1ef-f144-487a-89fe-39b8c49f460d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:29.770788 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-95eef1ef-f144-487a-89fe-39b8c49f460d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc05fac2520a4b9a89cb7c4f5d85b4cd'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:29.778277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-95eef1ef-f144-487a-89fe-39b8c49f460d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc05fac2520a4b9a89cb7c4f5d85b4cd'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:29.785309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-95eef1ef-f144-487a-89fe-39b8c49f460d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc05fac2520a4b9a89cb7c4f5d85b4cd'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:29.785950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-95eef1ef-f144-487a-89fe-39b8c49f460d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc05fac2520a4b9a89cb7c4f5d85b4cd'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:29.797581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-95eef1ef-f144-487a-89fe-39b8c49f460d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc05fac2520a4b9a89cb7c4f5d85b4cd'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:29.803480 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1244/2502] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:36:29 2022] DELETE /identity/v3/users/cc05fac2520a4b9a89cb7c4f5d85b4cd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:29.971356 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abb822-c7dd-472d-944b-e73142216784 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:29.982669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abb822-c7dd-472d-944b-e73142216784 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:30.039274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:30.039920 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:30.040241 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:30.040504 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] PATH_INFO: `/v3/projects/e47e1e8dbdb443a6ac114aed2ced597e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:30.042001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47e1e8dbdb443a6ac114aed2ced597e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:30.044490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:30.090598 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47e1e8dbdb443a6ac114aed2ced597e', 'request_id': 'req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.096723 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47e1e8dbdb443a6ac114aed2ced597e', 'request_id': 'req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.103944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47e1e8dbdb443a6ac114aed2ced597e', 'request_id': 'req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.105893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:30.116321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] The token cache is being invalidate because project e47e1e8dbdb443a6ac114aed2ced597e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:36:30.116969 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.117796 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.119556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1259/2503] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:36:29 2022] DELETE /identity/v3/projects/e47e1e8dbdb443a6ac114aed2ced597e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:36:30.126101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eef1ef-f144-487a-89fe-39b8c49f460d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:30.127656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-95eef1ef-f144-487a-89fe-39b8c49f460d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:30.143850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eef1ef-f144-487a-89fe-39b8c49f460d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:30.170259 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:30.202613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20260534-cedb-4a2d-9afc-6941bb66eb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:30.203260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260534-cedb-4a2d-9afc-6941bb66eb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:30.203547 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260534-cedb-4a2d-9afc-6941bb66eb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:30.203822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260534-cedb-4a2d-9afc-6941bb66eb59 admin admin] PATH_INFO: `/v3/users/eeaf4c24a8a94bd8b3f5a005d4398a3e` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:30.205002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20260534-cedb-4a2d-9afc-6941bb66eb59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeaf4c24a8a94bd8b3f5a005d4398a3e)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:30.206967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20260534-cedb-4a2d-9afc-6941bb66eb59 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:30.254813 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-20260534-cedb-4a2d-9afc-6941bb66eb59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeaf4c24a8a94bd8b3f5a005d4398a3e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.262102 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-20260534-cedb-4a2d-9afc-6941bb66eb59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeaf4c24a8a94bd8b3f5a005d4398a3e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.269855 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-20260534-cedb-4a2d-9afc-6941bb66eb59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeaf4c24a8a94bd8b3f5a005d4398a3e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.270559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-20260534-cedb-4a2d-9afc-6941bb66eb59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeaf4c24a8a94bd8b3f5a005d4398a3e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.282000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-20260534-cedb-4a2d-9afc-6941bb66eb59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeaf4c24a8a94bd8b3f5a005d4398a3e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.287880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1245/2504] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:36:30 2022] DELETE /identity/v3/users/eeaf4c24a8a94bd8b3f5a005d4398a3e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:36:30.463814 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:30.466073 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:30.484833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdde3c-03b4-49f3-b6c8-a8e5be03a221 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:30.541841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a95f7-6872-4cdb-8be6-699c7003f964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:30.542426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a95f7-6872-4cdb-8be6-699c7003f964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:30.542797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a95f7-6872-4cdb-8be6-699c7003f964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:30.543073 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a95f7-6872-4cdb-8be6-699c7003f964 admin admin] PATH_INFO: `/v3/projects/d001736425ea4dd7909cfbcbec7fac90` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:30.544838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a95f7-6872-4cdb-8be6-699c7003f964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d001736425ea4dd7909cfbcbec7fac90)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:30.546917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a95f7-6872-4cdb-8be6-699c7003f964 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:30.594158 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d62a95f7-6872-4cdb-8be6-699c7003f964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd001736425ea4dd7909cfbcbec7fac90', 'request_id': 'req-d62a95f7-6872-4cdb-8be6-699c7003f964'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.600235 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d62a95f7-6872-4cdb-8be6-699c7003f964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd001736425ea4dd7909cfbcbec7fac90', 'request_id': 'req-d62a95f7-6872-4cdb-8be6-699c7003f964'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.608153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d62a95f7-6872-4cdb-8be6-699c7003f964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd001736425ea4dd7909cfbcbec7fac90', 'request_id': 'req-d62a95f7-6872-4cdb-8be6-699c7003f964'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.618733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d62a95f7-6872-4cdb-8be6-699c7003f964 admin admin] The token cache is being invalidate because project d001736425ea4dd7909cfbcbec7fac90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:36:30.619028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d62a95f7-6872-4cdb-8be6-699c7003f964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.619712 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d62a95f7-6872-4cdb-8be6-699c7003f964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:30.621254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1260/2505] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:36:30 2022] DELETE /identity/v3/projects/d001736425ea4dd7909cfbcbec7fac90 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:30.626831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907601ac-d7a6-4a86-8742-67c3db46a504 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:30.627191 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907601ac-d7a6-4a86-8742-67c3db46a504 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:30.627584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907601ac-d7a6-4a86-8742-67c3db46a504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:30.649182 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-907601ac-d7a6-4a86-8742-67c3db46a504 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:30.650435 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-907601ac-d7a6-4a86-8742-67c3db46a504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:30.717354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1246/2506] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:30.724724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc262d1-831c-42b3-9e1a-9f16faf739af None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:30.725013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc262d1-831c-42b3-9e1a-9f16faf739af None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:30.725308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc262d1-831c-42b3-9e1a-9f16faf739af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:30.745956 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ffc262d1-831c-42b3-9e1a-9f16faf739af None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:30.747788 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ffc262d1-831c-42b3-9e1a-9f16faf739af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:30.755767 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1261/2507] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:30.760075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907601ac-d7a6-4a86-8742-67c3db46a504 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:30.770244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907601ac-d7a6-4a86-8742-67c3db46a504 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:30.774765 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7fa16-c346-4d72-a0cd-8f7427f6e8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:30.775372 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7fa16-c346-4d72-a0cd-8f7427f6e8df admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:30.775652 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7fa16-c346-4d72-a0cd-8f7427f6e8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:30.775930 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7fa16-c346-4d72-a0cd-8f7427f6e8df admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:30.776619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7fa16-c346-4d72-a0cd-8f7427f6e8df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:36:30.776932 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7fa16-c346-4d72-a0cd-8f7427f6e8df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:30.778598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7fa16-c346-4d72-a0cd-8f7427f6e8df admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:30.790066 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1247/2508] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:36:30.794892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc262d1-831c-42b3-9e1a-9f16faf739af None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:30.804036 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc262d1-831c-42b3-9e1a-9f16faf739af None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:30.808657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639af8a-99fb-414f-82ca-6baa234c8a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:30.809839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639af8a-99fb-414f-82ca-6baa234c8a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:30.810158 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639af8a-99fb-414f-82ca-6baa234c8a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:30.810461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639af8a-99fb-414f-82ca-6baa234c8a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:30.811655 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639af8a-99fb-414f-82ca-6baa234c8a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:30.813543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639af8a-99fb-414f-82ca-6baa234c8a35 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:30.841760 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1262/2509] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:36:30 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:30.845935 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7fa16-c346-4d72-a0cd-8f7427f6e8df admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:30.855911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7fa16-c346-4d72-a0cd-8f7427f6e8df admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:30.888450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:30.914904 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55697b7-7d26-4c58-b017-26c62f758dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:30.915518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55697b7-7d26-4c58-b017-26c62f758dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:30.915800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55697b7-7d26-4c58-b017-26c62f758dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:30.916075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55697b7-7d26-4c58-b017-26c62f758dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:30.916734 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55697b7-7d26-4c58-b017-26c62f758dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:30.919643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55697b7-7d26-4c58-b017-26c62f758dc3 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:30.940307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1248/2510] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:36:30 2022] POST /identity/v3/users => generated 278 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:30.944434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639af8a-99fb-414f-82ca-6baa234c8a35 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:30.954838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639af8a-99fb-414f-82ca-6baa234c8a35 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:30.959474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345efcd2-d048-409b-ba56-79677457739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:30.960088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345efcd2-d048-409b-ba56-79677457739e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:30.960372 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345efcd2-d048-409b-ba56-79677457739e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:30.960678 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345efcd2-d048-409b-ba56-79677457739e admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:30.961376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345efcd2-d048-409b-ba56-79677457739e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:30.963003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345efcd2-d048-409b-ba56-79677457739e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:30.973074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1263/2511] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:30.976885 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55697b7-7d26-4c58-b017-26c62f758dc3 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:30.987381 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55697b7-7d26-4c58-b017-26c62f758dc3 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:30.991978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9a263-aa63-4bb7-9f2e-451717c292b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:30.992585 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9a263-aa63-4bb7-9f2e-451717c292b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:30.992869 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9a263-aa63-4bb7-9f2e-451717c292b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:30.993145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9a263-aa63-4bb7-9f2e-451717c292b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:30.993833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9a263-aa63-4bb7-9f2e-451717c292b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:30.995452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9a263-aa63-4bb7-9f2e-451717c292b9 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:31.006112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1249/2512] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:31.010146 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345efcd2-d048-409b-ba56-79677457739e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:31.020260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345efcd2-d048-409b-ba56-79677457739e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:31.024726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3de901-c515-472a-a7e1-ef55b7b5dfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:31.025369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3de901-c515-472a-a7e1-ef55b7b5dfa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:31.025646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3de901-c515-472a-a7e1-ef55b7b5dfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:31.025921 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3de901-c515-472a-a7e1-ef55b7b5dfa4 admin admin] PATH_INFO: `/v3/projects/f7ff84ad5e4c4038973922e9f3c6a9d6/users/4151c1c1a8d54920a29a5194f19b46e2/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:31.039943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3de901-c515-472a-a7e1-ef55b7b5dfa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ff84ad5e4c4038973922e9f3c6a9d6, user_id=4151c1c1a8d54920a29a5194f19b46e2, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:31.042587 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3de901-c515-472a-a7e1-ef55b7b5dfa4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:31.055962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1264/2513] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:36:31 2022] PUT /identity/v3/projects/f7ff84ad5e4c4038973922e9f3c6a9d6/users/4151c1c1a8d54920a29a5194f19b46e2/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:36:31.067806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e8e3-178c-4e97-9f6b-d2feda671773 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:31.068113 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e8e3-178c-4e97-9f6b-d2feda671773 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:31.068391 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e8e3-178c-4e97-9f6b-d2feda671773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:31.096019 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-9648e8e3-178c-4e97-9f6b-d2feda671773 None None] MFA Rules not processed for user `4151c1c1a8d54920a29a5194f19b46e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:31.097211 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9648e8e3-178c-4e97-9f6b-d2feda671773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:31.159468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1250/2514] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:36:31.164100 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3de901-c515-472a-a7e1-ef55b7b5dfa4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:31.183263 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:31.227742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3de901-c515-472a-a7e1-ef55b7b5dfa4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:31.233124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5ca0a-ba5d-4158-9f29-ca87f10a816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:31.233742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5ca0a-ba5d-4158-9f29-ca87f10a816a admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:31.234025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5ca0a-ba5d-4158-9f29-ca87f10a816a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:31.234300 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5ca0a-ba5d-4158-9f29-ca87f10a816a admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:31.234992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5ca0a-ba5d-4158-9f29-ca87f10a816a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:31.236904 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5ca0a-ba5d-4158-9f29-ca87f10a816a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:31.262565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1265/2515] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:36:31 2022] POST /identity/v3/projects => generated 357 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:31.266840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648e8e3-178c-4e97-9f6b-d2feda671773 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:31.277404 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648e8e3-178c-4e97-9f6b-d2feda671773 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:31.336329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273f60f-82ac-49e1-96af-35a47df23e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:31.336947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f60f-82ac-49e1-96af-35a47df23e6d admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:31.337228 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f60f-82ac-49e1-96af-35a47df23e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:31.337501 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f60f-82ac-49e1-96af-35a47df23e6d admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:31.338171 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273f60f-82ac-49e1-96af-35a47df23e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:31.340867 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273f60f-82ac-49e1-96af-35a47df23e6d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:31.365621 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1251/2516] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:36:31 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:36:31.366807 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5ca0a-ba5d-4158-9f29-ca87f10a816a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:31.376968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5ca0a-ba5d-4158-9f29-ca87f10a816a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:31.381550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4305f08-7610-4d6f-acef-343b560dde63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:31.382161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4305f08-7610-4d6f-acef-343b560dde63 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:31.382466 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4305f08-7610-4d6f-acef-343b560dde63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:31.382741 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4305f08-7610-4d6f-acef-343b560dde63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:31.383427 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4305f08-7610-4d6f-acef-343b560dde63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:31.385009 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4305f08-7610-4d6f-acef-343b560dde63 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:31.395390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1266/2517] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:36:31.399442 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273f60f-82ac-49e1-96af-35a47df23e6d admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:31.410883 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273f60f-82ac-49e1-96af-35a47df23e6d admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:31.416630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f4d97-2e3c-4c63-a32e-5d878fba1d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:31.417671 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4d97-2e3c-4c63-a32e-5d878fba1d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:31.417956 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4d97-2e3c-4c63-a32e-5d878fba1d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:31.418230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4d97-2e3c-4c63-a32e-5d878fba1d83 admin admin] PATH_INFO: `/v3/projects/1bb093f11eac4826a9341c142c5035ca/users/ba35b7eb67ae4489923329cb1bdf061c/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:31.435557 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f4d97-2e3c-4c63-a32e-5d878fba1d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb093f11eac4826a9341c142c5035ca, user_id=ba35b7eb67ae4489923329cb1bdf061c, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:31.438399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f4d97-2e3c-4c63-a32e-5d878fba1d83 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:31.452755 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1252/2518] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:36:31 2022] PUT /identity/v3/projects/1bb093f11eac4826a9341c142c5035ca/users/ba35b7eb67ae4489923329cb1bdf061c/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:31.456822 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4305f08-7610-4d6f-acef-343b560dde63 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:31.469771 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4305f08-7610-4d6f-acef-343b560dde63 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:31.530669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f21a4-9f95-4f81-8806-d185da4ce17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:31.531424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f21a4-9f95-4f81-8806-d185da4ce17c admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:31.532101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f21a4-9f95-4f81-8806-d185da4ce17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:31.532101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f21a4-9f95-4f81-8806-d185da4ce17c admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:31.532650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f21a4-9f95-4f81-8806-d185da4ce17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:31.534254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f21a4-9f95-4f81-8806-d185da4ce17c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:31.544185 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1267/2519] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:36:31.548431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f4d97-2e3c-4c63-a32e-5d878fba1d83 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:31.558653 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f4d97-2e3c-4c63-a32e-5d878fba1d83 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:31.563258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fa07b-9d79-43ed-8081-cae94ecca0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:31.563952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fa07b-9d79-43ed-8081-cae94ecca0c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:31.564232 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fa07b-9d79-43ed-8081-cae94ecca0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:31.564508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fa07b-9d79-43ed-8081-cae94ecca0c5 admin admin] PATH_INFO: `/v3/projects/1bb093f11eac4826a9341c142c5035ca/users/ba35b7eb67ae4489923329cb1bdf061c/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:31.566548 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fa07b-9d79-43ed-8081-cae94ecca0c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb093f11eac4826a9341c142c5035ca, user_id=ba35b7eb67ae4489923329cb1bdf061c, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:31.569172 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fa07b-9d79-43ed-8081-cae94ecca0c5 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:31.572382 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:31.582597 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1253/2520] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:36:31 2022] PUT /identity/v3/projects/1bb093f11eac4826a9341c142c5035ca/users/ba35b7eb67ae4489923329cb1bdf061c/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:31.593902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825337c-5d92-42a8-9360-7316fb71ad99 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:31.594110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825337c-5d92-42a8-9360-7316fb71ad99 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:31.594382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825337c-5d92-42a8-9360-7316fb71ad99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:31.623596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9825337c-5d92-42a8-9360-7316fb71ad99 None None] MFA Rules not processed for user `ba35b7eb67ae4489923329cb1bdf061c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:31.624821 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9825337c-5d92-42a8-9360-7316fb71ad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:31.697893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1268/2521] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:31.709878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fa07b-9d79-43ed-8081-cae94ecca0c5 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:31.711310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f79fa07b-9d79-43ed-8081-cae94ecca0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:31.774871 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fa07b-9d79-43ed-8081-cae94ecca0c5 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:31.778542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc975f-8a61-4991-953b-b28f21d640ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:31.779160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc975f-8a61-4991-953b-b28f21d640ae service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:31.779469 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc975f-8a61-4991-953b-b28f21d640ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:31.779744 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc975f-8a61-4991-953b-b28f21d640ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:31.788764 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc975f-8a61-4991-953b-b28f21d640ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:31.790185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc975f-8a61-4991-953b-b28f21d640ae service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:31.801409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1254/2522] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:36:31.878149 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825337c-5d92-42a8-9360-7316fb71ad99 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:31.887748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825337c-5d92-42a8-9360-7316fb71ad99 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:31.891452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a711364-f165-4944-9dc1-0412cbff0851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:31.892061 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711364-f165-4944-9dc1-0412cbff0851 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:31.892345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711364-f165-4944-9dc1-0412cbff0851 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:31.892618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711364-f165-4944-9dc1-0412cbff0851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:31.903945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:31.954161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a711364-f165-4944-9dc1-0412cbff0851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:31.955645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a711364-f165-4944-9dc1-0412cbff0851 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:31.964969 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1269/2523] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:36:41.796415 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=28 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:41.960454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=22 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:46.673243 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc975f-8a61-4991-953b-b28f21d640ae service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:46.734145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc975f-8a61-4991-953b-b28f21d640ae service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:46.738710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a02d6-139e-4c41-8b07-c7bc09f1e662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:46.739342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a02d6-139e-4c41-8b07-c7bc09f1e662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:46.739623 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a02d6-139e-4c41-8b07-c7bc09f1e662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:46.739896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a02d6-139e-4c41-8b07-c7bc09f1e662 admin admin] PATH_INFO: `/v3/users/4151c1c1a8d54920a29a5194f19b46e2` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:46.741042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a02d6-139e-4c41-8b07-c7bc09f1e662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4151c1c1a8d54920a29a5194f19b46e2)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:46.742984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a02d6-139e-4c41-8b07-c7bc09f1e662 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:46.789365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-bf0a02d6-139e-4c41-8b07-c7bc09f1e662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4151c1c1a8d54920a29a5194f19b46e2'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:46.796613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-bf0a02d6-139e-4c41-8b07-c7bc09f1e662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4151c1c1a8d54920a29a5194f19b46e2'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:46.803428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-bf0a02d6-139e-4c41-8b07-c7bc09f1e662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4151c1c1a8d54920a29a5194f19b46e2'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:46.804046 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-bf0a02d6-139e-4c41-8b07-c7bc09f1e662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4151c1c1a8d54920a29a5194f19b46e2'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:46.816014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-bf0a02d6-139e-4c41-8b07-c7bc09f1e662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4151c1c1a8d54920a29a5194f19b46e2'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:46.821631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1255/2524] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:36:46 2022] DELETE /identity/v3/users/4151c1c1a8d54920a29a5194f19b46e2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:46.826816 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f09fb5-6add-454a-9ecd-2945e9caad94 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:46.827296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f09fb5-6add-454a-9ecd-2945e9caad94 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:46.827426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f09fb5-6add-454a-9ecd-2945e9caad94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:46.845944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-83f09fb5-6add-454a-9ecd-2945e9caad94 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:46.847198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-83f09fb5-6add-454a-9ecd-2945e9caad94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:46.903694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1270/2525] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:46.913567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a02d6-139e-4c41-8b07-c7bc09f1e662 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:46.914952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-bf0a02d6-139e-4c41-8b07-c7bc09f1e662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:46.972748 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a02d6-139e-4c41-8b07-c7bc09f1e662 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:46.976458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7587e9-448b-4c27-939b-5d1a02cb9359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:46.977074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7587e9-448b-4c27-939b-5d1a02cb9359 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:46.977359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7587e9-448b-4c27-939b-5d1a02cb9359 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:46.977636 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7587e9-448b-4c27-939b-5d1a02cb9359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:46.986598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7587e9-448b-4c27-939b-5d1a02cb9359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:46.988022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7587e9-448b-4c27-939b-5d1a02cb9359 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:46.998175 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1256/2526] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:36:47.261892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f09fb5-6add-454a-9ecd-2945e9caad94 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:47.263777 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-83f09fb5-6add-454a-9ecd-2945e9caad94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:47.278107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f09fb5-6add-454a-9ecd-2945e9caad94 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:47.282791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:47.283447 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:47.283723 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:47.283992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] PATH_INFO: `/v3/projects/f7ff84ad5e4c4038973922e9f3c6a9d6` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:47.285154 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ff84ad5e4c4038973922e9f3c6a9d6)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:47.287098 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:47.334195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ff84ad5e4c4038973922e9f3c6a9d6', 'request_id': 'req-110b1ef5-2678-4170-bce9-cf3d6c238dcb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.340709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ff84ad5e4c4038973922e9f3c6a9d6', 'request_id': 'req-110b1ef5-2678-4170-bce9-cf3d6c238dcb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.348551 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ff84ad5e4c4038973922e9f3c6a9d6', 'request_id': 'req-110b1ef5-2678-4170-bce9-cf3d6c238dcb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.359474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] The token cache is being invalidate because project f7ff84ad5e4c4038973922e9f3c6a9d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:36:47.359767 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.360391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.361904 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1271/2527] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:36:47 2022] DELETE /identity/v3/projects/f7ff84ad5e4c4038973922e9f3c6a9d6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:47.365881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7587e9-448b-4c27-939b-5d1a02cb9359 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:47.376321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7587e9-448b-4c27-939b-5d1a02cb9359 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:47.395274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:47.440588 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892485b1-aedb-4f37-8452-125b13ce0336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:47.441153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892485b1-aedb-4f37-8452-125b13ce0336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:47.441435 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892485b1-aedb-4f37-8452-125b13ce0336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:47.441709 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892485b1-aedb-4f37-8452-125b13ce0336 admin admin] PATH_INFO: `/v3/users/ba35b7eb67ae4489923329cb1bdf061c` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:47.442891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892485b1-aedb-4f37-8452-125b13ce0336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba35b7eb67ae4489923329cb1bdf061c)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:47.444854 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892485b1-aedb-4f37-8452-125b13ce0336 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:47.492173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-892485b1-aedb-4f37-8452-125b13ce0336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba35b7eb67ae4489923329cb1bdf061c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.500070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-892485b1-aedb-4f37-8452-125b13ce0336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba35b7eb67ae4489923329cb1bdf061c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.506988 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-892485b1-aedb-4f37-8452-125b13ce0336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba35b7eb67ae4489923329cb1bdf061c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.507615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-892485b1-aedb-4f37-8452-125b13ce0336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba35b7eb67ae4489923329cb1bdf061c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.519154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-892485b1-aedb-4f37-8452-125b13ce0336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba35b7eb67ae4489923329cb1bdf061c'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.524891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1257/2528] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:36:47 2022] DELETE /identity/v3/users/ba35b7eb67ae4489923329cb1bdf061c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:47.804554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:47.806079 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:47.821844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b1ef5-2678-4170-bce9-cf3d6c238dcb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:47.879532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22039f52-1693-4512-bd87-ef5ce0f69110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:47.880181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22039f52-1693-4512-bd87-ef5ce0f69110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:47.880428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22039f52-1693-4512-bd87-ef5ce0f69110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:47.880703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22039f52-1693-4512-bd87-ef5ce0f69110 admin admin] PATH_INFO: `/v3/projects/1bb093f11eac4826a9341c142c5035ca` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:47.881834 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22039f52-1693-4512-bd87-ef5ce0f69110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb093f11eac4826a9341c142c5035ca)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:47.883774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22039f52-1693-4512-bd87-ef5ce0f69110 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:47.914264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:47.932074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-22039f52-1693-4512-bd87-ef5ce0f69110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb093f11eac4826a9341c142c5035ca', 'request_id': 'req-22039f52-1693-4512-bd87-ef5ce0f69110'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.938197 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-22039f52-1693-4512-bd87-ef5ce0f69110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb093f11eac4826a9341c142c5035ca', 'request_id': 'req-22039f52-1693-4512-bd87-ef5ce0f69110'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.945377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-22039f52-1693-4512-bd87-ef5ce0f69110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb093f11eac4826a9341c142c5035ca', 'request_id': 'req-22039f52-1693-4512-bd87-ef5ce0f69110'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.956508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-22039f52-1693-4512-bd87-ef5ce0f69110 admin admin] The token cache is being invalidate because project 1bb093f11eac4826a9341c142c5035ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:36:47.956793 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-22039f52-1693-4512-bd87-ef5ce0f69110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.957416 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-22039f52-1693-4512-bd87-ef5ce0f69110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:47.958936 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1272/2529] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:36:47 2022] DELETE /identity/v3/projects/1bb093f11eac4826a9341c142c5035ca => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:36:47.963823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8d84f-2f7e-40c7-9733-8571d6e47070 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:47.964293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8d84f-2f7e-40c7-9733-8571d6e47070 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:47.964691 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8d84f-2f7e-40c7-9733-8571d6e47070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:47.984535 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-44d8d84f-2f7e-40c7-9733-8571d6e47070 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:47.985654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-44d8d84f-2f7e-40c7-9733-8571d6e47070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:48.043720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1258/2530] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:48.051455 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839124cd-1a60-4975-a11c-2bb64f7e0140 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.051751 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839124cd-1a60-4975-a11c-2bb64f7e0140 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.052030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839124cd-1a60-4975-a11c-2bb64f7e0140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.071917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-839124cd-1a60-4975-a11c-2bb64f7e0140 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:48.073129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-839124cd-1a60-4975-a11c-2bb64f7e0140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:48.081687 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1273/2531] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:48.085749 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8d84f-2f7e-40c7-9733-8571d6e47070 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:48.096172 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8d84f-2f7e-40c7-9733-8571d6e47070 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:48.100741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58173a9c-f57d-48e0-9095-d8fb8eb4f796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:48.101346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58173a9c-f57d-48e0-9095-d8fb8eb4f796 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.101628 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58173a9c-f57d-48e0-9095-d8fb8eb4f796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.101901 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58173a9c-f57d-48e0-9095-d8fb8eb4f796 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.102626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58173a9c-f57d-48e0-9095-d8fb8eb4f796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:36:48.102936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58173a9c-f57d-48e0-9095-d8fb8eb4f796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:48.104515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58173a9c-f57d-48e0-9095-d8fb8eb4f796 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:48.115844 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1259/2532] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:36:48.120030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839124cd-1a60-4975-a11c-2bb64f7e0140 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:48.129203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839124cd-1a60-4975-a11c-2bb64f7e0140 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:48.133847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daea2d-5fd2-4104-8b65-a99da3327942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:48.134471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daea2d-5fd2-4104-8b65-a99da3327942 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.134755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daea2d-5fd2-4104-8b65-a99da3327942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.135033 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daea2d-5fd2-4104-8b65-a99da3327942 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.140216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0daea2d-5fd2-4104-8b65-a99da3327942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:48.140216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0daea2d-5fd2-4104-8b65-a99da3327942 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:48.165608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1274/2533] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:36:48 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:48.169810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58173a9c-f57d-48e0-9095-d8fb8eb4f796 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:48.179732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58173a9c-f57d-48e0-9095-d8fb8eb4f796 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:48.205381 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:48.237769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cd97c-05d1-48c2-a9cf-3f13a6e72c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:48.238307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cd97c-05d1-48c2-a9cf-3f13a6e72c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.238620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cd97c-05d1-48c2-a9cf-3f13a6e72c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.238897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cd97c-05d1-48c2-a9cf-3f13a6e72c65 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.239555 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cd97c-05d1-48c2-a9cf-3f13a6e72c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:48.241451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cd97c-05d1-48c2-a9cf-3f13a6e72c65 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:48.264769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1260/2534] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:36:48 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:48.269123 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daea2d-5fd2-4104-8b65-a99da3327942 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:48.280094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daea2d-5fd2-4104-8b65-a99da3327942 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:48.284798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b67b5-5040-42ad-ae5b-a2431d54827d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:48.285410 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b67b5-5040-42ad-ae5b-a2431d54827d admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.285694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b67b5-5040-42ad-ae5b-a2431d54827d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.285970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b67b5-5040-42ad-ae5b-a2431d54827d admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.286704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b67b5-5040-42ad-ae5b-a2431d54827d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:48.288308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b67b5-5040-42ad-ae5b-a2431d54827d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:48.298214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1275/2535] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:48.302052 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cd97c-05d1-48c2-a9cf-3f13a6e72c65 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:48.312962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cd97c-05d1-48c2-a9cf-3f13a6e72c65 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:48.317673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528aade4-08e8-42f1-8e92-bf947f0b0894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:48.318285 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aade4-08e8-42f1-8e92-bf947f0b0894 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.318770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aade4-08e8-42f1-8e92-bf947f0b0894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.318998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aade4-08e8-42f1-8e92-bf947f0b0894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.319690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528aade4-08e8-42f1-8e92-bf947f0b0894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:48.321283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528aade4-08e8-42f1-8e92-bf947f0b0894 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:48.332507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1261/2536] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:48.336659 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b67b5-5040-42ad-ae5b-a2431d54827d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:48.347318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b67b5-5040-42ad-ae5b-a2431d54827d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:48.352229 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc5006-0422-4218-98e8-e3142ab4ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:48.352891 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc5006-0422-4218-98e8-e3142ab4ca45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.353175 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc5006-0422-4218-98e8-e3142ab4ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.353454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc5006-0422-4218-98e8-e3142ab4ca45 admin admin] PATH_INFO: `/v3/projects/8cff70ec37a742fb863bb340561a3ae8/users/d7694170e3b44769b055865f52e070f3/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.368408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc5006-0422-4218-98e8-e3142ab4ca45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cff70ec37a742fb863bb340561a3ae8, user_id=d7694170e3b44769b055865f52e070f3, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:48.371090 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc5006-0422-4218-98e8-e3142ab4ca45 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:48.384013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1276/2537] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:36:48 2022] PUT /identity/v3/projects/8cff70ec37a742fb863bb340561a3ae8/users/d7694170e3b44769b055865f52e070f3/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:48.395022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90915043-a361-4a3a-82cb-d733c7271456 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.395310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90915043-a361-4a3a-82cb-d733c7271456 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.395584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90915043-a361-4a3a-82cb-d733c7271456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.421947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-90915043-a361-4a3a-82cb-d733c7271456 None None] MFA Rules not processed for user `d7694170e3b44769b055865f52e070f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:48.423211 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-90915043-a361-4a3a-82cb-d733c7271456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:48.486323 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1262/2538] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:36:48.490886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc5006-0422-4218-98e8-e3142ab4ca45 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:48.550916 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc5006-0422-4218-98e8-e3142ab4ca45 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:48.555528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfa2b6-5cd6-4609-b770-28958a0b2ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:48.556132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfa2b6-5cd6-4609-b770-28958a0b2ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.556414 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfa2b6-5cd6-4609-b770-28958a0b2ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.556688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfa2b6-5cd6-4609-b770-28958a0b2ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.557362 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfa2b6-5cd6-4609-b770-28958a0b2ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:48.559274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfa2b6-5cd6-4609-b770-28958a0b2ef4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:48.586091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1277/2539] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:36:48 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:48.590363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90915043-a361-4a3a-82cb-d733c7271456 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:48.600948 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90915043-a361-4a3a-82cb-d733c7271456 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:48.658009 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285bb49-951c-4e82-bc70-c849ced30db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:48.658676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285bb49-951c-4e82-bc70-c849ced30db4 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.658964 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285bb49-951c-4e82-bc70-c849ced30db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.659244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285bb49-951c-4e82-bc70-c849ced30db4 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.659910 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285bb49-951c-4e82-bc70-c849ced30db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:48.661832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285bb49-951c-4e82-bc70-c849ced30db4 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:48.681928 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1263/2540] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:36:48 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:48.686556 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfa2b6-5cd6-4609-b770-28958a0b2ef4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:48.696725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfa2b6-5cd6-4609-b770-28958a0b2ef4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:48.701812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794fe2b-c736-4902-b3f7-e68bb943a601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:48.702436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794fe2b-c736-4902-b3f7-e68bb943a601 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.702719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794fe2b-c736-4902-b3f7-e68bb943a601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.702990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794fe2b-c736-4902-b3f7-e68bb943a601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.703672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794fe2b-c736-4902-b3f7-e68bb943a601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:48.705253 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794fe2b-c736-4902-b3f7-e68bb943a601 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:48.716074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1278/2541] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:48.720113 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285bb49-951c-4e82-bc70-c849ced30db4 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:48.729892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285bb49-951c-4e82-bc70-c849ced30db4 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:48.735258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfe831-ff2a-4861-949b-c30bfe88b404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:48.735928 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfe831-ff2a-4861-949b-c30bfe88b404 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.736217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfe831-ff2a-4861-949b-c30bfe88b404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.736525 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfe831-ff2a-4861-949b-c30bfe88b404 admin admin] PATH_INFO: `/v3/projects/493160c4ed644c51adea4268f51e99cc/users/ac773bc2ec704867b6578fa89f32d3e3/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.752103 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfe831-ff2a-4861-949b-c30bfe88b404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493160c4ed644c51adea4268f51e99cc, user_id=ac773bc2ec704867b6578fa89f32d3e3, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:48.754905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfe831-ff2a-4861-949b-c30bfe88b404 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:48.767515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1264/2542] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:36:48 2022] PUT /identity/v3/projects/493160c4ed644c51adea4268f51e99cc/users/ac773bc2ec704867b6578fa89f32d3e3/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:48.771426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794fe2b-c736-4902-b3f7-e68bb943a601 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:48.781088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794fe2b-c736-4902-b3f7-e68bb943a601 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:48.800718 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:48.838398 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d119a-4572-4a2a-9517-5a9044c35810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:48.839045 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d119a-4572-4a2a-9517-5a9044c35810 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.839325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d119a-4572-4a2a-9517-5a9044c35810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.839855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d119a-4572-4a2a-9517-5a9044c35810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.840538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d119a-4572-4a2a-9517-5a9044c35810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:48.842132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d119a-4572-4a2a-9517-5a9044c35810 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:48.851832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1279/2543] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:48.856048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfe831-ff2a-4861-949b-c30bfe88b404 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:48.861965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:48.867914 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfe831-ff2a-4861-949b-c30bfe88b404 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:48.873652 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee34249-0a2e-41d3-9845-beedc85f3b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:48.874319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee34249-0a2e-41d3-9845-beedc85f3b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.874639 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee34249-0a2e-41d3-9845-beedc85f3b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.874917 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee34249-0a2e-41d3-9845-beedc85f3b15 admin admin] PATH_INFO: `/v3/projects/493160c4ed644c51adea4268f51e99cc/users/ac773bc2ec704867b6578fa89f32d3e3/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.876896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee34249-0a2e-41d3-9845-beedc85f3b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493160c4ed644c51adea4268f51e99cc, user_id=ac773bc2ec704867b6578fa89f32d3e3, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:48.879608 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee34249-0a2e-41d3-9845-beedc85f3b15 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:48.889657 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1265/2544] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:36:48 2022] PUT /identity/v3/projects/493160c4ed644c51adea4268f51e99cc/users/ac773bc2ec704867b6578fa89f32d3e3/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:48.900661 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3d78-145a-4520-a468-dbe9e85c3897 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:48.901143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3d78-145a-4520-a468-dbe9e85c3897 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:48.901249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3d78-145a-4520-a468-dbe9e85c3897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:48.930184 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-019c3d78-145a-4520-a468-dbe9e85c3897 None None] MFA Rules not processed for user `ac773bc2ec704867b6578fa89f32d3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:48.931437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-019c3d78-145a-4520-a468-dbe9e85c3897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:49.004691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1280/2545] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:49.015738 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee34249-0a2e-41d3-9845-beedc85f3b15 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:49.017545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8ee34249-0a2e-41d3-9845-beedc85f3b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:49.074135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee34249-0a2e-41d3-9845-beedc85f3b15 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:49.077715 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2648b3-ce7b-46bc-a4de-d55c1087610e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:49.078320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2648b3-ce7b-46bc-a4de-d55c1087610e service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:49.078627 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2648b3-ce7b-46bc-a4de-d55c1087610e service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:49.078898 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2648b3-ce7b-46bc-a4de-d55c1087610e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:49.133879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2648b3-ce7b-46bc-a4de-d55c1087610e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:49.135317 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2648b3-ce7b-46bc-a4de-d55c1087610e service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:49.143912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1266/2546] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:36:50.502608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c3d78-145a-4520-a468-dbe9e85c3897 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:50.503998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-019c3d78-145a-4520-a468-dbe9e85c3897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:50.516057 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c3d78-145a-4520-a468-dbe9e85c3897 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:50.519666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245df8dc-16ef-4284-af44-49aaa7ae92b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:50.521133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245df8dc-16ef-4284-af44-49aaa7ae92b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:50.521586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245df8dc-16ef-4284-af44-49aaa7ae92b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:50.521867 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245df8dc-16ef-4284-af44-49aaa7ae92b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:50.532450 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245df8dc-16ef-4284-af44-49aaa7ae92b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:50.534136 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245df8dc-16ef-4284-af44-49aaa7ae92b7 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:50.546266 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1281/2547] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:36:54.310768 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2648b3-ce7b-46bc-a4de-d55c1087610e service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:54.373579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2648b3-ce7b-46bc-a4de-d55c1087610e service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:54.378151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abf36e-d432-4512-bdf4-366de0b3dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:54.378819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf36e-d432-4512-bdf4-366de0b3dc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:54.379105 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf36e-d432-4512-bdf4-366de0b3dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:54.379380 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf36e-d432-4512-bdf4-366de0b3dc78 admin admin] PATH_INFO: `/v3/users/d7694170e3b44769b055865f52e070f3` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:54.380536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abf36e-d432-4512-bdf4-366de0b3dc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7694170e3b44769b055865f52e070f3)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:54.382526 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abf36e-d432-4512-bdf4-366de0b3dc78 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:54.426521 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:54.428110 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-33abf36e-d432-4512-bdf4-366de0b3dc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7694170e3b44769b055865f52e070f3'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:54.435788 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-33abf36e-d432-4512-bdf4-366de0b3dc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7694170e3b44769b055865f52e070f3'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:54.442824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-33abf36e-d432-4512-bdf4-366de0b3dc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7694170e3b44769b055865f52e070f3'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:54.443476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-33abf36e-d432-4512-bdf4-366de0b3dc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7694170e3b44769b055865f52e070f3'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:54.455700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-33abf36e-d432-4512-bdf4-366de0b3dc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7694170e3b44769b055865f52e070f3'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:54.461838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1267/2548] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:36:54 2022] DELETE /identity/v3/users/d7694170e3b44769b055865f52e070f3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:54.466749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbf580-b8fd-43c1-9d5b-1c80e580ff4b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:54.467252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbf580-b8fd-43c1-9d5b-1c80e580ff4b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:54.468020 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbf580-b8fd-43c1-9d5b-1c80e580ff4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:54.487179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-82bbf580-b8fd-43c1-9d5b-1c80e580ff4b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:54.488361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-82bbf580-b8fd-43c1-9d5b-1c80e580ff4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:54.546696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1282/2549] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:54.556511 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abf36e-d432-4512-bdf4-366de0b3dc78 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:54.557961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-33abf36e-d432-4512-bdf4-366de0b3dc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:54.619486 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abf36e-d432-4512-bdf4-366de0b3dc78 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:54.623095 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2907960-87ab-4ec6-9297-acfc503ab66a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:54.623774 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2907960-87ab-4ec6-9297-acfc503ab66a service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:54.624054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2907960-87ab-4ec6-9297-acfc503ab66a service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:54.624328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2907960-87ab-4ec6-9297-acfc503ab66a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:54.633411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2907960-87ab-4ec6-9297-acfc503ab66a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:54.634856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2907960-87ab-4ec6-9297-acfc503ab66a service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:54.644360 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1268/2550] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:36:54.909799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbf580-b8fd-43c1-9d5b-1c80e580ff4b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:54.911283 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-82bbf580-b8fd-43c1-9d5b-1c80e580ff4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:54.924075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbf580-b8fd-43c1-9d5b-1c80e580ff4b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:54.929408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:54.930130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:54.930532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:54.930880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] PATH_INFO: `/v3/projects/8cff70ec37a742fb863bb340561a3ae8` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:54.932153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cff70ec37a742fb863bb340561a3ae8)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:54.934153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:54.972928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:54.988256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cff70ec37a742fb863bb340561a3ae8', 'request_id': 'req-5ff63520-6b00-4efb-b05d-eef17279963b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:54.994511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cff70ec37a742fb863bb340561a3ae8', 'request_id': 'req-5ff63520-6b00-4efb-b05d-eef17279963b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:55.001599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cff70ec37a742fb863bb340561a3ae8', 'request_id': 'req-5ff63520-6b00-4efb-b05d-eef17279963b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:55.011958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] The token cache is being invalidate because project 8cff70ec37a742fb863bb340561a3ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:36:55.012248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:55.012884 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:55.014961 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1283/2551] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:36:54 2022] DELETE /identity/v3/projects/8cff70ec37a742fb863bb340561a3ae8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:55.019040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2907960-87ab-4ec6-9297-acfc503ab66a service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:55.028526 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2907960-87ab-4ec6-9297-acfc503ab66a service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:55.084924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f1a03-979b-4100-8fc0-2a315d001908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:55.085563 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f1a03-979b-4100-8fc0-2a315d001908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:55.085852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f1a03-979b-4100-8fc0-2a315d001908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:55.086127 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f1a03-979b-4100-8fc0-2a315d001908 admin admin] PATH_INFO: `/v3/users/ac773bc2ec704867b6578fa89f32d3e3` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:55.087321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f1a03-979b-4100-8fc0-2a315d001908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac773bc2ec704867b6578fa89f32d3e3)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:55.089230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f1a03-979b-4100-8fc0-2a315d001908 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:55.135733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7e9f1a03-979b-4100-8fc0-2a315d001908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac773bc2ec704867b6578fa89f32d3e3'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:55.143659 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7e9f1a03-979b-4100-8fc0-2a315d001908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac773bc2ec704867b6578fa89f32d3e3'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:55.150781 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7e9f1a03-979b-4100-8fc0-2a315d001908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac773bc2ec704867b6578fa89f32d3e3'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:55.151412 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7e9f1a03-979b-4100-8fc0-2a315d001908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac773bc2ec704867b6578fa89f32d3e3'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:55.156054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:55.165993 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7e9f1a03-979b-4100-8fc0-2a315d001908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac773bc2ec704867b6578fa89f32d3e3'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:55.171991 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1269/2552] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:36:55 2022] DELETE /identity/v3/users/ac773bc2ec704867b6578fa89f32d3e3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:55.446799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:55.453831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:55.470298 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff63520-6b00-4efb-b05d-eef17279963b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:55.528265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0915308-cb32-4f2b-8824-0d58120f20d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:55.528905 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0915308-cb32-4f2b-8824-0d58120f20d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:55.529191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0915308-cb32-4f2b-8824-0d58120f20d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:55.529467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0915308-cb32-4f2b-8824-0d58120f20d3 admin admin] PATH_INFO: `/v3/projects/493160c4ed644c51adea4268f51e99cc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:55.530669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0915308-cb32-4f2b-8824-0d58120f20d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=493160c4ed644c51adea4268f51e99cc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:55.532641 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0915308-cb32-4f2b-8824-0d58120f20d3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:55.578987 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f0915308-cb32-4f2b-8824-0d58120f20d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493160c4ed644c51adea4268f51e99cc', 'request_id': 'req-f0915308-cb32-4f2b-8824-0d58120f20d3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:55.585037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f0915308-cb32-4f2b-8824-0d58120f20d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493160c4ed644c51adea4268f51e99cc', 'request_id': 'req-f0915308-cb32-4f2b-8824-0d58120f20d3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:55.592774 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f0915308-cb32-4f2b-8824-0d58120f20d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493160c4ed644c51adea4268f51e99cc', 'request_id': 'req-f0915308-cb32-4f2b-8824-0d58120f20d3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:55.603531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f0915308-cb32-4f2b-8824-0d58120f20d3 admin admin] The token cache is being invalidate because project 493160c4ed644c51adea4268f51e99cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:36:55.603826 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f0915308-cb32-4f2b-8824-0d58120f20d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:55.604475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f0915308-cb32-4f2b-8824-0d58120f20d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:55.606207 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1284/2553] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:36:55 2022] DELETE /identity/v3/projects/493160c4ed644c51adea4268f51e99cc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:55.611789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e46414-aa04-41a4-ae44-1525fe4ef2c8 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:55.612303 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e46414-aa04-41a4-ae44-1525fe4ef2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:55.612403 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e46414-aa04-41a4-ae44-1525fe4ef2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:55.632023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c5e46414-aa04-41a4-ae44-1525fe4ef2c8 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:55.633265 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c5e46414-aa04-41a4-ae44-1525fe4ef2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:55.692054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1270/2554] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:55.699882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911759a-35f3-4a34-91dd-93f1c66c8c0b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:55.700174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911759a-35f3-4a34-91dd-93f1c66c8c0b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:55.700453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911759a-35f3-4a34-91dd-93f1c66c8c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:55.719960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8911759a-35f3-4a34-91dd-93f1c66c8c0b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:55.721182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8911759a-35f3-4a34-91dd-93f1c66c8c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:55.729214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1285/2555] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:55.734022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e46414-aa04-41a4-ae44-1525fe4ef2c8 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:55.743586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e46414-aa04-41a4-ae44-1525fe4ef2c8 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:55.748116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09c89a-8ffa-4488-91de-6a31478003fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:55.749252 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09c89a-8ffa-4488-91de-6a31478003fc admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:55.749550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09c89a-8ffa-4488-91de-6a31478003fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:55.749816 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09c89a-8ffa-4488-91de-6a31478003fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:55.750537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09c89a-8ffa-4488-91de-6a31478003fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:36:55.750839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09c89a-8ffa-4488-91de-6a31478003fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:55.752413 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09c89a-8ffa-4488-91de-6a31478003fc admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:55.763761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1271/2556] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:36:55.768003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911759a-35f3-4a34-91dd-93f1c66c8c0b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:55.776937 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911759a-35f3-4a34-91dd-93f1c66c8c0b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:55.782035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e8772-06c5-4665-a474-39077d5e98d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:55.782675 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e8772-06c5-4665-a474-39077d5e98d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:55.782956 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e8772-06c5-4665-a474-39077d5e98d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:55.783228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e8772-06c5-4665-a474-39077d5e98d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:55.783886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e8772-06c5-4665-a474-39077d5e98d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:55.785781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e8772-06c5-4665-a474-39077d5e98d6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:55.812181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1286/2557] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:36:55 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:55.816161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09c89a-8ffa-4488-91de-6a31478003fc admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:55.826089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09c89a-8ffa-4488-91de-6a31478003fc admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:55.881719 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08370e6d-9619-42ee-aff9-ccca13674849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:55.882238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08370e6d-9619-42ee-aff9-ccca13674849 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:55.882554 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08370e6d-9619-42ee-aff9-ccca13674849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:55.882832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08370e6d-9619-42ee-aff9-ccca13674849 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:55.883485 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08370e6d-9619-42ee-aff9-ccca13674849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:55.885406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08370e6d-9619-42ee-aff9-ccca13674849 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:55.906976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1272/2558] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:36:55 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:55.910988 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e8772-06c5-4665-a474-39077d5e98d6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:55.921752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e8772-06c5-4665-a474-39077d5e98d6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:55.926437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b6f09-4864-4647-9434-1f22f83e107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:55.927052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b6f09-4864-4647-9434-1f22f83e107a admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:55.927324 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b6f09-4864-4647-9434-1f22f83e107a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:55.927599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b6f09-4864-4647-9434-1f22f83e107a admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:55.928285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b6f09-4864-4647-9434-1f22f83e107a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:55.929877 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b6f09-4864-4647-9434-1f22f83e107a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:55.939730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1287/2559] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:55.943467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08370e6d-9619-42ee-aff9-ccca13674849 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:55.954066 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08370e6d-9619-42ee-aff9-ccca13674849 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:55.959421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd15db4-19bc-4d03-8ebe-f312c9e479ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:55.960039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd15db4-19bc-4d03-8ebe-f312c9e479ce admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:55.960324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd15db4-19bc-4d03-8ebe-f312c9e479ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:55.960603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd15db4-19bc-4d03-8ebe-f312c9e479ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:55.961297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd15db4-19bc-4d03-8ebe-f312c9e479ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:55.962957 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd15db4-19bc-4d03-8ebe-f312c9e479ce admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:55.974540 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1273/2560] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:36:55.978630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b6f09-4864-4647-9434-1f22f83e107a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:55.989143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b6f09-4864-4647-9434-1f22f83e107a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:55.994001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4990357-3a66-4de8-96d6-c2254c4b6821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:55.994699 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4990357-3a66-4de8-96d6-c2254c4b6821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:55.994986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4990357-3a66-4de8-96d6-c2254c4b6821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:55.995265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4990357-3a66-4de8-96d6-c2254c4b6821 admin admin] PATH_INFO: `/v3/projects/ffdd35ef8b9d4595af00c74977d05f4f/users/30da845ab6a144a6884f7fbd1f2abfe7/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:55.997499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:56.012519 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4990357-3a66-4de8-96d6-c2254c4b6821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdd35ef8b9d4595af00c74977d05f4f, user_id=30da845ab6a144a6884f7fbd1f2abfe7, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:56.015225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4990357-3a66-4de8-96d6-c2254c4b6821 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:56.027714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1288/2561] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:36:55 2022] PUT /identity/v3/projects/ffdd35ef8b9d4595af00c74977d05f4f/users/30da845ab6a144a6884f7fbd1f2abfe7/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:56.038370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c4a0-2bea-486e-861c-a52b9ac43859 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:56.038690 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c4a0-2bea-486e-861c-a52b9ac43859 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:56.038970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c4a0-2bea-486e-861c-a52b9ac43859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:56.066548 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-1010c4a0-2bea-486e-861c-a52b9ac43859 None None] MFA Rules not processed for user `30da845ab6a144a6884f7fbd1f2abfe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:56.067752 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1010c4a0-2bea-486e-861c-a52b9ac43859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:56.106982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:56.133318 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1274/2562] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:56.137745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4990357-3a66-4de8-96d6-c2254c4b6821 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:56.199324 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4990357-3a66-4de8-96d6-c2254c4b6821 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:56.204527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd835ff-091b-4222-88d4-6a9c7f2bac2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:56.205138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd835ff-091b-4222-88d4-6a9c7f2bac2a admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:56.205424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd835ff-091b-4222-88d4-6a9c7f2bac2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:56.205703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd835ff-091b-4222-88d4-6a9c7f2bac2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:56.206416 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd835ff-091b-4222-88d4-6a9c7f2bac2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:56.208342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd835ff-091b-4222-88d4-6a9c7f2bac2a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:56.235481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1289/2563] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:36:56 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:56.239474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010c4a0-2bea-486e-861c-a52b9ac43859 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:56.250060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010c4a0-2bea-486e-861c-a52b9ac43859 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:56.307431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9ece6-645c-4677-be21-a63cab303520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:56.308042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9ece6-645c-4677-be21-a63cab303520 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:56.308329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9ece6-645c-4677-be21-a63cab303520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:56.308608 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9ece6-645c-4677-be21-a63cab303520 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:56.309283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9ece6-645c-4677-be21-a63cab303520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:56.311277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9ece6-645c-4677-be21-a63cab303520 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:56.333077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1275/2564] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:36:56 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:56.336428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd835ff-091b-4222-88d4-6a9c7f2bac2a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:56.347647 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd835ff-091b-4222-88d4-6a9c7f2bac2a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:56.352297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5543f8-3fc4-4756-b38d-00eeeb48be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:56.352912 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5543f8-3fc4-4756-b38d-00eeeb48be8b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:56.353196 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5543f8-3fc4-4756-b38d-00eeeb48be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:56.353474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5543f8-3fc4-4756-b38d-00eeeb48be8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:56.354163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5543f8-3fc4-4756-b38d-00eeeb48be8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:56.355789 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5543f8-3fc4-4756-b38d-00eeeb48be8b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:56.366592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1290/2565] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:56.370611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9ece6-645c-4677-be21-a63cab303520 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:56.380643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9ece6-645c-4677-be21-a63cab303520 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:56.385342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25157539-edc5-4be6-b42a-12b4567f28af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:56.385922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25157539-edc5-4be6-b42a-12b4567f28af admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:56.386207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25157539-edc5-4be6-b42a-12b4567f28af admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:56.386520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25157539-edc5-4be6-b42a-12b4567f28af admin admin] PATH_INFO: `/v3/projects/35e3918094124787b59035fb51b52323/users/7f95cb1b7c2f4030881c072f1d9146bc/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:56.401441 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25157539-edc5-4be6-b42a-12b4567f28af admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e3918094124787b59035fb51b52323, user_id=7f95cb1b7c2f4030881c072f1d9146bc, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:56.404135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25157539-edc5-4be6-b42a-12b4567f28af admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:56.416752 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1276/2566] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:36:56 2022] PUT /identity/v3/projects/35e3918094124787b59035fb51b52323/users/7f95cb1b7c2f4030881c072f1d9146bc/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:36:56.421186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5543f8-3fc4-4756-b38d-00eeeb48be8b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:56.431207 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5543f8-3fc4-4756-b38d-00eeeb48be8b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:56.487908 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fc497-c1ee-4d90-95a1-1675701a3baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:56.488525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fc497-c1ee-4d90-95a1-1675701a3baf admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:56.488809 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fc497-c1ee-4d90-95a1-1675701a3baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:56.489106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fc497-c1ee-4d90-95a1-1675701a3baf admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:56.489803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fc497-c1ee-4d90-95a1-1675701a3baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:56.491433 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fc497-c1ee-4d90-95a1-1675701a3baf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:56.501811 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1291/2567] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:56.505921 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25157539-edc5-4be6-b42a-12b4567f28af admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:56.516830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25157539-edc5-4be6-b42a-12b4567f28af admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:56.521595 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde36e5-c940-42b7-971e-8e40ea63e73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:56.522261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde36e5-c940-42b7-971e-8e40ea63e73f admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:56.522585 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde36e5-c940-42b7-971e-8e40ea63e73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:56.522862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde36e5-c940-42b7-971e-8e40ea63e73f admin admin] PATH_INFO: `/v3/projects/35e3918094124787b59035fb51b52323/users/7f95cb1b7c2f4030881c072f1d9146bc/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:56.524812 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde36e5-c940-42b7-971e-8e40ea63e73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e3918094124787b59035fb51b52323, user_id=7f95cb1b7c2f4030881c072f1d9146bc, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:56.527508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde36e5-c940-42b7-971e-8e40ea63e73f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:56.538122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1277/2568] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:36:56 2022] PUT /identity/v3/projects/35e3918094124787b59035fb51b52323/users/7f95cb1b7c2f4030881c072f1d9146bc/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:56.549734 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861df9d9-ad0c-4a3a-984b-510ab4b09f3f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:56.550050 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861df9d9-ad0c-4a3a-984b-510ab4b09f3f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:56.550325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861df9d9-ad0c-4a3a-984b-510ab4b09f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:56.577278 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-861df9d9-ad0c-4a3a-984b-510ab4b09f3f None None] MFA Rules not processed for user `7f95cb1b7c2f4030881c072f1d9146bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:56.578508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-861df9d9-ad0c-4a3a-984b-510ab4b09f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:56.619300 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:56.646048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1292/2569] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:56.658254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde36e5-c940-42b7-971e-8e40ea63e73f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:56.660077 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-bfde36e5-c940-42b7-971e-8e40ea63e73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:56.716437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde36e5-c940-42b7-971e-8e40ea63e73f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:56.720569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c85f-eca9-4218-9cfc-c78347d23547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:56.721175 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c85f-eca9-4218-9cfc-c78347d23547 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:56.721483 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c85f-eca9-4218-9cfc-c78347d23547 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:56.721757 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c85f-eca9-4218-9cfc-c78347d23547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:56.730673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371c85f-eca9-4218-9cfc-c78347d23547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:56.732088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371c85f-eca9-4218-9cfc-c78347d23547 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:56.741940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1278/2570] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:36:56.812745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861df9d9-ad0c-4a3a-984b-510ab4b09f3f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:56.822269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861df9d9-ad0c-4a3a-984b-510ab4b09f3f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:56.825960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f48f3-ea67-4bb3-80f3-34843ce371d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:56.826609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f48f3-ea67-4bb3-80f3-34843ce371d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:56.826893 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f48f3-ea67-4bb3-80f3-34843ce371d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:56.827177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f48f3-ea67-4bb3-80f3-34843ce371d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:56.883140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f48f3-ea67-4bb3-80f3-34843ce371d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:56.884581 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f48f3-ea67-4bb3-80f3-34843ce371d6 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:56.893357 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1293/2571] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:36:57.153746 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c85f-eca9-4218-9cfc-c78347d23547 service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:57.191720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:57.216294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c85f-eca9-4218-9cfc-c78347d23547 service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:57.221793 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61afddb-86c2-4424-a753-ab1be3016723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:57.222459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61afddb-86c2-4424-a753-ab1be3016723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:57.222747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61afddb-86c2-4424-a753-ab1be3016723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:57.223023 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61afddb-86c2-4424-a753-ab1be3016723 admin admin] PATH_INFO: `/v3/users/30da845ab6a144a6884f7fbd1f2abfe7` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:57.224178 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61afddb-86c2-4424-a753-ab1be3016723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30da845ab6a144a6884f7fbd1f2abfe7)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:57.226086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61afddb-86c2-4424-a753-ab1be3016723 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:57.285706 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d61afddb-86c2-4424-a753-ab1be3016723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30da845ab6a144a6884f7fbd1f2abfe7'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:57.292341 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d61afddb-86c2-4424-a753-ab1be3016723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30da845ab6a144a6884f7fbd1f2abfe7'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:57.299159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d61afddb-86c2-4424-a753-ab1be3016723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30da845ab6a144a6884f7fbd1f2abfe7'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:57.299789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d61afddb-86c2-4424-a753-ab1be3016723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30da845ab6a144a6884f7fbd1f2abfe7'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:57.311904 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d61afddb-86c2-4424-a753-ab1be3016723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30da845ab6a144a6884f7fbd1f2abfe7'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:57.317676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1279/2572] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:36:57 2022] DELETE /identity/v3/users/30da845ab6a144a6884f7fbd1f2abfe7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:57.322118 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086551-6c5d-4c31-ada7-212b6019ec35 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:57.322427 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086551-6c5d-4c31-ada7-212b6019ec35 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:57.322804 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086551-6c5d-4c31-ada7-212b6019ec35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:57.343587 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5e086551-6c5d-4c31-ada7-212b6019ec35 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:57.344807 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5e086551-6c5d-4c31-ada7-212b6019ec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:57.403811 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1294/2573] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:57.413376 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61afddb-86c2-4424-a753-ab1be3016723 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:57.414847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d61afddb-86c2-4424-a753-ab1be3016723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:57.473116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61afddb-86c2-4424-a753-ab1be3016723 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:57.476789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446e7ce-bbe8-472c-bb07-816b88527607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:57.477409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446e7ce-bbe8-472c-bb07-816b88527607 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:57.477695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446e7ce-bbe8-472c-bb07-816b88527607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:57.477973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446e7ce-bbe8-472c-bb07-816b88527607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:57.486895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446e7ce-bbe8-472c-bb07-816b88527607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:57.488315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446e7ce-bbe8-472c-bb07-816b88527607 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:57.497671 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1280/2574] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:36:57.766791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e086551-6c5d-4c31-ada7-212b6019ec35 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:57.768262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5e086551-6c5d-4c31-ada7-212b6019ec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:57.780191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e086551-6c5d-4c31-ada7-212b6019ec35 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:57.785764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:57.786432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:57.786722 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:57.786994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] PATH_INFO: `/v3/projects/ffdd35ef8b9d4595af00c74977d05f4f` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:57.788162 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffdd35ef8b9d4595af00c74977d05f4f)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:57.790071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:57.836131 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffdd35ef8b9d4595af00c74977d05f4f', 'request_id': 'req-71676896-16d2-4e5b-91f2-b744b09db096'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:57.842673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffdd35ef8b9d4595af00c74977d05f4f', 'request_id': 'req-71676896-16d2-4e5b-91f2-b744b09db096'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:57.850149 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffdd35ef8b9d4595af00c74977d05f4f', 'request_id': 'req-71676896-16d2-4e5b-91f2-b744b09db096'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:57.857022 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:57.861984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] The token cache is being invalidate because project ffdd35ef8b9d4595af00c74977d05f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:36:57.862291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:57.863370 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:57.865428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1295/2575] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:36:57 2022] DELETE /identity/v3/projects/ffdd35ef8b9d4595af00c74977d05f4f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:57.869432 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446e7ce-bbe8-472c-bb07-816b88527607 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:57.879644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446e7ce-bbe8-472c-bb07-816b88527607 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:57.928993 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:57.935497 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9c8e1-0d94-4f9e-bb17-6bce07739612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:57.936842 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c8e1-0d94-4f9e-bb17-6bce07739612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:57.937468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c8e1-0d94-4f9e-bb17-6bce07739612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:57.938013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9c8e1-0d94-4f9e-bb17-6bce07739612 admin admin] PATH_INFO: `/v3/users/7f95cb1b7c2f4030881c072f1d9146bc` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:57.939330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9c8e1-0d94-4f9e-bb17-6bce07739612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f95cb1b7c2f4030881c072f1d9146bc)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:57.941596 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9c8e1-0d94-4f9e-bb17-6bce07739612 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:57.986040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9ed9c8e1-0d94-4f9e-bb17-6bce07739612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f95cb1b7c2f4030881c072f1d9146bc'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:57.992728 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9ed9c8e1-0d94-4f9e-bb17-6bce07739612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f95cb1b7c2f4030881c072f1d9146bc'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:58.000507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9ed9c8e1-0d94-4f9e-bb17-6bce07739612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f95cb1b7c2f4030881c072f1d9146bc'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:58.001193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9ed9c8e1-0d94-4f9e-bb17-6bce07739612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f95cb1b7c2f4030881c072f1d9146bc'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:58.013055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-9ed9c8e1-0d94-4f9e-bb17-6bce07739612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f95cb1b7c2f4030881c072f1d9146bc'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:58.018962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1281/2576] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:36:57 2022] DELETE /identity/v3/users/7f95cb1b7c2f4030881c072f1d9146bc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:58.298464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:58.299962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:58.315576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71676896-16d2-4e5b-91f2-b744b09db096 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:58.374087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ea996-d034-4e12-b584-d09f53b725c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:58.374763 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ea996-d034-4e12-b584-d09f53b725c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:58.375046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ea996-d034-4e12-b584-d09f53b725c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:58.375321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ea996-d034-4e12-b584-d09f53b725c8 admin admin] PATH_INFO: `/v3/projects/35e3918094124787b59035fb51b52323` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:58.376474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ea996-d034-4e12-b584-d09f53b725c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e3918094124787b59035fb51b52323)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:58.378384 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ea996-d034-4e12-b584-d09f53b725c8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:58.423968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ab9ea996-d034-4e12-b584-d09f53b725c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e3918094124787b59035fb51b52323', 'request_id': 'req-ab9ea996-d034-4e12-b584-d09f53b725c8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:58.429983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ab9ea996-d034-4e12-b584-d09f53b725c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e3918094124787b59035fb51b52323', 'request_id': 'req-ab9ea996-d034-4e12-b584-d09f53b725c8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:58.437073 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ab9ea996-d034-4e12-b584-d09f53b725c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e3918094124787b59035fb51b52323', 'request_id': 'req-ab9ea996-d034-4e12-b584-d09f53b725c8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:58.447131 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ab9ea996-d034-4e12-b584-d09f53b725c8 admin admin] The token cache is being invalidate because project 35e3918094124787b59035fb51b52323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:36:58.447423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ab9ea996-d034-4e12-b584-d09f53b725c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:58.448074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ab9ea996-d034-4e12-b584-d09f53b725c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:58.449795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1296/2577] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:36:58 2022] DELETE /identity/v3/projects/35e3918094124787b59035fb51b52323 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:58.454937 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d36ab-8cd7-4538-ab8b-5ac60b1001eb None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:58.455297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d36ab-8cd7-4538-ab8b-5ac60b1001eb None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:58.455642 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d36ab-8cd7-4538-ab8b-5ac60b1001eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:58.476308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-450d36ab-8cd7-4538-ab8b-5ac60b1001eb None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:58.477495 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-450d36ab-8cd7-4538-ab8b-5ac60b1001eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:58.535360 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1282/2578] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:58.543065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec0187-ab9d-4b4b-bfef-e2f270576f33 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:58.543354 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec0187-ab9d-4b4b-bfef-e2f270576f33 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:58.543629 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec0187-ab9d-4b4b-bfef-e2f270576f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:58.563686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a2ec0187-ab9d-4b4b-bfef-e2f270576f33 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:58.564889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a2ec0187-ab9d-4b4b-bfef-e2f270576f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:58.572858 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1297/2579] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:58.577548 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d36ab-8cd7-4538-ab8b-5ac60b1001eb None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:58.587103 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d36ab-8cd7-4538-ab8b-5ac60b1001eb None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:58.591890 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaad9d-0fa5-42c4-8d32-f831d835cfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:58.593154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaad9d-0fa5-42c4-8d32-f831d835cfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:58.593431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaad9d-0fa5-42c4-8d32-f831d835cfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:58.593698 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbaad9d-0fa5-42c4-8d32-f831d835cfa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:58.594389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaad9d-0fa5-42c4-8d32-f831d835cfa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:36:58.594718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaad9d-0fa5-42c4-8d32-f831d835cfa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:58.596294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbaad9d-0fa5-42c4-8d32-f831d835cfa1 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:58.607482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1283/2580] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:36:58.611656 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec0187-ab9d-4b4b-bfef-e2f270576f33 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:58.620713 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec0187-ab9d-4b4b-bfef-e2f270576f33 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:58.625294 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886498db-dedd-4671-b41b-e2f56f7ae60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:58.625892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886498db-dedd-4671-b41b-e2f56f7ae60c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:58.626173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886498db-dedd-4671-b41b-e2f56f7ae60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:58.626475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886498db-dedd-4671-b41b-e2f56f7ae60c admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:58.627130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886498db-dedd-4671-b41b-e2f56f7ae60c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:58.629002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886498db-dedd-4671-b41b-e2f56f7ae60c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:58.656544 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1298/2581] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:36:58 2022] POST /identity/v3/projects => generated 359 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:58.660803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaad9d-0fa5-42c4-8d32-f831d835cfa1 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:58.671102 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbaad9d-0fa5-42c4-8d32-f831d835cfa1 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:58.727313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a7b45-c00d-44f5-8b03-b6dbbaa39d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:58.727854 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a7b45-c00d-44f5-8b03-b6dbbaa39d1a admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:58.728137 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a7b45-c00d-44f5-8b03-b6dbbaa39d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:58.728411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a7b45-c00d-44f5-8b03-b6dbbaa39d1a admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:58.729067 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a7b45-c00d-44f5-8b03-b6dbbaa39d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:58.731027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a7b45-c00d-44f5-8b03-b6dbbaa39d1a admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:58.740702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:58.753883 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1284/2582] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:36:58 2022] POST /identity/v3/users => generated 280 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:36:58.758074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886498db-dedd-4671-b41b-e2f56f7ae60c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:58.768810 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886498db-dedd-4671-b41b-e2f56f7ae60c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:58.773343 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13add350-5833-401f-964b-d1208607d4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:58.773949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13add350-5833-401f-964b-d1208607d4ea admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:58.774229 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13add350-5833-401f-964b-d1208607d4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:58.774544 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13add350-5833-401f-964b-d1208607d4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:58.775236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13add350-5833-401f-964b-d1208607d4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:58.776813 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13add350-5833-401f-964b-d1208607d4ea admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:58.787222 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1299/2583] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:58.791080 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a7b45-c00d-44f5-8b03-b6dbbaa39d1a admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:58.801095 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a7b45-c00d-44f5-8b03-b6dbbaa39d1a admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:58.805753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44528954-8d44-4f2a-ab22-da5d3a406778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:58.806357 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528954-8d44-4f2a-ab22-da5d3a406778 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:58.806673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528954-8d44-4f2a-ab22-da5d3a406778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:58.807256 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528954-8d44-4f2a-ab22-da5d3a406778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:58.807682 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44528954-8d44-4f2a-ab22-da5d3a406778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:58.809314 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44528954-8d44-4f2a-ab22-da5d3a406778 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:58.821590 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1285/2584] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:36:58.825676 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13add350-5833-401f-964b-d1208607d4ea admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:58.836073 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13add350-5833-401f-964b-d1208607d4ea admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:58.841088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975308bc-4753-4ad5-ab3a-a1dc0cb49674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:58.841752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975308bc-4753-4ad5-ab3a-a1dc0cb49674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:58.842073 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975308bc-4753-4ad5-ab3a-a1dc0cb49674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:58.842351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975308bc-4753-4ad5-ab3a-a1dc0cb49674 admin admin] PATH_INFO: `/v3/projects/796232b548194e4f80c8283d186423a4/users/714f94b13c2f479d9b68a26acae54cde/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:58.856755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975308bc-4753-4ad5-ab3a-a1dc0cb49674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=796232b548194e4f80c8283d186423a4, user_id=714f94b13c2f479d9b68a26acae54cde, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:58.859482 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975308bc-4753-4ad5-ab3a-a1dc0cb49674 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:58.872240 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1300/2585] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:36:58 2022] PUT /identity/v3/projects/796232b548194e4f80c8283d186423a4/users/714f94b13c2f479d9b68a26acae54cde/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:58.884018 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b44df-ce93-4fd5-a068-94e372c5f8ae None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:58.884492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b44df-ce93-4fd5-a068-94e372c5f8ae None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:58.884606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b44df-ce93-4fd5-a068-94e372c5f8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:59.036902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-348b44df-ce93-4fd5-a068-94e372c5f8ae None None] MFA Rules not processed for user `714f94b13c2f479d9b68a26acae54cde`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:59.038031 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-348b44df-ce93-4fd5-a068-94e372c5f8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:59.099523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1286/2586] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:59.131961 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975308bc-4753-4ad5-ab3a-a1dc0cb49674 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:59.133672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-975308bc-4753-4ad5-ab3a-a1dc0cb49674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:59.164180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:59.192752 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975308bc-4753-4ad5-ab3a-a1dc0cb49674 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:59.196359 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce098f-b78e-4994-8f26-4e6bafcb05b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:59.196970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce098f-b78e-4994-8f26-4e6bafcb05b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:59.197287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce098f-b78e-4994-8f26-4e6bafcb05b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:59.197566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce098f-b78e-4994-8f26-4e6bafcb05b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:59.205676 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce098f-b78e-4994-8f26-4e6bafcb05b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:59.207140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce098f-b78e-4994-8f26-4e6bafcb05b4 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:59.216068 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1301/2587] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:36:59.230984 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b44df-ce93-4fd5-a068-94e372c5f8ae None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:59.296715 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b44df-ce93-4fd5-a068-94e372c5f8ae None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:59.301153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b03d90-60b0-4212-9b76-ea0b9d320635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:59.301789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b03d90-60b0-4212-9b76-ea0b9d320635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:59.302072 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b03d90-60b0-4212-9b76-ea0b9d320635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:59.302349 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b03d90-60b0-4212-9b76-ea0b9d320635 admin admin] PATH_INFO: `/v3/users/714f94b13c2f479d9b68a26acae54cde` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:59.303543 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b03d90-60b0-4212-9b76-ea0b9d320635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=714f94b13c2f479d9b68a26acae54cde)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:59.305444 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b03d90-60b0-4212-9b76-ea0b9d320635 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:59.350643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-84b03d90-60b0-4212-9b76-ea0b9d320635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714f94b13c2f479d9b68a26acae54cde'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:59.358185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-84b03d90-60b0-4212-9b76-ea0b9d320635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714f94b13c2f479d9b68a26acae54cde'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:59.366312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-84b03d90-60b0-4212-9b76-ea0b9d320635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714f94b13c2f479d9b68a26acae54cde'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:59.367027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-84b03d90-60b0-4212-9b76-ea0b9d320635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714f94b13c2f479d9b68a26acae54cde'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:59.374755 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:36:59.380140 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-84b03d90-60b0-4212-9b76-ea0b9d320635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714f94b13c2f479d9b68a26acae54cde'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:59.387329 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1287/2588] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:36:59 2022] DELETE /identity/v3/users/714f94b13c2f479d9b68a26acae54cde => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:59.392279 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e38aa-84fe-4b32-a59c-ee58b0e18f60 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:59.392566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e38aa-84fe-4b32-a59c-ee58b0e18f60 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:59.392851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e38aa-84fe-4b32-a59c-ee58b0e18f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:59.412212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c44e38aa-84fe-4b32-a59c-ee58b0e18f60 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:59.413445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c44e38aa-84fe-4b32-a59c-ee58b0e18f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:59.472070 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1302/2589] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:36:59.481574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b03d90-60b0-4212-9b76-ea0b9d320635 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:59.483070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-84b03d90-60b0-4212-9b76-ea0b9d320635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:59.541058 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b03d90-60b0-4212-9b76-ea0b9d320635 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:59.544637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d02c9-db5f-48e4-a399-95f2e25b9b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:59.545240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d02c9-db5f-48e4-a399-95f2e25b9b08 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:59.545544 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d02c9-db5f-48e4-a399-95f2e25b9b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:59.545833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d02c9-db5f-48e4-a399-95f2e25b9b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:59.554720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d02c9-db5f-48e4-a399-95f2e25b9b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:59.556055 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d02c9-db5f-48e4-a399-95f2e25b9b08 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:59.565847 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1288/2590] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:36:59.842172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e38aa-84fe-4b32-a59c-ee58b0e18f60 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:36:59.844287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c44e38aa-84fe-4b32-a59c-ee58b0e18f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:36:59.856565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e38aa-84fe-4b32-a59c-ee58b0e18f60 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:36:59.862084 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dc7e2-5512-486e-90a9-770066ce78b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:36:59.862589 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dc7e2-5512-486e-90a9-770066ce78b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:59.863136 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dc7e2-5512-486e-90a9-770066ce78b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:59.863531 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dc7e2-5512-486e-90a9-770066ce78b5 admin admin] PATH_INFO: `/v3/projects/796232b548194e4f80c8283d186423a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:59.864784 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dc7e2-5512-486e-90a9-770066ce78b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=796232b548194e4f80c8283d186423a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:36:59.866847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dc7e2-5512-486e-90a9-770066ce78b5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:36:59.913505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-444dc7e2-5512-486e-90a9-770066ce78b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796232b548194e4f80c8283d186423a4', 'request_id': 'req-444dc7e2-5512-486e-90a9-770066ce78b5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:59.919493 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-444dc7e2-5512-486e-90a9-770066ce78b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796232b548194e4f80c8283d186423a4', 'request_id': 'req-444dc7e2-5512-486e-90a9-770066ce78b5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:59.927416 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-444dc7e2-5512-486e-90a9-770066ce78b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796232b548194e4f80c8283d186423a4', 'request_id': 'req-444dc7e2-5512-486e-90a9-770066ce78b5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:59.937596 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-444dc7e2-5512-486e-90a9-770066ce78b5 admin admin] The token cache is being invalidate because project 796232b548194e4f80c8283d186423a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:36:59.937886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-444dc7e2-5512-486e-90a9-770066ce78b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:59.938534 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-444dc7e2-5512-486e-90a9-770066ce78b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:36:59.940031 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1303/2591] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:36:59 2022] DELETE /identity/v3/projects/796232b548194e4f80c8283d186423a4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:36:59.944822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640cb1d-9220-4dc7-a72d-bae556f0a818 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:36:59.945298 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640cb1d-9220-4dc7-a72d-bae556f0a818 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:36:59.945409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640cb1d-9220-4dc7-a72d-bae556f0a818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:36:59.964865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-7640cb1d-9220-4dc7-a72d-bae556f0a818 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:36:59.966041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7640cb1d-9220-4dc7-a72d-bae556f0a818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:00.023481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1289/2592] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:00.031569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165056ba-9fc2-41cb-84f0-c9dbf8f5611e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:00.031856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165056ba-9fc2-41cb-84f0-c9dbf8f5611e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:00.032130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165056ba-9fc2-41cb-84f0-c9dbf8f5611e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:00.051715 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-165056ba-9fc2-41cb-84f0-c9dbf8f5611e None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:00.052911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-165056ba-9fc2-41cb-84f0-c9dbf8f5611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:00.060762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1304/2593] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:00.064798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640cb1d-9220-4dc7-a72d-bae556f0a818 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:00.074286 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640cb1d-9220-4dc7-a72d-bae556f0a818 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:00.079705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbc8d6-fd95-471a-86de-fb328e300111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:00.080313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbc8d6-fd95-471a-86de-fb328e300111 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:00.080598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbc8d6-fd95-471a-86de-fb328e300111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:00.080874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbc8d6-fd95-471a-86de-fb328e300111 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:00.081598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbc8d6-fd95-471a-86de-fb328e300111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:37:00.081907 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbc8d6-fd95-471a-86de-fb328e300111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:00.083523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbc8d6-fd95-471a-86de-fb328e300111 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:00.095936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1290/2594] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:37:00.099946 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165056ba-9fc2-41cb-84f0-c9dbf8f5611e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:00.108990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165056ba-9fc2-41cb-84f0-c9dbf8f5611e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:00.113617 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a87a1-67d8-4486-b3a5-ae1c27658b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:00.114212 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a87a1-67d8-4486-b3a5-ae1c27658b52 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:00.114526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a87a1-67d8-4486-b3a5-ae1c27658b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:00.114803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a87a1-67d8-4486-b3a5-ae1c27658b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:00.115461 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a87a1-67d8-4486-b3a5-ae1c27658b52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:00.117343 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a87a1-67d8-4486-b3a5-ae1c27658b52 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:00.145448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1305/2595] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:37:00 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:37:00.149464 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbc8d6-fd95-471a-86de-fb328e300111 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:00.159808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbc8d6-fd95-471a-86de-fb328e300111 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:00.214129 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d0bc1-6188-425d-b58a-df1d9b0f7bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:00.215016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d0bc1-6188-425d-b58a-df1d9b0f7bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:00.215300 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d0bc1-6188-425d-b58a-df1d9b0f7bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:00.215579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d0bc1-6188-425d-b58a-df1d9b0f7bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:00.216245 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d0bc1-6188-425d-b58a-df1d9b0f7bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:00.218929 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d0bc1-6188-425d-b58a-df1d9b0f7bc1 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:00.239192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1291/2596] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:37:00 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:37:00.243404 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a87a1-67d8-4486-b3a5-ae1c27658b52 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:00.253562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a87a1-67d8-4486-b3a5-ae1c27658b52 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:00.258133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9a8cd-3bbd-48f9-9a03-8846394577aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:00.258771 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9a8cd-3bbd-48f9-9a03-8846394577aa admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:00.259055 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9a8cd-3bbd-48f9-9a03-8846394577aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:00.259331 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9a8cd-3bbd-48f9-9a03-8846394577aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:00.260015 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9a8cd-3bbd-48f9-9a03-8846394577aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:00.261800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9a8cd-3bbd-48f9-9a03-8846394577aa admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:00.272407 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1306/2597] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:00.276293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d0bc1-6188-425d-b58a-df1d9b0f7bc1 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:00.286735 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d0bc1-6188-425d-b58a-df1d9b0f7bc1 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:00.291291 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11e952-474c-4024-b179-c174a7c0370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:00.291904 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11e952-474c-4024-b179-c174a7c0370f admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:00.292184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11e952-474c-4024-b179-c174a7c0370f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:00.292456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11e952-474c-4024-b179-c174a7c0370f admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:00.293133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11e952-474c-4024-b179-c174a7c0370f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:00.294715 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11e952-474c-4024-b179-c174a7c0370f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:00.299811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:00.304756 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1292/2598] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:00.308863 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9a8cd-3bbd-48f9-9a03-8846394577aa admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:00.319250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9a8cd-3bbd-48f9-9a03-8846394577aa admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:00.323858 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e013a-4e59-4a14-8c96-a2440f15b486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:00.324509 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e013a-4e59-4a14-8c96-a2440f15b486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:00.324788 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e013a-4e59-4a14-8c96-a2440f15b486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:00.325060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e013a-4e59-4a14-8c96-a2440f15b486 admin admin] PATH_INFO: `/v3/projects/1520cc0bafd240a88429393b642ae92c/users/3aa5782a712941f1ab58e2b3d05a5ab6/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:00.337227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:00.341991 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e013a-4e59-4a14-8c96-a2440f15b486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1520cc0bafd240a88429393b642ae92c, user_id=3aa5782a712941f1ab58e2b3d05a5ab6, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:00.345762 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e013a-4e59-4a14-8c96-a2440f15b486 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:00.359261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1307/2599] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:37:00 2022] PUT /identity/v3/projects/1520cc0bafd240a88429393b642ae92c/users/3aa5782a712941f1ab58e2b3d05a5ab6/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:00.369603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86247b56-fbd6-4b3d-8fd5-cd608a19bc76 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:00.369893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86247b56-fbd6-4b3d-8fd5-cd608a19bc76 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:00.370207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86247b56-fbd6-4b3d-8fd5-cd608a19bc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:00.397143 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-86247b56-fbd6-4b3d-8fd5-cd608a19bc76 None None] MFA Rules not processed for user `3aa5782a712941f1ab58e2b3d05a5ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:00.398361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-86247b56-fbd6-4b3d-8fd5-cd608a19bc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:00.463205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1293/2600] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:00.475504 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e013a-4e59-4a14-8c96-a2440f15b486 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:00.477348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3a6e013a-4e59-4a14-8c96-a2440f15b486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:00.534968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e013a-4e59-4a14-8c96-a2440f15b486 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:00.538680 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177e5ae-2302-497b-abcb-5055d643ca78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:00.539425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177e5ae-2302-497b-abcb-5055d643ca78 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:00.539710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177e5ae-2302-497b-abcb-5055d643ca78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:00.539990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177e5ae-2302-497b-abcb-5055d643ca78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:00.550347 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177e5ae-2302-497b-abcb-5055d643ca78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:00.551816 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177e5ae-2302-497b-abcb-5055d643ca78 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:00.560680 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1308/2601] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:10.460157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=32 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:10.556646 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:16.122258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86247b56-fbd6-4b3d-8fd5-cd608a19bc76 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:16.181813 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86247b56-fbd6-4b3d-8fd5-cd608a19bc76 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:16.186231 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d907a0a-47e9-47c3-86c2-08935a3e8011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:16.186902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907a0a-47e9-47c3-86c2-08935a3e8011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:16.187182 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907a0a-47e9-47c3-86c2-08935a3e8011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:16.187456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907a0a-47e9-47c3-86c2-08935a3e8011 admin admin] PATH_INFO: `/v3/users/3aa5782a712941f1ab58e2b3d05a5ab6` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:16.188622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d907a0a-47e9-47c3-86c2-08935a3e8011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa5782a712941f1ab58e2b3d05a5ab6)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:16.190581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d907a0a-47e9-47c3-86c2-08935a3e8011 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:16.237859 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8d907a0a-47e9-47c3-86c2-08935a3e8011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa5782a712941f1ab58e2b3d05a5ab6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:16.245182 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8d907a0a-47e9-47c3-86c2-08935a3e8011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa5782a712941f1ab58e2b3d05a5ab6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:16.252431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8d907a0a-47e9-47c3-86c2-08935a3e8011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa5782a712941f1ab58e2b3d05a5ab6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:16.253069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8d907a0a-47e9-47c3-86c2-08935a3e8011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa5782a712941f1ab58e2b3d05a5ab6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:16.264687 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8d907a0a-47e9-47c3-86c2-08935a3e8011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa5782a712941f1ab58e2b3d05a5ab6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:16.270515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1294/2602] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:37:16 2022] DELETE /identity/v3/users/3aa5782a712941f1ab58e2b3d05a5ab6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:16.274973 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0faac-d803-4bf1-9317-377247df7bcf None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:16.275463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0faac-d803-4bf1-9317-377247df7bcf None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:16.275576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0faac-d803-4bf1-9317-377247df7bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:16.294983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e4c0faac-d803-4bf1-9317-377247df7bcf None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:16.296189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e4c0faac-d803-4bf1-9317-377247df7bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:16.362476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1309/2603] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:16.372205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d907a0a-47e9-47c3-86c2-08935a3e8011 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:16.373625 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8d907a0a-47e9-47c3-86c2-08935a3e8011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:16.429926 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d907a0a-47e9-47c3-86c2-08935a3e8011 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:16.433477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198d5b6-3d44-4693-aa79-248ba3d4fec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:16.434080 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198d5b6-3d44-4693-aa79-248ba3d4fec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:16.434383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198d5b6-3d44-4693-aa79-248ba3d4fec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:16.434682 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198d5b6-3d44-4693-aa79-248ba3d4fec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:16.443402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198d5b6-3d44-4693-aa79-248ba3d4fec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:16.444792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198d5b6-3d44-4693-aa79-248ba3d4fec9 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:16.454695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1295/2604] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:16.723573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0faac-d803-4bf1-9317-377247df7bcf None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:16.725092 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e4c0faac-d803-4bf1-9317-377247df7bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:16.739272 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0faac-d803-4bf1-9317-377247df7bcf None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:16.744503 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:16.745337 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:16.745625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:16.745928 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708 admin admin] PATH_INFO: `/v3/projects/1520cc0bafd240a88429393b642ae92c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:16.747172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1520cc0bafd240a88429393b642ae92c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:16.749028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:16.796497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1520cc0bafd240a88429393b642ae92c', 'request_id': 'req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:16.802716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1520cc0bafd240a88429393b642ae92c', 'request_id': 'req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:16.810630 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1520cc0bafd240a88429393b642ae92c', 'request_id': 'req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:16.821636 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708 admin admin] The token cache is being invalidate because project 1520cc0bafd240a88429393b642ae92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:37:16.821930 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:16.822583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fc4f0f1b-7e08-4dfb-91d0-25228ccc1708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:16.824087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1310/2605] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:37:16 2022] DELETE /identity/v3/projects/1520cc0bafd240a88429393b642ae92c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:16.829709 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc733bc1-47f5-4f7b-8300-6e7fe9001e7e None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:16.829996 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc733bc1-47f5-4f7b-8300-6e7fe9001e7e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:16.830269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc733bc1-47f5-4f7b-8300-6e7fe9001e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:16.849176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-cc733bc1-47f5-4f7b-8300-6e7fe9001e7e None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:16.850366 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-cc733bc1-47f5-4f7b-8300-6e7fe9001e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:16.866392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:16.910218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1296/2606] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:16.974319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be737bc-529e-4047-9813-3caa98435b90 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:16.974780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be737bc-529e-4047-9813-3caa98435b90 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:16.975132 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be737bc-529e-4047-9813-3caa98435b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:16.997325 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6be737bc-529e-4047-9813-3caa98435b90 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:16.998577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6be737bc-529e-4047-9813-3caa98435b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:17.007038 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1311/2607] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:17.011337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc733bc1-47f5-4f7b-8300-6e7fe9001e7e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:17.021596 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc733bc1-47f5-4f7b-8300-6e7fe9001e7e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:17.026118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc537d-e0fe-4d53-b23b-42f1603c109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:17.026763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc537d-e0fe-4d53-b23b-42f1603c109c admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:17.027037 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc537d-e0fe-4d53-b23b-42f1603c109c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:17.027308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc537d-e0fe-4d53-b23b-42f1603c109c admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:17.027999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc537d-e0fe-4d53-b23b-42f1603c109c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:37:17.028305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc537d-e0fe-4d53-b23b-42f1603c109c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:17.029878 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc537d-e0fe-4d53-b23b-42f1603c109c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:17.041764 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1297/2608] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:37:17.045963 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be737bc-529e-4047-9813-3caa98435b90 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:17.063464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be737bc-529e-4047-9813-3caa98435b90 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:17.068160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28926b71-3776-4336-9cfc-9b4a6c80974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:17.068767 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926b71-3776-4336-9cfc-9b4a6c80974c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:17.069047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926b71-3776-4336-9cfc-9b4a6c80974c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:17.069436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926b71-3776-4336-9cfc-9b4a6c80974c admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:17.070100 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28926b71-3776-4336-9cfc-9b4a6c80974c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:17.072057 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28926b71-3776-4336-9cfc-9b4a6c80974c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:17.099083 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1312/2609] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:37:17 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:37:17.103144 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc537d-e0fe-4d53-b23b-42f1603c109c admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:17.113398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc537d-e0fe-4d53-b23b-42f1603c109c admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:17.166624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763dc81-02dc-4277-b37f-45d164ea2e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:17.167234 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763dc81-02dc-4277-b37f-45d164ea2e40 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:17.167491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763dc81-02dc-4277-b37f-45d164ea2e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:17.167760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763dc81-02dc-4277-b37f-45d164ea2e40 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:17.168417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763dc81-02dc-4277-b37f-45d164ea2e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:17.170272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763dc81-02dc-4277-b37f-45d164ea2e40 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:17.191767 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1298/2610] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:37:17 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:37:17.195917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28926b71-3776-4336-9cfc-9b4a6c80974c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:17.206046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28926b71-3776-4336-9cfc-9b4a6c80974c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:17.210623 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee13fc7-df70-418e-ba7e-7be5e1e8c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:17.211227 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee13fc7-df70-418e-ba7e-7be5e1e8c709 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:17.211509 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee13fc7-df70-418e-ba7e-7be5e1e8c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:17.211780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee13fc7-df70-418e-ba7e-7be5e1e8c709 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:17.212462 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee13fc7-df70-418e-ba7e-7be5e1e8c709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:17.214043 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee13fc7-df70-418e-ba7e-7be5e1e8c709 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:17.224994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1313/2611] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:17.228838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763dc81-02dc-4277-b37f-45d164ea2e40 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:17.239120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763dc81-02dc-4277-b37f-45d164ea2e40 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:17.243653 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2f08f-f556-43e6-855b-e17c2bc37799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:17.244253 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f08f-f556-43e6-855b-e17c2bc37799 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:17.244537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f08f-f556-43e6-855b-e17c2bc37799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:17.244812 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f08f-f556-43e6-855b-e17c2bc37799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:17.245499 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2f08f-f556-43e6-855b-e17c2bc37799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:17.247108 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2f08f-f556-43e6-855b-e17c2bc37799 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:17.258478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1299/2612] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:17.262464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee13fc7-df70-418e-ba7e-7be5e1e8c709 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:17.272369 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee13fc7-df70-418e-ba7e-7be5e1e8c709 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:17.277130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5d4d2-534f-4d29-8872-aaa0675824ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:17.277817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5d4d2-534f-4d29-8872-aaa0675824ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:17.278103 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5d4d2-534f-4d29-8872-aaa0675824ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:17.278380 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5d4d2-534f-4d29-8872-aaa0675824ba admin admin] PATH_INFO: `/v3/projects/be7ceb10aad4431e9ce2cdc64728d106/users/cf3e84b74ef64ebcbb2d4cb2b810126f/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:17.292825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5d4d2-534f-4d29-8872-aaa0675824ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7ceb10aad4431e9ce2cdc64728d106, user_id=cf3e84b74ef64ebcbb2d4cb2b810126f, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:17.295948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5d4d2-534f-4d29-8872-aaa0675824ba admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:17.310202 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1314/2613] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:37:17 2022] PUT /identity/v3/projects/be7ceb10aad4431e9ce2cdc64728d106/users/cf3e84b74ef64ebcbb2d4cb2b810126f/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:37:17.320753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfab2b-1e3c-45af-8286-35dcdb924c1a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:17.320982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfab2b-1e3c-45af-8286-35dcdb924c1a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:17.321258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfab2b-1e3c-45af-8286-35dcdb924c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:17.348634 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-31dfab2b-1e3c-45af-8286-35dcdb924c1a None None] MFA Rules not processed for user `cf3e84b74ef64ebcbb2d4cb2b810126f`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:17.349846 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-31dfab2b-1e3c-45af-8286-35dcdb924c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:17.415249 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1300/2614] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:17.426510 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5d4d2-534f-4d29-8872-aaa0675824ba admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:17.428174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1ef5d4d2-534f-4d29-8872-aaa0675824ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:17.450352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:17.488356 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5d4d2-534f-4d29-8872-aaa0675824ba admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:17.493174 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2fdad-d752-4772-8123-81fd06535c88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:17.493780 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2fdad-d752-4772-8123-81fd06535c88 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:17.494082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2fdad-d752-4772-8123-81fd06535c88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:17.494351 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2fdad-d752-4772-8123-81fd06535c88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:17.504305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2fdad-d752-4772-8123-81fd06535c88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:17.505737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2fdad-d752-4772-8123-81fd06535c88 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:17.514560 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1315/2615] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:18.854898 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45cf32-8e04-455f-b21c-8858731797a6 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:18.855391 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45cf32-8e04-455f-b21c-8858731797a6 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:18.855509 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45cf32-8e04-455f-b21c-8858731797a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:18.874277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-9c45cf32-8e04-455f-b21c-8858731797a6 None None] MFA Rules not processed for user `cf3e84b74ef64ebcbb2d4cb2b810126f`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:18.875511 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9c45cf32-8e04-455f-b21c-8858731797a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:18.882963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1301/2616] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:24.555766 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2fdad-d752-4772-8123-81fd06535c88 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:24.558843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-33c2fdad-d752-4772-8123-81fd06535c88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:24.687142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2fdad-d752-4772-8123-81fd06535c88 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:24.694236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5116e03-0b41-4669-a4ed-49407234b701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:24.694907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5116e03-0b41-4669-a4ed-49407234b701 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:24.695188 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5116e03-0b41-4669-a4ed-49407234b701 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:24.695464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5116e03-0b41-4669-a4ed-49407234b701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:24.697873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d5116e03-0b41-4669-a4ed-49407234b701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:24.711947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5116e03-0b41-4669-a4ed-49407234b701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:24.714039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5116e03-0b41-4669-a4ed-49407234b701 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:24.726532 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1316/2617] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:28.869185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:29.171324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45cf32-8e04-455f-b21c-8858731797a6 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:29.181294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45cf32-8e04-455f-b21c-8858731797a6 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:29.186342 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac69c7-0374-48a8-88a8-9d5a839f5b25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:29.186998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac69c7-0374-48a8-88a8-9d5a839f5b25 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:29.187272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac69c7-0374-48a8-88a8-9d5a839f5b25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:29.187858 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac69c7-0374-48a8-88a8-9d5a839f5b25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:29.190731 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-12ac69c7-0374-48a8-88a8-9d5a839f5b25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:29.282946 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac69c7-0374-48a8-88a8-9d5a839f5b25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:29.284559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac69c7-0374-48a8-88a8-9d5a839f5b25 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:29.313798 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1302/2618] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:29.415973 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5116e03-0b41-4669-a4ed-49407234b701 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:29.417440 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d5116e03-0b41-4669-a4ed-49407234b701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:29.474836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5116e03-0b41-4669-a4ed-49407234b701 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:29.478346 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca932d0f-c68b-4c0d-b36d-cc0baf87510e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:29.479010 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca932d0f-c68b-4c0d-b36d-cc0baf87510e service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:29.479268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca932d0f-c68b-4c0d-b36d-cc0baf87510e service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:29.479538 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca932d0f-c68b-4c0d-b36d-cc0baf87510e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:29.481591 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ca932d0f-c68b-4c0d-b36d-cc0baf87510e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:29.544743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca932d0f-c68b-4c0d-b36d-cc0baf87510e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:29.546194 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca932d0f-c68b-4c0d-b36d-cc0baf87510e service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:29.550634 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:29.558049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1317/2619] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:33.139542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac69c7-0374-48a8-88a8-9d5a839f5b25 service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:33.141154 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-12ac69c7-0374-48a8-88a8-9d5a839f5b25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:33.155747 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac69c7-0374-48a8-88a8-9d5a839f5b25 service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:33.161247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb0914-7568-466b-8e3e-fdca35657946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:33.161952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb0914-7568-466b-8e3e-fdca35657946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:33.162302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb0914-7568-466b-8e3e-fdca35657946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:33.162673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb0914-7568-466b-8e3e-fdca35657946 admin admin] PATH_INFO: `/v3/users/edd38bf6e5f849ff99259f9f494203d7` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:33.163934 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb0914-7568-466b-8e3e-fdca35657946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd38bf6e5f849ff99259f9f494203d7)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:33.165976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb0914-7568-466b-8e3e-fdca35657946 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:33.216866 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c0fb0914-7568-466b-8e3e-fdca35657946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd38bf6e5f849ff99259f9f494203d7'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:33.226503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c0fb0914-7568-466b-8e3e-fdca35657946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd38bf6e5f849ff99259f9f494203d7'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:33.234195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c0fb0914-7568-466b-8e3e-fdca35657946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd38bf6e5f849ff99259f9f494203d7'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:33.234958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c0fb0914-7568-466b-8e3e-fdca35657946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd38bf6e5f849ff99259f9f494203d7'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:33.247325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c0fb0914-7568-466b-8e3e-fdca35657946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd38bf6e5f849ff99259f9f494203d7'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:33.254300 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1303/2620] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:37:33 2022] DELETE /identity/v3/users/edd38bf6e5f849ff99259f9f494203d7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:33.434251 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca932d0f-c68b-4c0d-b36d-cc0baf87510e service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:33.445017 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca932d0f-c68b-4c0d-b36d-cc0baf87510e service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:33.528791 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:33.529622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:33.529979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:33.530547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f admin admin] PATH_INFO: `/v3/projects/9633b17987854aeaafef61d7452bcc9c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:33.531949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9633b17987854aeaafef61d7452bcc9c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:33.533939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:33.590872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9633b17987854aeaafef61d7452bcc9c', 'request_id': 'req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:33.598115 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9633b17987854aeaafef61d7452bcc9c', 'request_id': 'req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:33.606382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9633b17987854aeaafef61d7452bcc9c', 'request_id': 'req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:33.618474 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f admin admin] The token cache is being invalidate because project 9633b17987854aeaafef61d7452bcc9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:37:33.618889 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:33.619658 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bbb66e35-1997-4dd4-bb5d-965bb28dc46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:33.621371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1318/2621] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:37:33 2022] DELETE /identity/v3/projects/9633b17987854aeaafef61d7452bcc9c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:33.627031 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ddf82-7f15-4811-9559-3fdf14a085b5 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:33.627456 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ddf82-7f15-4811-9559-3fdf14a085b5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:33.628586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ddf82-7f15-4811-9559-3fdf14a085b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:33.648762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-e53ddf82-7f15-4811-9559-3fdf14a085b5 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:33.650123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e53ddf82-7f15-4811-9559-3fdf14a085b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:33.689155 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:33.712917 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1304/2622] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:33.721254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5697fd-6250-4622-9a11-102e1a3bd20e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:33.721570 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5697fd-6250-4622-9a11-102e1a3bd20e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:33.721845 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5697fd-6250-4622-9a11-102e1a3bd20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:33.742177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-fc5697fd-6250-4622-9a11-102e1a3bd20e None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:33.743425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fc5697fd-6250-4622-9a11-102e1a3bd20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:33.751907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1319/2623] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:33.756137 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ddf82-7f15-4811-9559-3fdf14a085b5 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:33.766106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ddf82-7f15-4811-9559-3fdf14a085b5 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:33.771457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a093-a9e5-49a4-b5d6-631086db484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:33.772123 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a093-a9e5-49a4-b5d6-631086db484e admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:33.772459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a093-a9e5-49a4-b5d6-631086db484e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:33.772737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a093-a9e5-49a4-b5d6-631086db484e admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:33.773440 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863a093-a9e5-49a4-b5d6-631086db484e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:37:33.773752 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863a093-a9e5-49a4-b5d6-631086db484e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:33.775375 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863a093-a9e5-49a4-b5d6-631086db484e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:33.787267 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1305/2624] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:37:33.791632 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5697fd-6250-4622-9a11-102e1a3bd20e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:33.801675 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5697fd-6250-4622-9a11-102e1a3bd20e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:33.806311 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc7fc2-f141-4797-b70e-057c47d3baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:33.806981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7fc2-f141-4797-b70e-057c47d3baa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:33.807266 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7fc2-f141-4797-b70e-057c47d3baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:33.807535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc7fc2-f141-4797-b70e-057c47d3baa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:33.808205 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc7fc2-f141-4797-b70e-057c47d3baa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:33.810087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc7fc2-f141-4797-b70e-057c47d3baa6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:33.839099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1320/2625] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:37:33 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:37:33.843518 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a093-a9e5-49a4-b5d6-631086db484e admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:33.853519 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a093-a9e5-49a4-b5d6-631086db484e admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:33.908928 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07ce11-a1db-498e-9914-e1d813bf33ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:33.909539 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07ce11-a1db-498e-9914-e1d813bf33ea admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:33.909823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07ce11-a1db-498e-9914-e1d813bf33ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:33.910098 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07ce11-a1db-498e-9914-e1d813bf33ea admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:33.910805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07ce11-a1db-498e-9914-e1d813bf33ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:33.912759 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07ce11-a1db-498e-9914-e1d813bf33ea admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:33.932882 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1306/2626] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:37:33 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:37:33.937005 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc7fc2-f141-4797-b70e-057c47d3baa6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:33.947931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc7fc2-f141-4797-b70e-057c47d3baa6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:33.952487 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0a786-d008-4f4f-86da-fd60b91f93d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:33.953094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0a786-d008-4f4f-86da-fd60b91f93d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:33.953377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0a786-d008-4f4f-86da-fd60b91f93d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:33.953675 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0a786-d008-4f4f-86da-fd60b91f93d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:33.954393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0a786-d008-4f4f-86da-fd60b91f93d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:33.956024 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0a786-d008-4f4f-86da-fd60b91f93d2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:33.966229 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1321/2627] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:33.969853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07ce11-a1db-498e-9914-e1d813bf33ea admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:33.988787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07ce11-a1db-498e-9914-e1d813bf33ea admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:33.998457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af170630-1e13-4162-a822-2c98d66adc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:33.999318 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170630-1e13-4162-a822-2c98d66adc7c admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:33.999850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170630-1e13-4162-a822-2c98d66adc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:34.000404 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170630-1e13-4162-a822-2c98d66adc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:34.001996 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af170630-1e13-4162-a822-2c98d66adc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:34.003834 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af170630-1e13-4162-a822-2c98d66adc7c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:34.022349 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0a786-d008-4f4f-86da-fd60b91f93d2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:34.023462 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1307/2628] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:34.035012 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0a786-d008-4f4f-86da-fd60b91f93d2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:34.041578 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2827581-8efc-43db-9fda-83b5b1b8e910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:34.042266 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2827581-8efc-43db-9fda-83b5b1b8e910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:34.042615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2827581-8efc-43db-9fda-83b5b1b8e910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:34.043143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2827581-8efc-43db-9fda-83b5b1b8e910 admin admin] PATH_INFO: `/v3/projects/02fc3d1e5f1044fcb9a615c649112b31/users/e18142de7c7844a4a4ae89a187d501d4/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:34.066091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2827581-8efc-43db-9fda-83b5b1b8e910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02fc3d1e5f1044fcb9a615c649112b31, user_id=e18142de7c7844a4a4ae89a187d501d4, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:34.071119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2827581-8efc-43db-9fda-83b5b1b8e910 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:34.088491 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1322/2629] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:37:34 2022] PUT /identity/v3/projects/02fc3d1e5f1044fcb9a615c649112b31/users/e18142de7c7844a4a4ae89a187d501d4/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:37:34.102064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915523e-a750-4267-8fd4-120548eaa722 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:34.102526 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915523e-a750-4267-8fd4-120548eaa722 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:34.102865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915523e-a750-4267-8fd4-120548eaa722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:34.131665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2915523e-a750-4267-8fd4-120548eaa722 None None] MFA Rules not processed for user `e18142de7c7844a4a4ae89a187d501d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:34.133581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2915523e-a750-4267-8fd4-120548eaa722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:34.202742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1308/2630] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:34.207160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2827581-8efc-43db-9fda-83b5b1b8e910 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:34.238038 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:34.273668 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2827581-8efc-43db-9fda-83b5b1b8e910 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:34.278343 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd041073-a31c-4477-985d-2e3c8ecb7e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:34.278984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd041073-a31c-4477-985d-2e3c8ecb7e2f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:34.279272 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd041073-a31c-4477-985d-2e3c8ecb7e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:34.279549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd041073-a31c-4477-985d-2e3c8ecb7e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:34.280210 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd041073-a31c-4477-985d-2e3c8ecb7e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:34.282657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd041073-a31c-4477-985d-2e3c8ecb7e2f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:34.309912 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1323/2631] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:37:34 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:37:34.314003 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915523e-a750-4267-8fd4-120548eaa722 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:34.324682 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915523e-a750-4267-8fd4-120548eaa722 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:34.357587 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:34.381287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89123e9f-981f-4e63-a93d-bbacda20b8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:34.381909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89123e9f-981f-4e63-a93d-bbacda20b8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:34.382187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89123e9f-981f-4e63-a93d-bbacda20b8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:34.382487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89123e9f-981f-4e63-a93d-bbacda20b8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:34.383157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89123e9f-981f-4e63-a93d-bbacda20b8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:34.385053 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89123e9f-981f-4e63-a93d-bbacda20b8a9 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:34.405522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1309/2632] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:37:34 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:37:34.410131 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd041073-a31c-4477-985d-2e3c8ecb7e2f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:34.420579 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd041073-a31c-4477-985d-2e3c8ecb7e2f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:34.425238 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d781af-9d88-4bed-8a49-0e76606a301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:34.425851 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d781af-9d88-4bed-8a49-0e76606a301f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:34.426136 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d781af-9d88-4bed-8a49-0e76606a301f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:34.426433 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d781af-9d88-4bed-8a49-0e76606a301f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:34.427138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d781af-9d88-4bed-8a49-0e76606a301f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:34.428756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d781af-9d88-4bed-8a49-0e76606a301f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:34.439306 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1324/2633] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:34.443428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89123e9f-981f-4e63-a93d-bbacda20b8a9 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:34.453425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89123e9f-981f-4e63-a93d-bbacda20b8a9 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:34.458432 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45779b3-77ab-497b-abb1-e229fc391402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:34.459094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45779b3-77ab-497b-abb1-e229fc391402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:34.459371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45779b3-77ab-497b-abb1-e229fc391402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:34.459641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45779b3-77ab-497b-abb1-e229fc391402 admin admin] PATH_INFO: `/v3/projects/7b45ad425c6549dab4d2e5ecfe0e6229/users/d4a343995f4547afaa2e8f7c7b49fcdc/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:34.476978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45779b3-77ab-497b-abb1-e229fc391402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b45ad425c6549dab4d2e5ecfe0e6229, user_id=d4a343995f4547afaa2e8f7c7b49fcdc, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:34.479673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45779b3-77ab-497b-abb1-e229fc391402 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:34.492955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1310/2634] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:37:34 2022] PUT /identity/v3/projects/7b45ad425c6549dab4d2e5ecfe0e6229/users/d4a343995f4547afaa2e8f7c7b49fcdc/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:34.497047 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d781af-9d88-4bed-8a49-0e76606a301f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:34.509459 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d781af-9d88-4bed-8a49-0e76606a301f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:34.569260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cfd70-2227-41ae-a757-2dad5570169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:34.569872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfd70-2227-41ae-a757-2dad5570169a admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:34.570152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfd70-2227-41ae-a757-2dad5570169a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:34.570444 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cfd70-2227-41ae-a757-2dad5570169a admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:34.571125 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cfd70-2227-41ae-a757-2dad5570169a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:34.572702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cfd70-2227-41ae-a757-2dad5570169a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:34.582706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1325/2635] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:34.586874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45779b3-77ab-497b-abb1-e229fc391402 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:34.597836 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45779b3-77ab-497b-abb1-e229fc391402 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:34.602305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c80cb7-e97c-4a12-8f77-5ea35507a112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:34.602976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c80cb7-e97c-4a12-8f77-5ea35507a112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:34.603378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c80cb7-e97c-4a12-8f77-5ea35507a112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:34.603610 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c80cb7-e97c-4a12-8f77-5ea35507a112 admin admin] PATH_INFO: `/v3/projects/7b45ad425c6549dab4d2e5ecfe0e6229/users/d4a343995f4547afaa2e8f7c7b49fcdc/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:34.605433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c80cb7-e97c-4a12-8f77-5ea35507a112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b45ad425c6549dab4d2e5ecfe0e6229, user_id=d4a343995f4547afaa2e8f7c7b49fcdc, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:34.608067 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c80cb7-e97c-4a12-8f77-5ea35507a112 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:34.618485 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1311/2636] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:37:34 2022] PUT /identity/v3/projects/7b45ad425c6549dab4d2e5ecfe0e6229/users/d4a343995f4547afaa2e8f7c7b49fcdc/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:37:34.629213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4b363-d889-4de6-99e8-eef2fd8a2495 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:34.629502 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4b363-d889-4de6-99e8-eef2fd8a2495 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:34.629801 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4b363-d889-4de6-99e8-eef2fd8a2495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:34.658529 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cca4b363-d889-4de6-99e8-eef2fd8a2495 None None] MFA Rules not processed for user `d4a343995f4547afaa2e8f7c7b49fcdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:34.659849 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cca4b363-d889-4de6-99e8-eef2fd8a2495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:34.732523 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1326/2637] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:34.744365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c80cb7-e97c-4a12-8f77-5ea35507a112 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:34.746118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-24c80cb7-e97c-4a12-8f77-5ea35507a112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:34.805806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c80cb7-e97c-4a12-8f77-5ea35507a112 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:34.809464 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47404d88-d493-4686-a2f3-234b8f175474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:34.810075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47404d88-d493-4686-a2f3-234b8f175474 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:34.810369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47404d88-d493-4686-a2f3-234b8f175474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:34.810654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47404d88-d493-4686-a2f3-234b8f175474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:34.819476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47404d88-d493-4686-a2f3-234b8f175474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:34.820874 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47404d88-d493-4686-a2f3-234b8f175474 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:34.830116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1312/2638] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:34.899297 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4b363-d889-4de6-99e8-eef2fd8a2495 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:34.920740 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:34.963464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4b363-d889-4de6-99e8-eef2fd8a2495 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:34.968310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89d3d1-911a-4c45-ae79-867a3e6203b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:34.968948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89d3d1-911a-4c45-ae79-867a3e6203b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:34.969231 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89d3d1-911a-4c45-ae79-867a3e6203b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:34.970073 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89d3d1-911a-4c45-ae79-867a3e6203b1 admin admin] PATH_INFO: `/v3/users/e18142de7c7844a4a4ae89a187d501d4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:34.971296 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89d3d1-911a-4c45-ae79-867a3e6203b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18142de7c7844a4a4ae89a187d501d4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:34.973219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89d3d1-911a-4c45-ae79-867a3e6203b1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:35.019208 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb89d3d1-911a-4c45-ae79-867a3e6203b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18142de7c7844a4a4ae89a187d501d4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.026618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb89d3d1-911a-4c45-ae79-867a3e6203b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18142de7c7844a4a4ae89a187d501d4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.039367 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb89d3d1-911a-4c45-ae79-867a3e6203b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18142de7c7844a4a4ae89a187d501d4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.040018 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb89d3d1-911a-4c45-ae79-867a3e6203b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18142de7c7844a4a4ae89a187d501d4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.046831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb89d3d1-911a-4c45-ae79-867a3e6203b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18142de7c7844a4a4ae89a187d501d4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.053268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1327/2639] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:37:34 2022] DELETE /identity/v3/users/e18142de7c7844a4a4ae89a187d501d4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:35.057703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b3245-4e83-4e46-8532-b5210e7b4dc0 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:35.058057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b3245-4e83-4e46-8532-b5210e7b4dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:35.058474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b3245-4e83-4e46-8532-b5210e7b4dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:35.077355 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-503b3245-4e83-4e46-8532-b5210e7b4dc0 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:35.078565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-503b3245-4e83-4e46-8532-b5210e7b4dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:35.134549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1313/2640] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:37:35.144783 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89d3d1-911a-4c45-ae79-867a3e6203b1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:35.146183 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cb89d3d1-911a-4c45-ae79-867a3e6203b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:35.330133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89d3d1-911a-4c45-ae79-867a3e6203b1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:35.333691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f9bc3-7a10-4472-b3f7-a44f91427281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:35.334310 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f9bc3-7a10-4472-b3f7-a44f91427281 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:35.334633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f9bc3-7a10-4472-b3f7-a44f91427281 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:35.334908 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f9bc3-7a10-4472-b3f7-a44f91427281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:35.344615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f9bc3-7a10-4472-b3f7-a44f91427281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:35.346035 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f9bc3-7a10-4472-b3f7-a44f91427281 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:35.355567 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1328/2641] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:35.649875 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b3245-4e83-4e46-8532-b5210e7b4dc0 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:35.651453 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-503b3245-4e83-4e46-8532-b5210e7b4dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:35.673103 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b3245-4e83-4e46-8532-b5210e7b4dc0 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:35.678205 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:35.678986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:35.679273 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:35.679551 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] PATH_INFO: `/v3/projects/02fc3d1e5f1044fcb9a615c649112b31` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:35.680990 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02fc3d1e5f1044fcb9a615c649112b31)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:35.682732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:35.714371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:35.731822 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02fc3d1e5f1044fcb9a615c649112b31', 'request_id': 'req-5fbeea75-a327-46b4-92a2-c0e76a589593'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.739262 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02fc3d1e5f1044fcb9a615c649112b31', 'request_id': 'req-5fbeea75-a327-46b4-92a2-c0e76a589593'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.745117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02fc3d1e5f1044fcb9a615c649112b31', 'request_id': 'req-5fbeea75-a327-46b4-92a2-c0e76a589593'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.756039 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] The token cache is being invalidate because project 02fc3d1e5f1044fcb9a615c649112b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:37:35.756325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.756951 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.758475 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1314/2642] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:37:35 2022] DELETE /identity/v3/projects/02fc3d1e5f1044fcb9a615c649112b31 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:35.762470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f9bc3-7a10-4472-b3f7-a44f91427281 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:35.771917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f9bc3-7a10-4472-b3f7-a44f91427281 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:35.812495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:35.831735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf4df1-f3a0-44eb-80c4-8470682d336a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:35.832299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4df1-f3a0-44eb-80c4-8470682d336a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:35.832573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4df1-f3a0-44eb-80c4-8470682d336a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:35.832840 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4df1-f3a0-44eb-80c4-8470682d336a admin admin] PATH_INFO: `/v3/users/d4a343995f4547afaa2e8f7c7b49fcdc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:35.833970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf4df1-f3a0-44eb-80c4-8470682d336a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a343995f4547afaa2e8f7c7b49fcdc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:35.835954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf4df1-f3a0-44eb-80c4-8470682d336a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:35.882265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b0cf4df1-f3a0-44eb-80c4-8470682d336a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a343995f4547afaa2e8f7c7b49fcdc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.889691 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b0cf4df1-f3a0-44eb-80c4-8470682d336a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a343995f4547afaa2e8f7c7b49fcdc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.902282 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b0cf4df1-f3a0-44eb-80c4-8470682d336a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a343995f4547afaa2e8f7c7b49fcdc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.902946 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b0cf4df1-f3a0-44eb-80c4-8470682d336a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a343995f4547afaa2e8f7c7b49fcdc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.909537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b0cf4df1-f3a0-44eb-80c4-8470682d336a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a343995f4547afaa2e8f7c7b49fcdc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:35.915974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1329/2643] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:37:35 2022] DELETE /identity/v3/users/d4a343995f4547afaa2e8f7c7b49fcdc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:36.184895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:36.186650 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:36.201443 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbeea75-a327-46b4-92a2-c0e76a589593 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:36.260961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a46871-086b-4459-af31-14814a97c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:36.261595 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a46871-086b-4459-af31-14814a97c898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:36.261880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a46871-086b-4459-af31-14814a97c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:36.262161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a46871-086b-4459-af31-14814a97c898 admin admin] PATH_INFO: `/v3/projects/7b45ad425c6549dab4d2e5ecfe0e6229` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:36.263350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a46871-086b-4459-af31-14814a97c898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b45ad425c6549dab4d2e5ecfe0e6229)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:36.265234 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a46871-086b-4459-af31-14814a97c898 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:36.310837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b6a46871-086b-4459-af31-14814a97c898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b45ad425c6549dab4d2e5ecfe0e6229', 'request_id': 'req-b6a46871-086b-4459-af31-14814a97c898'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:36.318384 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b6a46871-086b-4459-af31-14814a97c898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b45ad425c6549dab4d2e5ecfe0e6229', 'request_id': 'req-b6a46871-086b-4459-af31-14814a97c898'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:36.323845 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b6a46871-086b-4459-af31-14814a97c898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b45ad425c6549dab4d2e5ecfe0e6229', 'request_id': 'req-b6a46871-086b-4459-af31-14814a97c898'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:36.334819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b6a46871-086b-4459-af31-14814a97c898 admin admin] The token cache is being invalidate because project 7b45ad425c6549dab4d2e5ecfe0e6229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:37:36.335106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b6a46871-086b-4459-af31-14814a97c898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:36.335733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b6a46871-086b-4459-af31-14814a97c898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:36.337217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1315/2644] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:37:36 2022] DELETE /identity/v3/projects/7b45ad425c6549dab4d2e5ecfe0e6229 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:36.342248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cb23f-9216-4a49-a560-4a8abdf0de09 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:36.342565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cb23f-9216-4a49-a560-4a8abdf0de09 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:36.342838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cb23f-9216-4a49-a560-4a8abdf0de09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:36.362570 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-422cb23f-9216-4a49-a560-4a8abdf0de09 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:36.363709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-422cb23f-9216-4a49-a560-4a8abdf0de09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:36.421520 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1330/2645] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:36.429371 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f932-9dd3-4b78-b94d-3160423f9282 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:36.429817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f932-9dd3-4b78-b94d-3160423f9282 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:36.430145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f932-9dd3-4b78-b94d-3160423f9282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:36.449525 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2ff3f932-9dd3-4b78-b94d-3160423f9282 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:36.450761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2ff3f932-9dd3-4b78-b94d-3160423f9282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:36.459258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1316/2646] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:36.463615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cb23f-9216-4a49-a560-4a8abdf0de09 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:36.474058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cb23f-9216-4a49-a560-4a8abdf0de09 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:36.478806 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff60a4-3823-463a-bd9f-5ecf080190f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:36.479451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff60a4-3823-463a-bd9f-5ecf080190f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:36.479761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff60a4-3823-463a-bd9f-5ecf080190f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:36.480037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff60a4-3823-463a-bd9f-5ecf080190f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:36.480732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff60a4-3823-463a-bd9f-5ecf080190f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:37:36.481040 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff60a4-3823-463a-bd9f-5ecf080190f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:36.482694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff60a4-3823-463a-bd9f-5ecf080190f2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:36.494357 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1331/2647] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:37:36.498658 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3f932-9dd3-4b78-b94d-3160423f9282 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:36.510827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3f932-9dd3-4b78-b94d-3160423f9282 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:36.518297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98634a4c-c16d-4111-901c-fbfc875641b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:36.518942 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98634a4c-c16d-4111-901c-fbfc875641b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:36.519219 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98634a4c-c16d-4111-901c-fbfc875641b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:36.519512 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98634a4c-c16d-4111-901c-fbfc875641b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:36.520180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98634a4c-c16d-4111-901c-fbfc875641b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:36.522297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98634a4c-c16d-4111-901c-fbfc875641b1 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:36.549289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1317/2648] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:37:36 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:37:36.553398 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff60a4-3823-463a-bd9f-5ecf080190f2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:36.563225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff60a4-3823-463a-bd9f-5ecf080190f2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:36.607453 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:36.620170 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d3317-8071-473e-a2c9-878d225c9398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:36.620713 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d3317-8071-473e-a2c9-878d225c9398 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:36.621012 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d3317-8071-473e-a2c9-878d225c9398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:36.621282 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d3317-8071-473e-a2c9-878d225c9398 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:36.621944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d3317-8071-473e-a2c9-878d225c9398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:36.623866 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d3317-8071-473e-a2c9-878d225c9398 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:36.644868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1332/2649] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:37:36 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:37:36.649020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98634a4c-c16d-4111-901c-fbfc875641b1 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:36.659004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98634a4c-c16d-4111-901c-fbfc875641b1 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:36.663549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad0950-b633-40b3-9fc2-1b6c1faea826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:36.664149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad0950-b633-40b3-9fc2-1b6c1faea826 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:36.664425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad0950-b633-40b3-9fc2-1b6c1faea826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:36.664695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad0950-b633-40b3-9fc2-1b6c1faea826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:36.665382 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad0950-b633-40b3-9fc2-1b6c1faea826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:36.667088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad0950-b633-40b3-9fc2-1b6c1faea826 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:36.676765 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1318/2650] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:36.680715 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d3317-8071-473e-a2c9-878d225c9398 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:36.690992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d3317-8071-473e-a2c9-878d225c9398 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:36.697082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26ed7e-0ed7-4fb0-922d-f75cd8aeb68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:36.697689 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26ed7e-0ed7-4fb0-922d-f75cd8aeb68a admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:36.697966 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26ed7e-0ed7-4fb0-922d-f75cd8aeb68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:36.698232 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26ed7e-0ed7-4fb0-922d-f75cd8aeb68a admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:36.699019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26ed7e-0ed7-4fb0-922d-f75cd8aeb68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:36.700595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26ed7e-0ed7-4fb0-922d-f75cd8aeb68a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:36.711308 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1333/2651] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:36.715776 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad0950-b633-40b3-9fc2-1b6c1faea826 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:36.725613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad0950-b633-40b3-9fc2-1b6c1faea826 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:36.730209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a74c0-7668-4133-a01c-653d38d95339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:36.730895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a74c0-7668-4133-a01c-653d38d95339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:36.731174 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a74c0-7668-4133-a01c-653d38d95339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:36.731446 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a74c0-7668-4133-a01c-653d38d95339 admin admin] PATH_INFO: `/v3/projects/70f9e093a8cb421ab78d9a242ee1f238/users/25aee94c64144bf6b1133299b2815e44/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:36.733672 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:36.748959 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a74c0-7668-4133-a01c-653d38d95339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f9e093a8cb421ab78d9a242ee1f238, user_id=25aee94c64144bf6b1133299b2815e44, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:36.751737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a74c0-7668-4133-a01c-653d38d95339 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:36.765766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1319/2652] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:37:36 2022] PUT /identity/v3/projects/70f9e093a8cb421ab78d9a242ee1f238/users/25aee94c64144bf6b1133299b2815e44/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:37:36.777738 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0f58f-854e-48f4-a325-96b5a9e7411f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:36.778264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0f58f-854e-48f4-a325-96b5a9e7411f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:36.778481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0f58f-854e-48f4-a325-96b5a9e7411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:36.808991 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b7b0f58f-854e-48f4-a325-96b5a9e7411f None None] MFA Rules not processed for user `25aee94c64144bf6b1133299b2815e44`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:36.810292 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b7b0f58f-854e-48f4-a325-96b5a9e7411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:36.889707 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1334/2653] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:36.894689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a74c0-7668-4133-a01c-653d38d95339 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:36.955753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a74c0-7668-4133-a01c-653d38d95339 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:36.960325 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271248d-341f-4224-b0fa-a14fb073db07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:36.961048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271248d-341f-4224-b0fa-a14fb073db07 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:36.961334 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271248d-341f-4224-b0fa-a14fb073db07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:36.961612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271248d-341f-4224-b0fa-a14fb073db07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:36.962270 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271248d-341f-4224-b0fa-a14fb073db07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:36.964163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271248d-341f-4224-b0fa-a14fb073db07 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:36.990309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1320/2654] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:37:36 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:37:36.994173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0f58f-854e-48f4-a325-96b5a9e7411f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:37.005722 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0f58f-854e-48f4-a325-96b5a9e7411f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:37.059577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28375564-30c8-4e11-ba9f-4986b6ba1b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:37.060187 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28375564-30c8-4e11-ba9f-4986b6ba1b18 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:37.060463 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28375564-30c8-4e11-ba9f-4986b6ba1b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:37.060735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28375564-30c8-4e11-ba9f-4986b6ba1b18 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:37.061393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28375564-30c8-4e11-ba9f-4986b6ba1b18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:37.063328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28375564-30c8-4e11-ba9f-4986b6ba1b18 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:37.085036 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1335/2655] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:37:36 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:37:37.088969 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271248d-341f-4224-b0fa-a14fb073db07 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:37.099507 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271248d-341f-4224-b0fa-a14fb073db07 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:37.104254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972afefa-fe24-44df-9d5d-ba6e75b0ced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:37.104902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972afefa-fe24-44df-9d5d-ba6e75b0ced5 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:37.105296 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972afefa-fe24-44df-9d5d-ba6e75b0ced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:37.105733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972afefa-fe24-44df-9d5d-ba6e75b0ced5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:37.106470 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972afefa-fe24-44df-9d5d-ba6e75b0ced5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:37.108095 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972afefa-fe24-44df-9d5d-ba6e75b0ced5 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:37.119223 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1321/2656] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:37.123327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28375564-30c8-4e11-ba9f-4986b6ba1b18 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:37.133771 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28375564-30c8-4e11-ba9f-4986b6ba1b18 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:37.138344 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5853f8-3390-4e0e-891e-c75b66b901fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:37.139032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5853f8-3390-4e0e-891e-c75b66b901fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:37.139316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5853f8-3390-4e0e-891e-c75b66b901fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:37.139595 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5853f8-3390-4e0e-891e-c75b66b901fd admin admin] PATH_INFO: `/v3/projects/15d01408f7e646e884d27bcc1c1dde8b/users/27458aa02e8e40a0ba2323963b526ef2/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:37.154232 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5853f8-3390-4e0e-891e-c75b66b901fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d01408f7e646e884d27bcc1c1dde8b, user_id=27458aa02e8e40a0ba2323963b526ef2, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:37.157105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5853f8-3390-4e0e-891e-c75b66b901fd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:37.169776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1336/2657] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:37:37 2022] PUT /identity/v3/projects/15d01408f7e646e884d27bcc1c1dde8b/users/27458aa02e8e40a0ba2323963b526ef2/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:37:37.174269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972afefa-fe24-44df-9d5d-ba6e75b0ced5 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:37.184106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972afefa-fe24-44df-9d5d-ba6e75b0ced5 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:37.250777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65c4f1-0319-4f66-8368-d6299ca586ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:37.251400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65c4f1-0319-4f66-8368-d6299ca586ea admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:37.251678 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65c4f1-0319-4f66-8368-d6299ca586ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:37.252608 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65c4f1-0319-4f66-8368-d6299ca586ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:37.253309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65c4f1-0319-4f66-8368-d6299ca586ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:37.254912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65c4f1-0319-4f66-8368-d6299ca586ea admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:37.264739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1322/2658] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:37.268829 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5853f8-3390-4e0e-891e-c75b66b901fd admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:37.278860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5853f8-3390-4e0e-891e-c75b66b901fd admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:37.283313 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370812c-5d1a-4df3-a16c-3ce21f83a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:37.283962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370812c-5d1a-4df3-a16c-3ce21f83a4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:37.284238 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370812c-5d1a-4df3-a16c-3ce21f83a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:37.284506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370812c-5d1a-4df3-a16c-3ce21f83a4c8 admin admin] PATH_INFO: `/v3/projects/15d01408f7e646e884d27bcc1c1dde8b/users/27458aa02e8e40a0ba2323963b526ef2/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:37.286429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370812c-5d1a-4df3-a16c-3ce21f83a4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d01408f7e646e884d27bcc1c1dde8b, user_id=27458aa02e8e40a0ba2323963b526ef2, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:37.289028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370812c-5d1a-4df3-a16c-3ce21f83a4c8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:37.299848 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1337/2659] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:37:37 2022] PUT /identity/v3/projects/15d01408f7e646e884d27bcc1c1dde8b/users/27458aa02e8e40a0ba2323963b526ef2/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:37.310069 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a1dc5-c20c-4b9d-b04f-595aaf1eb38a None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:37.310363 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a1dc5-c20c-4b9d-b04f-595aaf1eb38a None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:37.310678 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a1dc5-c20c-4b9d-b04f-595aaf1eb38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:37.338808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-6b2a1dc5-c20c-4b9d-b04f-595aaf1eb38a None None] MFA Rules not processed for user `27458aa02e8e40a0ba2323963b526ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:37.340287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-6b2a1dc5-c20c-4b9d-b04f-595aaf1eb38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:37.381559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:37.412002 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1323/2660] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:37:37.422681 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370812c-5d1a-4df3-a16c-3ce21f83a4c8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:37.424960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1370812c-5d1a-4df3-a16c-3ce21f83a4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:37.437448 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:37.483913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370812c-5d1a-4df3-a16c-3ce21f83a4c8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:37.488115 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811ae29-1e9a-49b2-948b-906416200273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:37.488726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811ae29-1e9a-49b2-948b-906416200273 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:37.489004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811ae29-1e9a-49b2-948b-906416200273 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:37.489276 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811ae29-1e9a-49b2-948b-906416200273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:37.498118 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811ae29-1e9a-49b2-948b-906416200273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:37.499565 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811ae29-1e9a-49b2-948b-906416200273 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:37.508799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1338/2661] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:38.100552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a1dc5-c20c-4b9d-b04f-595aaf1eb38a None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:38.167824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a1dc5-c20c-4b9d-b04f-595aaf1eb38a None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:38.173315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1cae1-1eaa-418c-9a21-409c249334f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:38.174602 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1cae1-1eaa-418c-9a21-409c249334f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:38.174868 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1cae1-1eaa-418c-9a21-409c249334f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:38.175136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1cae1-1eaa-418c-9a21-409c249334f4 admin admin] PATH_INFO: `/v3/users/25aee94c64144bf6b1133299b2815e44` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:38.176335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1cae1-1eaa-418c-9a21-409c249334f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25aee94c64144bf6b1133299b2815e44)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:38.178241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1cae1-1eaa-418c-9a21-409c249334f4 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:38.231201 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-99d1cae1-1eaa-418c-9a21-409c249334f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25aee94c64144bf6b1133299b2815e44'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:38.239040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-99d1cae1-1eaa-418c-9a21-409c249334f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25aee94c64144bf6b1133299b2815e44'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:38.246356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-99d1cae1-1eaa-418c-9a21-409c249334f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25aee94c64144bf6b1133299b2815e44'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:38.247037 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-99d1cae1-1eaa-418c-9a21-409c249334f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25aee94c64144bf6b1133299b2815e44'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:38.265479 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-99d1cae1-1eaa-418c-9a21-409c249334f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25aee94c64144bf6b1133299b2815e44'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:38.274479 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1324/2662] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:37:38 2022] DELETE /identity/v3/users/25aee94c64144bf6b1133299b2815e44 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:38.278754 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062048cd-cf14-4aa3-b292-1731c2c783d0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:38.279264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062048cd-cf14-4aa3-b292-1731c2c783d0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:38.279608 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062048cd-cf14-4aa3-b292-1731c2c783d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:38.300820 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-062048cd-cf14-4aa3-b292-1731c2c783d0 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:38.302281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-062048cd-cf14-4aa3-b292-1731c2c783d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:38.380431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1339/2663] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:37:38.391868 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1cae1-1eaa-418c-9a21-409c249334f4 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:38.393883 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-99d1cae1-1eaa-418c-9a21-409c249334f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:38.468197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1cae1-1eaa-418c-9a21-409c249334f4 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:38.472564 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16269dc-f78a-4b2f-9de7-5426c145a6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:38.473197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16269dc-f78a-4b2f-9de7-5426c145a6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:38.473569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16269dc-f78a-4b2f-9de7-5426c145a6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:38.473744 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16269dc-f78a-4b2f-9de7-5426c145a6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:38.483395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16269dc-f78a-4b2f-9de7-5426c145a6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:38.484818 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16269dc-f78a-4b2f-9de7-5426c145a6b4 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:38.490452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:38.496046 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1325/2664] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:38.766232 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062048cd-cf14-4aa3-b292-1731c2c783d0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:38.768283 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-062048cd-cf14-4aa3-b292-1731c2c783d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:38.781935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062048cd-cf14-4aa3-b292-1731c2c783d0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:38.787436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d27a7a-138f-4084-b769-8b63055a6574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:38.788079 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d27a7a-138f-4084-b769-8b63055a6574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:38.788360 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d27a7a-138f-4084-b769-8b63055a6574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:38.788668 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d27a7a-138f-4084-b769-8b63055a6574 admin admin] PATH_INFO: `/v3/projects/70f9e093a8cb421ab78d9a242ee1f238` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:38.789853 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d27a7a-138f-4084-b769-8b63055a6574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f9e093a8cb421ab78d9a242ee1f238)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:38.792505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d27a7a-138f-4084-b769-8b63055a6574 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:38.841494 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c6d27a7a-138f-4084-b769-8b63055a6574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f9e093a8cb421ab78d9a242ee1f238', 'request_id': 'req-c6d27a7a-138f-4084-b769-8b63055a6574'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:38.848423 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c6d27a7a-138f-4084-b769-8b63055a6574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f9e093a8cb421ab78d9a242ee1f238', 'request_id': 'req-c6d27a7a-138f-4084-b769-8b63055a6574'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:38.856128 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c6d27a7a-138f-4084-b769-8b63055a6574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f9e093a8cb421ab78d9a242ee1f238', 'request_id': 'req-c6d27a7a-138f-4084-b769-8b63055a6574'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:38.866924 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c6d27a7a-138f-4084-b769-8b63055a6574 admin admin] The token cache is being invalidate because project 70f9e093a8cb421ab78d9a242ee1f238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:37:38.867213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c6d27a7a-138f-4084-b769-8b63055a6574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:38.867833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c6d27a7a-138f-4084-b769-8b63055a6574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:38.869336 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1340/2665] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:37:38 2022] DELETE /identity/v3/projects/70f9e093a8cb421ab78d9a242ee1f238 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:38.873233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16269dc-f78a-4b2f-9de7-5426c145a6b4 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:38.884177 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16269dc-f78a-4b2f-9de7-5426c145a6b4 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:38.944241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a053c2c-9190-47ef-99cb-027519f57ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:38.944884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a053c2c-9190-47ef-99cb-027519f57ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:38.945168 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a053c2c-9190-47ef-99cb-027519f57ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:38.945444 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a053c2c-9190-47ef-99cb-027519f57ecd admin admin] PATH_INFO: `/v3/users/27458aa02e8e40a0ba2323963b526ef2` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:38.946718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a053c2c-9190-47ef-99cb-027519f57ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=27458aa02e8e40a0ba2323963b526ef2)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:38.948651 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a053c2c-9190-47ef-99cb-027519f57ecd admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:38.996483 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2a053c2c-9190-47ef-99cb-027519f57ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27458aa02e8e40a0ba2323963b526ef2'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:39.006315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2a053c2c-9190-47ef-99cb-027519f57ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27458aa02e8e40a0ba2323963b526ef2'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:39.014396 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2a053c2c-9190-47ef-99cb-027519f57ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27458aa02e8e40a0ba2323963b526ef2'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:39.015122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2a053c2c-9190-47ef-99cb-027519f57ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27458aa02e8e40a0ba2323963b526ef2'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:39.028830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2a053c2c-9190-47ef-99cb-027519f57ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27458aa02e8e40a0ba2323963b526ef2'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:39.034842 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1326/2666] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:37:38 2022] DELETE /identity/v3/users/27458aa02e8e40a0ba2323963b526ef2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:39.293119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfc8bb-463b-4004-a895-ce5121fae6c5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:39.293953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfc8bb-463b-4004-a895-ce5121fae6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:39.294451 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfc8bb-463b-4004-a895-ce5121fae6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:39.320197 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a053c2c-9190-47ef-99cb-027519f57ecd admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:39.321998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2a053c2c-9190-47ef-99cb-027519f57ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:39.351426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f3bfc8bb-463b-4004-a895-ce5121fae6c5 None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:39.353108 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f3bfc8bb-463b-4004-a895-ce5121fae6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:39.358934 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:39.402008 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a053c2c-9190-47ef-99cb-027519f57ecd admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:39.406702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:39.407348 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:39.407632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:39.407909 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a admin admin] PATH_INFO: `/v3/projects/15d01408f7e646e884d27bcc1c1dde8b` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:39.409107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d01408f7e646e884d27bcc1c1dde8b)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:39.411049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:39.424714 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1341/2667] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:37:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:39.434737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:39.464263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d01408f7e646e884d27bcc1c1dde8b', 'request_id': 'req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:39.472962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d01408f7e646e884d27bcc1c1dde8b', 'request_id': 'req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:39.475583 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfc8bb-463b-4004-a895-ce5121fae6c5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:39.476944 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f3bfc8bb-463b-4004-a895-ce5121fae6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:39.479117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d01408f7e646e884d27bcc1c1dde8b', 'request_id': 'req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:39.491389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a admin admin] The token cache is being invalidate because project 15d01408f7e646e884d27bcc1c1dde8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:37:39.491694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:39.492361 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e1b904ce-7839-43a0-9c6e-71e08a02ae9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:39.494014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1327/2668] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:37:39 2022] DELETE /identity/v3/projects/15d01408f7e646e884d27bcc1c1dde8b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:37:39.498662 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c80ca-47e8-4e93-99e6-d40cc6e95e42 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:39.498779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c80ca-47e8-4e93-99e6-d40cc6e95e42 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:39.499042 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c80ca-47e8-4e93-99e6-d40cc6e95e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:39.519478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a91c80ca-47e8-4e93-99e6-d40cc6e95e42 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:39.520694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a91c80ca-47e8-4e93-99e6-d40cc6e95e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:39.570911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfc8bb-463b-4004-a895-ce5121fae6c5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:39.581184 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1328/2669] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:37:39.588612 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318602-9b7a-41c5-80bc-86f07a2603ee None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:39.588899 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318602-9b7a-41c5-80bc-86f07a2603ee None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:39.589173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318602-9b7a-41c5-80bc-86f07a2603ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:39.608655 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-08318602-9b7a-41c5-80bc-86f07a2603ee None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:39.609870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-08318602-9b7a-41c5-80bc-86f07a2603ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:39.618580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1329/2670] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:37:39.622593 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08318602-9b7a-41c5-80bc-86f07a2603ee None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:39.631274 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccf1a7-180b-4b18-8325-0c6bea7d488c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:39.631897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccf1a7-180b-4b18-8325-0c6bea7d488c service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:39.632180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccf1a7-180b-4b18-8325-0c6bea7d488c service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:39.632458 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccf1a7-180b-4b18-8325-0c6bea7d488c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:39.632580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08318602-9b7a-41c5-80bc-86f07a2603ee None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:39.634234 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6bccf1a7-180b-4b18-8325-0c6bea7d488c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:39.637161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4443983-1db1-4dc7-85ce-82a60bcadc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:39.637753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443983-1db1-4dc7-85ce-82a60bcadc44 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:39.638088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443983-1db1-4dc7-85ce-82a60bcadc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:39.638893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443983-1db1-4dc7-85ce-82a60bcadc44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:39.639020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4443983-1db1-4dc7-85ce-82a60bcadc44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:37:39.639320 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4443983-1db1-4dc7-85ce-82a60bcadc44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:39.641007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4443983-1db1-4dc7-85ce-82a60bcadc44 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:39.652725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1330/2671] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:37:39.657133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4443983-1db1-4dc7-85ce-82a60bcadc44 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:39.667261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4443983-1db1-4dc7-85ce-82a60bcadc44 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:39.670360 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:39.672207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58025dcc-d179-46f6-98a3-43d9bd7b0897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:39.672979 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58025dcc-d179-46f6-98a3-43d9bd7b0897 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:39.673263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58025dcc-d179-46f6-98a3-43d9bd7b0897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:39.673545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58025dcc-d179-46f6-98a3-43d9bd7b0897 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:39.674829 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58025dcc-d179-46f6-98a3-43d9bd7b0897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:39.676753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58025dcc-d179-46f6-98a3-43d9bd7b0897 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:39.700520 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccf1a7-180b-4b18-8325-0c6bea7d488c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:39.702479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccf1a7-180b-4b18-8325-0c6bea7d488c service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:39.706261 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1331/2672] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:37:39 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:37:39.710321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58025dcc-d179-46f6-98a3-43d9bd7b0897 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:39.711471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1342/2673] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:37:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 22:37:39.774322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58025dcc-d179-46f6-98a3-43d9bd7b0897 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:39.779520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16652239-1a8d-45d5-99b0-807bc62ee901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:39.780140 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16652239-1a8d-45d5-99b0-807bc62ee901 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:39.780437 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16652239-1a8d-45d5-99b0-807bc62ee901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:39.780703 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16652239-1a8d-45d5-99b0-807bc62ee901 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:39.781369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16652239-1a8d-45d5-99b0-807bc62ee901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:39.783873 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16652239-1a8d-45d5-99b0-807bc62ee901 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:39.800619 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:39.813215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1332/2674] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:37:39 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:37:39.813956 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccf1a7-180b-4b18-8325-0c6bea7d488c service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:39.827699 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccf1a7-180b-4b18-8325-0c6bea7d488c service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:39.832357 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a851f8-5096-401f-b265-36263095268f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:39.832971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a851f8-5096-401f-b265-36263095268f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:39.833256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a851f8-5096-401f-b265-36263095268f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:39.833535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a851f8-5096-401f-b265-36263095268f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:39.834225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a851f8-5096-401f-b265-36263095268f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:39.835858 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a851f8-5096-401f-b265-36263095268f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:39.850477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1343/2675] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:39.852499 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16652239-1a8d-45d5-99b0-807bc62ee901 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:39.863015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16652239-1a8d-45d5-99b0-807bc62ee901 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:39.867676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57b172-4d0e-48b7-b61d-171f250d6256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:39.868285 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57b172-4d0e-48b7-b61d-171f250d6256 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:39.868569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57b172-4d0e-48b7-b61d-171f250d6256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:39.868848 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57b172-4d0e-48b7-b61d-171f250d6256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:39.869539 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57b172-4d0e-48b7-b61d-171f250d6256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:39.871151 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57b172-4d0e-48b7-b61d-171f250d6256 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:39.881398 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1333/2676] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:39.886107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a851f8-5096-401f-b265-36263095268f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:39.896193 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a851f8-5096-401f-b265-36263095268f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:39.900834 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30faa4-4421-453d-832e-e410e93607cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:39.901490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30faa4-4421-453d-832e-e410e93607cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:39.901769 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30faa4-4421-453d-832e-e410e93607cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:39.902043 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30faa4-4421-453d-832e-e410e93607cc admin admin] PATH_INFO: `/v3/projects/e8865947676047c1918131ad8a2ba025/users/0ece68d68a714758985d3bcc330f5d4a/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:39.921490 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30faa4-4421-453d-832e-e410e93607cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8865947676047c1918131ad8a2ba025, user_id=0ece68d68a714758985d3bcc330f5d4a, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:39.925252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30faa4-4421-453d-832e-e410e93607cc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:39.939429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1344/2677] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:37:39 2022] PUT /identity/v3/projects/e8865947676047c1918131ad8a2ba025/users/0ece68d68a714758985d3bcc330f5d4a/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:37:39.944279 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc6c08-825c-4334-a2cc-b164edb26283 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:39.944568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc6c08-825c-4334-a2cc-b164edb26283 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:39.944843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc6c08-825c-4334-a2cc-b164edb26283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:39.963819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-74cc6c08-825c-4334-a2cc-b164edb26283 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:39.965293 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-74cc6c08-825c-4334-a2cc-b164edb26283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:40.038700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1334/2678] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:40.049395 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30faa4-4421-453d-832e-e410e93607cc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:40.051153 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2f30faa4-4421-453d-832e-e410e93607cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:40.111060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30faa4-4421-453d-832e-e410e93607cc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:40.114713 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae1f44-8984-4e8c-a144-50c3ef172f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:40.115439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae1f44-8984-4e8c-a144-50c3ef172f8d service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:40.115724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae1f44-8984-4e8c-a144-50c3ef172f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:40.115997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae1f44-8984-4e8c-a144-50c3ef172f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:40.127261 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae1f44-8984-4e8c-a144-50c3ef172f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:40.128689 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae1f44-8984-4e8c-a144-50c3ef172f8d service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:40.138749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1345/2679] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:40.257535 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d5c3a-2731-487f-8bb4-9a1c034c7a2e None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:40.257817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d5c3a-2731-487f-8bb4-9a1c034c7a2e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:40.258089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d5c3a-2731-487f-8bb4-9a1c034c7a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:40.277613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-0d1d5c3a-2731-487f-8bb4-9a1c034c7a2e None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:40.278842 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0d1d5c3a-2731-487f-8bb4-9a1c034c7a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:40.343620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1335/2680] 10.222.0.27 () {58 vars in 967 bytes} [Thu Aug 4 22:37:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:40.355427 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae1f44-8984-4e8c-a144-50c3ef172f8d service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:40.356959 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f8ae1f44-8984-4e8c-a144-50c3ef172f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:40.430706 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae1f44-8984-4e8c-a144-50c3ef172f8d service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:40.435719 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87905d4f-9746-4b9c-a9cc-660753df2c7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:40.436331 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87905d4f-9746-4b9c-a9cc-660753df2c7a service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:40.436613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87905d4f-9746-4b9c-a9cc-660753df2c7a service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:40.436996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87905d4f-9746-4b9c-a9cc-660753df2c7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:40.446618 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87905d4f-9746-4b9c-a9cc-660753df2c7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:40.449088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87905d4f-9746-4b9c-a9cc-660753df2c7a service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:40.458078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1346/2681] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:37:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:37:40.700606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a9b4-a80f-40b3-8056-8cb1dc8af349 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:40.700896 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a9b4-a80f-40b3-8056-8cb1dc8af349 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:40.701198 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a9b4-a80f-40b3-8056-8cb1dc8af349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:40.722146 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-e018a9b4-a80f-40b3-8056-8cb1dc8af349 None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:40.723373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e018a9b4-a80f-40b3-8056-8cb1dc8af349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:40.730546 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1336/2682] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:37:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:37:40.743631 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87905d4f-9746-4b9c-a9cc-660753df2c7a service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:40.755854 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87905d4f-9746-4b9c-a9cc-660753df2c7a service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:40.760905 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428d388-7cf0-4328-940d-2d00ae65ff45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:40.761552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428d388-7cf0-4328-940d-2d00ae65ff45 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:40.762011 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428d388-7cf0-4328-940d-2d00ae65ff45 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:40.762486 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428d388-7cf0-4328-940d-2d00ae65ff45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:40.772111 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428d388-7cf0-4328-940d-2d00ae65ff45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:40.773981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428d388-7cf0-4328-940d-2d00ae65ff45 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:40.782923 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1347/2683] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:37:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:37:40.829695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580e1b3-c4e5-4e64-9c49-5c117fb0f71e None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:40.830700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580e1b3-c4e5-4e64-9c49-5c117fb0f71e None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:40.831180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580e1b3-c4e5-4e64-9c49-5c117fb0f71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:40.861035 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b580e1b3-c4e5-4e64-9c49-5c117fb0f71e None None] MFA Rules not processed for user `0ece68d68a714758985d3bcc330f5d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:40.862842 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b580e1b3-c4e5-4e64-9c49-5c117fb0f71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:40.954443 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1337/2684] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:40.957026 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428d388-7cf0-4328-940d-2d00ae65ff45 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:40.969348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428d388-7cf0-4328-940d-2d00ae65ff45 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:40.975006 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ff873-3800-453c-b469-f64be0cc2ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:40.975779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ff873-3800-453c-b469-f64be0cc2ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:40.975922 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ff873-3800-453c-b469-f64be0cc2ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:40.976160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ff873-3800-453c-b469-f64be0cc2ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:40.976830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ff873-3800-453c-b469-f64be0cc2ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:40.980255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ff873-3800-453c-b469-f64be0cc2ed2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:40.996948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:41.015144 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1348/2685] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:37:40 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:37:41.019247 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580e1b3-c4e5-4e64-9c49-5c117fb0f71e None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:41.030513 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580e1b3-c4e5-4e64-9c49-5c117fb0f71e None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:41.043689 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=100 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:41.092800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eb4db-e653-4537-a663-0b431c3de4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:41.093553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eb4db-e653-4537-a663-0b431c3de4ff admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:41.093840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eb4db-e653-4537-a663-0b431c3de4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:41.094116 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eb4db-e653-4537-a663-0b431c3de4ff admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:41.094969 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eb4db-e653-4537-a663-0b431c3de4ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:41.096968 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eb4db-e653-4537-a663-0b431c3de4ff admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:41.124307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1338/2686] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:37:41 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:37:41.125515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ff873-3800-453c-b469-f64be0cc2ed2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:41.138650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ff873-3800-453c-b469-f64be0cc2ed2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:41.141283 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d832a5b-b7ff-47a5-bc76-97d939a4b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:41.141897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d832a5b-b7ff-47a5-bc76-97d939a4b410 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:41.142177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d832a5b-b7ff-47a5-bc76-97d939a4b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:41.142522 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d832a5b-b7ff-47a5-bc76-97d939a4b410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:41.143245 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d832a5b-b7ff-47a5-bc76-97d939a4b410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:41.144841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d832a5b-b7ff-47a5-bc76-97d939a4b410 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:41.156794 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1349/2687] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:41.161725 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eb4db-e653-4537-a663-0b431c3de4ff admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:41.165514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fffb1-436a-4d2e-acc5-f0b7e497a5ab None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:41.165793 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fffb1-436a-4d2e-acc5-f0b7e497a5ab None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:41.166063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fffb1-436a-4d2e-acc5-f0b7e497a5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:41.172024 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eb4db-e653-4537-a663-0b431c3de4ff admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:41.177321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c08296-56da-4c86-8a02-af60895b30b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:41.177998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08296-56da-4c86-8a02-af60895b30b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:41.178287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08296-56da-4c86-8a02-af60895b30b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:41.178675 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08296-56da-4c86-8a02-af60895b30b7 admin admin] PATH_INFO: `/v3/projects/05b284eb64954cf98ae297d056e265b1/users/7f32f52dbc5644a882befa1a19daf1da/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:41.185130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-667fffb1-436a-4d2e-acc5-f0b7e497a5ab None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:41.186344 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-667fffb1-436a-4d2e-acc5-f0b7e497a5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:41.193971 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c08296-56da-4c86-8a02-af60895b30b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b284eb64954cf98ae297d056e265b1, user_id=7f32f52dbc5644a882befa1a19daf1da, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:41.196673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c08296-56da-4c86-8a02-af60895b30b7 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:41.210694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1339/2688] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:37:41 2022] PUT /identity/v3/projects/05b284eb64954cf98ae297d056e265b1/users/7f32f52dbc5644a882befa1a19daf1da/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:41.215431 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c08296-56da-4c86-8a02-af60895b30b7 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:41.252529 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1350/2689] 10.222.0.27 () {58 vars in 967 bytes} [Thu Aug 4 22:37:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:37:41.265626 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fffb1-436a-4d2e-acc5-f0b7e497a5ab None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:41.289118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c08296-56da-4c86-8a02-af60895b30b7 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:41.294837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce93f0-5add-409e-9534-9ddc80440b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:41.295459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce93f0-5add-409e-9534-9ddc80440b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:41.295746 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce93f0-5add-409e-9534-9ddc80440b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:41.296417 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce93f0-5add-409e-9534-9ddc80440b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:41.296736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce93f0-5add-409e-9534-9ddc80440b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:41.298389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce93f0-5add-409e-9534-9ddc80440b69 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:41.309806 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1340/2690] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:37:41.313835 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce93f0-5add-409e-9534-9ddc80440b69 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:41.324038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce93f0-5add-409e-9534-9ddc80440b69 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:41.328723 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7ed6f-5275-40ba-b084-bf7f3a53410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:41.329369 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7ed6f-5275-40ba-b084-bf7f3a53410c admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:41.329656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7ed6f-5275-40ba-b084-bf7f3a53410c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:41.330542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7ed6f-5275-40ba-b084-bf7f3a53410c admin admin] PATH_INFO: `/v3/projects/05b284eb64954cf98ae297d056e265b1/users/7f32f52dbc5644a882befa1a19daf1da/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:41.332524 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7ed6f-5275-40ba-b084-bf7f3a53410c admin admin] RBAC: Authorizing `identity:create_grant(project_id=05b284eb64954cf98ae297d056e265b1, user_id=7f32f52dbc5644a882befa1a19daf1da, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:41.335181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7ed6f-5275-40ba-b084-bf7f3a53410c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:41.336099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fffb1-436a-4d2e-acc5-f0b7e497a5ab None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:41.346670 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1341/2691] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:37:41 2022] PUT /identity/v3/projects/05b284eb64954cf98ae297d056e265b1/users/7f32f52dbc5644a882befa1a19daf1da/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:37:41.406996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e060e5-bc10-4db5-b712-f10c666c0564 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:41.407790 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e060e5-bc10-4db5-b712-f10c666c0564 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:41.407911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e060e5-bc10-4db5-b712-f10c666c0564 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:41.408725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e060e5-bc10-4db5-b712-f10c666c0564 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:41.441089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:41.483673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e060e5-bc10-4db5-b712-f10c666c0564 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:41.487323 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e060e5-bc10-4db5-b712-f10c666c0564 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:41.496892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1351/2692] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:37:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 04 22:37:42.117193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d0f39-5db9-42ca-aa41-0bc6fd2bc2c3 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:42.117585 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d0f39-5db9-42ca-aa41-0bc6fd2bc2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:42.117959 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d0f39-5db9-42ca-aa41-0bc6fd2bc2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:42.152360 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-983d0f39-5db9-42ca-aa41-0bc6fd2bc2c3 None None] MFA Rules not processed for user `7f32f52dbc5644a882befa1a19daf1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:42.154741 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-983d0f39-5db9-42ca-aa41-0bc6fd2bc2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:42.218060 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:42.257569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1342/2693] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:42.260328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f6eb1-9d35-4ac2-bf9a-8dfa15205fcc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:42.260615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f6eb1-9d35-4ac2-bf9a-8dfa15205fcc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:42.260885 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f6eb1-9d35-4ac2-bf9a-8dfa15205fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:42.283260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c21f6eb1-9d35-4ac2-bf9a-8dfa15205fcc None None] MFA Rules not processed for user `0ece68d68a714758985d3bcc330f5d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:42.284411 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c21f6eb1-9d35-4ac2-bf9a-8dfa15205fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:42.362028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1352/2694] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:42.379088 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d0f39-5db9-42ca-aa41-0bc6fd2bc2c3 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:42.381245 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-983d0f39-5db9-42ca-aa41-0bc6fd2bc2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:42.485843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d0f39-5db9-42ca-aa41-0bc6fd2bc2c3 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:42.492156 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03593c2a-f9e9-49e3-b0b3-2273029107bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:42.492646 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03593c2a-f9e9-49e3-b0b3-2273029107bc service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:42.492929 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03593c2a-f9e9-49e3-b0b3-2273029107bc service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:42.493232 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03593c2a-f9e9-49e3-b0b3-2273029107bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:42.501568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03593c2a-f9e9-49e3-b0b3-2273029107bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:42.503762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03593c2a-f9e9-49e3-b0b3-2273029107bc service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:42.516735 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1343/2695] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:43.067807 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f6eb1-9d35-4ac2-bf9a-8dfa15205fcc None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:43.069203 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c21f6eb1-9d35-4ac2-bf9a-8dfa15205fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:43.150045 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f6eb1-9d35-4ac2-bf9a-8dfa15205fcc None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:43.155148 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de0ac7-65b1-4be1-ab72-2572235d43d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2448489cc4ad1a6fd3096ebd3f746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:43.155769 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de0ac7-65b1-4be1-ab72-2572235d43d2 service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:43.156184 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de0ac7-65b1-4be1-ab72-2572235d43d2 service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:43.156460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de0ac7-65b1-4be1-ab72-2572235d43d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:43.158273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e8de0ac7-65b1-4be1-ab72-2572235d43d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:43.171429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de0ac7-65b1-4be1-ab72-2572235d43d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:43.172645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de0ac7-65b1-4be1-ab72-2572235d43d2 service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:43.183106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1353/2696] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:43.746193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03593c2a-f9e9-49e3-b0b3-2273029107bc service nova] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:43.747674 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-03593c2a-f9e9-49e3-b0b3-2273029107bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:43.820730 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03593c2a-f9e9-49e3-b0b3-2273029107bc service nova] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:43.825618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b350c-641d-4cd2-80e6-5f2ad71d01bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:43.826268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b350c-641d-4cd2-80e6-5f2ad71d01bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:43.826592 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b350c-641d-4cd2-80e6-5f2ad71d01bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:43.826876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b350c-641d-4cd2-80e6-5f2ad71d01bf admin admin] PATH_INFO: `/v3/users/cf3e84b74ef64ebcbb2d4cb2b810126f` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:43.828053 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b350c-641d-4cd2-80e6-5f2ad71d01bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3e84b74ef64ebcbb2d4cb2b810126f)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:43.830603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b350c-641d-4cd2-80e6-5f2ad71d01bf admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:43.878803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e82b350c-641d-4cd2-80e6-5f2ad71d01bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3e84b74ef64ebcbb2d4cb2b810126f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:43.886064 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e82b350c-641d-4cd2-80e6-5f2ad71d01bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3e84b74ef64ebcbb2d4cb2b810126f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:43.893622 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e82b350c-641d-4cd2-80e6-5f2ad71d01bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3e84b74ef64ebcbb2d4cb2b810126f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:43.894273 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e82b350c-641d-4cd2-80e6-5f2ad71d01bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3e84b74ef64ebcbb2d4cb2b810126f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:43.904496 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:43.906928 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-e82b350c-641d-4cd2-80e6-5f2ad71d01bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3e84b74ef64ebcbb2d4cb2b810126f'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:43.914527 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1344/2697] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:37:43 2022] DELETE /identity/v3/users/cf3e84b74ef64ebcbb2d4cb2b810126f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:43.919332 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193fac9-aff7-4ecb-9583-8dce8955d14d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:43.919636 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193fac9-aff7-4ecb-9583-8dce8955d14d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:43.919917 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193fac9-aff7-4ecb-9583-8dce8955d14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:43.939933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9193fac9-aff7-4ecb-9583-8dce8955d14d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:37:43.941059 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9193fac9-aff7-4ecb-9583-8dce8955d14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:43.998969 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1354/2698] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:37:44.009672 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b350c-641d-4cd2-80e6-5f2ad71d01bf admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:44.011284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e82b350c-641d-4cd2-80e6-5f2ad71d01bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:44.080604 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b350c-641d-4cd2-80e6-5f2ad71d01bf admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:44.084461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485f588-0b85-431c-bb3f-0585c92c7102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:44.085435 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f588-0b85-431c-bb3f-0585c92c7102 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:44.085718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f588-0b85-431c-bb3f-0585c92c7102 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:44.085998 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f588-0b85-431c-bb3f-0585c92c7102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:44.095682 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485f588-0b85-431c-bb3f-0585c92c7102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:44.097671 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485f588-0b85-431c-bb3f-0585c92c7102 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:44.107068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1345/2699] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:44.323588 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193fac9-aff7-4ecb-9583-8dce8955d14d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:44.325971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9193fac9-aff7-4ecb-9583-8dce8955d14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:44.350972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193fac9-aff7-4ecb-9583-8dce8955d14d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:44.356116 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:44.356900 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:44.357257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:44.357606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] PATH_INFO: `/v3/projects/be7ceb10aad4431e9ce2cdc64728d106` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:44.359141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7ceb10aad4431e9ce2cdc64728d106)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:44.361376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:44.363293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:44.415043 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7ceb10aad4431e9ce2cdc64728d106', 'request_id': 'req-e91325c2-4e83-41a0-9832-9e85004a8a96'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:44.421137 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7ceb10aad4431e9ce2cdc64728d106', 'request_id': 'req-e91325c2-4e83-41a0-9832-9e85004a8a96'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:44.430138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7ceb10aad4431e9ce2cdc64728d106', 'request_id': 'req-e91325c2-4e83-41a0-9832-9e85004a8a96'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:44.441802 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] The token cache is being invalidate because project be7ceb10aad4431e9ce2cdc64728d106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:37:44.442457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:44.442777 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:37:44.444286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1355/2700] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:37:44 2022] DELETE /identity/v3/projects/be7ceb10aad4431e9ce2cdc64728d106 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:37:51.947792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485f588-0b85-431c-bb3f-0585c92c7102 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:51.949305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8485f588-0b85-431c-bb3f-0585c92c7102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:52.026315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485f588-0b85-431c-bb3f-0585c92c7102 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:52.087603 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39254474-0b88-435e-8f27-01c2fc69599b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:52.088224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254474-0b88-435e-8f27-01c2fc69599b service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:52.088508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254474-0b88-435e-8f27-01c2fc69599b service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:52.088788 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254474-0b88-435e-8f27-01c2fc69599b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:52.090890 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-39254474-0b88-435e-8f27-01c2fc69599b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:52.102638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39254474-0b88-435e-8f27-01c2fc69599b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:52.104211 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39254474-0b88-435e-8f27-01c2fc69599b service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:52.115160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1346/2701] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:37:54.438042 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:37:56.643927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:37:56.645328 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:56.702457 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91325c2-4e83-41a0-9832-9e85004a8a96 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:37:56.706005 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7a066-2632-4eb3-8e3f-4b6bfa55189f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:37:56.706650 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7a066-2632-4eb3-8e3f-4b6bfa55189f service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:37:56.706934 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7a066-2632-4eb3-8e3f-4b6bfa55189f service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:37:56.707209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7a066-2632-4eb3-8e3f-4b6bfa55189f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:37:56.708933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-91b7a066-2632-4eb3-8e3f-4b6bfa55189f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:37:56.775839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7a066-2632-4eb3-8e3f-4b6bfa55189f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:37:56.777186 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7a066-2632-4eb3-8e3f-4b6bfa55189f service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:37:56.786794 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1356/2702] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:37:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:00.418937 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39254474-0b88-435e-8f27-01c2fc69599b service nova] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:00.420426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-39254474-0b88-435e-8f27-01c2fc69599b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:00.435195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39254474-0b88-435e-8f27-01c2fc69599b service nova] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:00.441457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0b429-5d54-4331-8b74-8f68e4a0352d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:00.442074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0b429-5d54-4331-8b74-8f68e4a0352d service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:00.442355 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0b429-5d54-4331-8b74-8f68e4a0352d service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:00.442656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0b429-5d54-4331-8b74-8f68e4a0352d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:00.444440 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4aa0b429-5d54-4331-8b74-8f68e4a0352d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:00.466014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:00.531571 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0b429-5d54-4331-8b74-8f68e4a0352d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:00.533160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0b429-5d54-4331-8b74-8f68e4a0352d service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:00.551753 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1347/2703] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:06.782343 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=50 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:10.548591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=32 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:16.771819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7a066-2632-4eb3-8e3f-4b6bfa55189f service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:16.773406 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-91b7a066-2632-4eb3-8e3f-4b6bfa55189f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:16.837738 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7a066-2632-4eb3-8e3f-4b6bfa55189f service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:16.842577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbfd4b-aa1b-4a37-91c8-9bd1495c9c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:16.843364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbfd4b-aa1b-4a37-91c8-9bd1495c9c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:16.843884 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbfd4b-aa1b-4a37-91c8-9bd1495c9c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:16.844234 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbfd4b-aa1b-4a37-91c8-9bd1495c9c7c admin admin] PATH_INFO: `/v3/users/0ece68d68a714758985d3bcc330f5d4a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:16.845444 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbfd4b-aa1b-4a37-91c8-9bd1495c9c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ece68d68a714758985d3bcc330f5d4a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:16.847616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbfd4b-aa1b-4a37-91c8-9bd1495c9c7c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:16.893100 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6fbfd4b-aa1b-4a37-91c8-9bd1495c9c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ece68d68a714758985d3bcc330f5d4a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:16.900735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6fbfd4b-aa1b-4a37-91c8-9bd1495c9c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ece68d68a714758985d3bcc330f5d4a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:16.912770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6fbfd4b-aa1b-4a37-91c8-9bd1495c9c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ece68d68a714758985d3bcc330f5d4a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:16.913410 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6fbfd4b-aa1b-4a37-91c8-9bd1495c9c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ece68d68a714758985d3bcc330f5d4a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:16.920785 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6fbfd4b-aa1b-4a37-91c8-9bd1495c9c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ece68d68a714758985d3bcc330f5d4a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:16.926749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1357/2704] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:38:16 2022] DELETE /identity/v3/users/0ece68d68a714758985d3bcc330f5d4a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:17.100708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0b429-5d54-4331-8b74-8f68e4a0352d service nova] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:17.111584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0b429-5d54-4331-8b74-8f68e4a0352d service nova] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:17.179240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:17.179902 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:17.180183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:17.180459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] PATH_INFO: `/v3/projects/e8865947676047c1918131ad8a2ba025` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:17.181708 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8865947676047c1918131ad8a2ba025)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:17.183788 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:17.255489 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8865947676047c1918131ad8a2ba025', 'request_id': 'req-898471a0-b1bf-4ded-ad27-467a7c59efbe'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.266838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8865947676047c1918131ad8a2ba025', 'request_id': 'req-898471a0-b1bf-4ded-ad27-467a7c59efbe'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.270338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbfd4b-aa1b-4a37-91c8-9bd1495c9c7c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:17.272344 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b6fbfd4b-aa1b-4a37-91c8-9bd1495c9c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:17.273483 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8865947676047c1918131ad8a2ba025', 'request_id': 'req-898471a0-b1bf-4ded-ad27-467a7c59efbe'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.285163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] The token cache is being invalidate because project e8865947676047c1918131ad8a2ba025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:38:17.285458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.286137 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.287779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1348/2705] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:38:17 2022] DELETE /identity/v3/projects/e8865947676047c1918131ad8a2ba025 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:38:17.291648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:17.293121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:17.329004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbfd4b-aa1b-4a37-91c8-9bd1495c9c7c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:17.359115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898471a0-b1bf-4ded-ad27-467a7c59efbe admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:17.362085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:17.364685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b716eb8-1b62-485d-b223-254905c9b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:17.365330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b716eb8-1b62-485d-b223-254905c9b4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:17.365644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b716eb8-1b62-485d-b223-254905c9b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:17.365944 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b716eb8-1b62-485d-b223-254905c9b4f5 admin admin] PATH_INFO: `/v3/users/7f32f52dbc5644a882befa1a19daf1da` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:17.367494 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b716eb8-1b62-485d-b223-254905c9b4f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f32f52dbc5644a882befa1a19daf1da)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:17.369447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b716eb8-1b62-485d-b223-254905c9b4f5 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:17.381139 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcde871-1d4d-4e05-9d41-14fcaa3da65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:17.381764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcde871-1d4d-4e05-9d41-14fcaa3da65c service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:17.382044 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcde871-1d4d-4e05-9d41-14fcaa3da65c service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:17.382318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcde871-1d4d-4e05-9d41-14fcaa3da65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:17.384150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ddcde871-1d4d-4e05-9d41-14fcaa3da65c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:17.398771 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcde871-1d4d-4e05-9d41-14fcaa3da65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:17.400262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcde871-1d4d-4e05-9d41-14fcaa3da65c service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:17.410183 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:17.412652 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1358/2706] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:38:17.424941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2b716eb8-1b62-485d-b223-254905c9b4f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f32f52dbc5644a882befa1a19daf1da'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.433372 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2b716eb8-1b62-485d-b223-254905c9b4f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f32f52dbc5644a882befa1a19daf1da'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.440215 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2b716eb8-1b62-485d-b223-254905c9b4f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f32f52dbc5644a882befa1a19daf1da'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.440876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2b716eb8-1b62-485d-b223-254905c9b4f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f32f52dbc5644a882befa1a19daf1da'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.453939 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2b716eb8-1b62-485d-b223-254905c9b4f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f32f52dbc5644a882befa1a19daf1da'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.460027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1349/2707] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:38:17 2022] DELETE /identity/v3/users/7f32f52dbc5644a882befa1a19daf1da => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:38:17.635043 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcde871-1d4d-4e05-9d41-14fcaa3da65c service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:17.645383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcde871-1d4d-4e05-9d41-14fcaa3da65c service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:17.714390 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c89fc7-3ebc-40be-a420-573adde671fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:17.715358 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c89fc7-3ebc-40be-a420-573adde671fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:17.715703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c89fc7-3ebc-40be-a420-573adde671fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:17.715976 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c89fc7-3ebc-40be-a420-573adde671fe admin admin] PATH_INFO: `/v3/projects/05b284eb64954cf98ae297d056e265b1` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:17.717159 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c89fc7-3ebc-40be-a420-573adde671fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=05b284eb64954cf98ae297d056e265b1)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:17.719107 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c89fc7-3ebc-40be-a420-573adde671fe admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:17.767927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-95c89fc7-3ebc-40be-a420-573adde671fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05b284eb64954cf98ae297d056e265b1', 'request_id': 'req-95c89fc7-3ebc-40be-a420-573adde671fe'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.774255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-95c89fc7-3ebc-40be-a420-573adde671fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05b284eb64954cf98ae297d056e265b1', 'request_id': 'req-95c89fc7-3ebc-40be-a420-573adde671fe'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.782699 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-95c89fc7-3ebc-40be-a420-573adde671fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05b284eb64954cf98ae297d056e265b1', 'request_id': 'req-95c89fc7-3ebc-40be-a420-573adde671fe'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.795606 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-95c89fc7-3ebc-40be-a420-573adde671fe admin admin] The token cache is being invalidate because project 05b284eb64954cf98ae297d056e265b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:38:17.795896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-95c89fc7-3ebc-40be-a420-573adde671fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.796542 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-95c89fc7-3ebc-40be-a420-573adde671fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:17.798293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1359/2708] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:38:17 2022] DELETE /identity/v3/projects/05b284eb64954cf98ae297d056e265b1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:17.803701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85262830-0a20-4f05-8823-238773b19583 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:17.803993 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85262830-0a20-4f05-8823-238773b19583 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:17.804273 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85262830-0a20-4f05-8823-238773b19583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:17.823854 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-85262830-0a20-4f05-8823-238773b19583 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:17.825078 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-85262830-0a20-4f05-8823-238773b19583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:17.889153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1350/2709] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:17.896897 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448323d9-626f-4cbd-b7d3-df007e853e98 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:17.897180 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448323d9-626f-4cbd-b7d3-df007e853e98 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:17.897460 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448323d9-626f-4cbd-b7d3-df007e853e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:17.917137 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-448323d9-626f-4cbd-b7d3-df007e853e98 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:17.918334 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-448323d9-626f-4cbd-b7d3-df007e853e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:17.926738 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1360/2710] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:17.932335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85262830-0a20-4f05-8823-238773b19583 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:17.948972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85262830-0a20-4f05-8823-238773b19583 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:17.956712 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e637075-ee85-4aeb-969c-f15ae3ebd880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:17.957718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e637075-ee85-4aeb-969c-f15ae3ebd880 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:17.958311 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e637075-ee85-4aeb-969c-f15ae3ebd880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:17.958824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e637075-ee85-4aeb-969c-f15ae3ebd880 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:17.960127 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e637075-ee85-4aeb-969c-f15ae3ebd880 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:38:17.960677 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e637075-ee85-4aeb-969c-f15ae3ebd880 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:17.963841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e637075-ee85-4aeb-969c-f15ae3ebd880 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:17.985350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1351/2711] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:38:17.990428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448323d9-626f-4cbd-b7d3-df007e853e98 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:18.001269 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448323d9-626f-4cbd-b7d3-df007e853e98 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:18.006009 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bb2db-5f94-4ec9-bf4d-dad9ff24cbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:18.006648 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bb2db-5f94-4ec9-bf4d-dad9ff24cbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:18.006931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bb2db-5f94-4ec9-bf4d-dad9ff24cbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:18.007207 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355bb2db-5f94-4ec9-bf4d-dad9ff24cbf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:18.007874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bb2db-5f94-4ec9-bf4d-dad9ff24cbf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:18.009764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355bb2db-5f94-4ec9-bf4d-dad9ff24cbf4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:18.039275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1361/2712] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:38:17 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:38:18.043263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e637075-ee85-4aeb-969c-f15ae3ebd880 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:18.054319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e637075-ee85-4aeb-969c-f15ae3ebd880 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:18.110049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c22522-9310-44c7-b7e0-10d84c6e4ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:18.110752 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c22522-9310-44c7-b7e0-10d84c6e4ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:18.110974 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c22522-9310-44c7-b7e0-10d84c6e4ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:18.111254 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c22522-9310-44c7-b7e0-10d84c6e4ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:18.111925 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c22522-9310-44c7-b7e0-10d84c6e4ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:18.113827 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c22522-9310-44c7-b7e0-10d84c6e4ca7 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:18.136440 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1352/2713] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:38:18 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:38:18.140737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bb2db-5f94-4ec9-bf4d-dad9ff24cbf4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:18.151729 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355bb2db-5f94-4ec9-bf4d-dad9ff24cbf4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:18.156442 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd67d5-d29c-4ffe-85d2-4c615e409e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:18.157042 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd67d5-d29c-4ffe-85d2-4c615e409e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:18.157324 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd67d5-d29c-4ffe-85d2-4c615e409e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:18.157717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd67d5-d29c-4ffe-85d2-4c615e409e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:18.158480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd67d5-d29c-4ffe-85d2-4c615e409e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:18.160076 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd67d5-d29c-4ffe-85d2-4c615e409e8c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:18.173287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1362/2714] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:18.176141 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c22522-9310-44c7-b7e0-10d84c6e4ca7 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:18.186580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c22522-9310-44c7-b7e0-10d84c6e4ca7 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:18.191370 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5db67-e504-46ac-9430-9a2c3d3ac5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:18.191980 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5db67-e504-46ac-9430-9a2c3d3ac5cc admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:18.192264 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5db67-e504-46ac-9430-9a2c3d3ac5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:18.192572 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5db67-e504-46ac-9430-9a2c3d3ac5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:18.193401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5db67-e504-46ac-9430-9a2c3d3ac5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:18.195066 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5db67-e504-46ac-9430-9a2c3d3ac5cc admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:18.205794 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1353/2715] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:18.210290 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd67d5-d29c-4ffe-85d2-4c615e409e8c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:18.220602 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd67d5-d29c-4ffe-85d2-4c615e409e8c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:18.226147 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19b504-8b3e-48c4-9dfb-62da7cb22a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:18.226915 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19b504-8b3e-48c4-9dfb-62da7cb22a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:18.227431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19b504-8b3e-48c4-9dfb-62da7cb22a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:18.227573 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19b504-8b3e-48c4-9dfb-62da7cb22a2d admin admin] PATH_INFO: `/v3/projects/d7a5cbade94b4e6f972efd3b12298fd8/users/41a0adc34c7645028ec506e9437b07f1/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:18.247926 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19b504-8b3e-48c4-9dfb-62da7cb22a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a5cbade94b4e6f972efd3b12298fd8, user_id=41a0adc34c7645028ec506e9437b07f1, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:18.250670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19b504-8b3e-48c4-9dfb-62da7cb22a2d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:18.271472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1363/2716] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:38:18 2022] PUT /identity/v3/projects/d7a5cbade94b4e6f972efd3b12298fd8/users/41a0adc34c7645028ec506e9437b07f1/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:38:18.277032 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f82da-a2df-409e-8efa-ac03d89d7713 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:18.277245 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f82da-a2df-409e-8efa-ac03d89d7713 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:18.277552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f82da-a2df-409e-8efa-ac03d89d7713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:18.300709 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-978f82da-a2df-409e-8efa-ac03d89d7713 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:18.302621 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-978f82da-a2df-409e-8efa-ac03d89d7713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:18.313685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:18.405842 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1354/2717] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:18.417537 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19b504-8b3e-48c4-9dfb-62da7cb22a2d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:18.419362 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6a19b504-8b3e-48c4-9dfb-62da7cb22a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:18.427910 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:18.508789 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19b504-8b3e-48c4-9dfb-62da7cb22a2d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:18.513123 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1978a6-0de4-483d-be3c-4d76c6222ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:18.513761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1978a6-0de4-483d-be3c-4d76c6222ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:18.514041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1978a6-0de4-483d-be3c-4d76c6222ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:18.514317 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1978a6-0de4-483d-be3c-4d76c6222ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:18.528776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1978a6-0de4-483d-be3c-4d76c6222ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:18.530223 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1978a6-0de4-483d-be3c-4d76c6222ba8 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:18.541025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1364/2718] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:19.214367 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1bca9-47be-4ae0-8dd6-a64a82e8e118 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:19.214882 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1bca9-47be-4ae0-8dd6-a64a82e8e118 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:19.215406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1bca9-47be-4ae0-8dd6-a64a82e8e118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:19.249357 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-adf1bca9-47be-4ae0-8dd6-a64a82e8e118 None None] MFA Rules not processed for user `41a0adc34c7645028ec506e9437b07f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:19.250983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-adf1bca9-47be-4ae0-8dd6-a64a82e8e118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:19.326515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1355/2719] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:19.337833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1978a6-0de4-483d-be3c-4d76c6222ba8 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:19.339520 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9a1978a6-0de4-483d-be3c-4d76c6222ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:19.407665 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1978a6-0de4-483d-be3c-4d76c6222ba8 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:19.412357 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34c0ec-12bb-46e7-b766-0e5059f95fe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:19.413177 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c0ec-12bb-46e7-b766-0e5059f95fe9 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:19.413793 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c0ec-12bb-46e7-b766-0e5059f95fe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:19.414327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34c0ec-12bb-46e7-b766-0e5059f95fe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:19.433904 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34c0ec-12bb-46e7-b766-0e5059f95fe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:19.435731 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34c0ec-12bb-46e7-b766-0e5059f95fe9 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:19.446576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1365/2720] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:20.825226 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1bca9-47be-4ae0-8dd6-a64a82e8e118 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:20.826913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-adf1bca9-47be-4ae0-8dd6-a64a82e8e118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:20.842718 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1bca9-47be-4ae0-8dd6-a64a82e8e118 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:20.847386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8107ec-913f-42aa-bbad-f0ded21560bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:20.848111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8107ec-913f-42aa-bbad-f0ded21560bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:20.848465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8107ec-913f-42aa-bbad-f0ded21560bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:20.848837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8107ec-913f-42aa-bbad-f0ded21560bf admin admin] PATH_INFO: `/v3/users/bf807d1c7e6244edbf3f4d8fae5fe67d` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:20.850094 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8107ec-913f-42aa-bbad-f0ded21560bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf807d1c7e6244edbf3f4d8fae5fe67d)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:20.852172 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8107ec-913f-42aa-bbad-f0ded21560bf admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:20.928281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5e8107ec-913f-42aa-bbad-f0ded21560bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf807d1c7e6244edbf3f4d8fae5fe67d'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:20.937045 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5e8107ec-913f-42aa-bbad-f0ded21560bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf807d1c7e6244edbf3f4d8fae5fe67d'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:20.955185 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5e8107ec-913f-42aa-bbad-f0ded21560bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf807d1c7e6244edbf3f4d8fae5fe67d'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:20.955864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5e8107ec-913f-42aa-bbad-f0ded21560bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf807d1c7e6244edbf3f4d8fae5fe67d'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:20.974539 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0974a2-6fd1-443b-94c9-9b3d477e167f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:20.975064 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0974a2-6fd1-443b-94c9-9b3d477e167f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:20.975064 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0974a2-6fd1-443b-94c9-9b3d477e167f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:20.978506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5e8107ec-913f-42aa-bbad-f0ded21560bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf807d1c7e6244edbf3f4d8fae5fe67d'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:20.989756 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1356/2721] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:38:20 2022] DELETE /identity/v3/users/bf807d1c7e6244edbf3f4d8fae5fe67d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:38:20.996801 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5c0974a2-6fd1-443b-94c9-9b3d477e167f None None] MFA Rules not processed for user `41a0adc34c7645028ec506e9437b07f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:20.998078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5c0974a2-6fd1-443b-94c9-9b3d477e167f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:21.061041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1366/2722] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:21.177771 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8107ec-913f-42aa-bbad-f0ded21560bf admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:21.179257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5e8107ec-913f-42aa-bbad-f0ded21560bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:21.201947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:21.257621 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8107ec-913f-42aa-bbad-f0ded21560bf admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:21.262190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401edf2-6cd8-48df-8fad-31563d31cbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:21.263268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401edf2-6cd8-48df-8fad-31563d31cbe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:21.263557 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401edf2-6cd8-48df-8fad-31563d31cbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:21.263861 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401edf2-6cd8-48df-8fad-31563d31cbe4 admin admin] PATH_INFO: `/v3/projects/9e77ea3eb102436f8de3c58a43aea4ca` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:21.265041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401edf2-6cd8-48df-8fad-31563d31cbe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e77ea3eb102436f8de3c58a43aea4ca)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:21.266986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401edf2-6cd8-48df-8fad-31563d31cbe4 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:21.316436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d401edf2-6cd8-48df-8fad-31563d31cbe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e77ea3eb102436f8de3c58a43aea4ca', 'request_id': 'req-d401edf2-6cd8-48df-8fad-31563d31cbe4'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:21.329102 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d401edf2-6cd8-48df-8fad-31563d31cbe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e77ea3eb102436f8de3c58a43aea4ca', 'request_id': 'req-d401edf2-6cd8-48df-8fad-31563d31cbe4'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:21.335606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d401edf2-6cd8-48df-8fad-31563d31cbe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e77ea3eb102436f8de3c58a43aea4ca', 'request_id': 'req-d401edf2-6cd8-48df-8fad-31563d31cbe4'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:21.348961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d401edf2-6cd8-48df-8fad-31563d31cbe4 admin admin] The token cache is being invalidate because project 9e77ea3eb102436f8de3c58a43aea4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:38:21.349187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d401edf2-6cd8-48df-8fad-31563d31cbe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:21.349843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d401edf2-6cd8-48df-8fad-31563d31cbe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:21.351882 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1357/2723] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:38:21 2022] DELETE /identity/v3/projects/9e77ea3eb102436f8de3c58a43aea4ca => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:21.357260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2322756-4ba2-4f39-87ea-ee633d4ba62f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:21.357547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2322756-4ba2-4f39-87ea-ee633d4ba62f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:21.357817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2322756-4ba2-4f39-87ea-ee633d4ba62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:21.379138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c2322756-4ba2-4f39-87ea-ee633d4ba62f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:21.380971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c2322756-4ba2-4f39-87ea-ee633d4ba62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:21.431566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:21.444158 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1367/2724] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:38:21.452161 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa373-a0eb-40f5-ad7b-2b5aa8a05f81 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:21.452451 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa373-a0eb-40f5-ad7b-2b5aa8a05f81 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:21.452732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa373-a0eb-40f5-ad7b-2b5aa8a05f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:21.474195 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-ffbaa373-a0eb-40f5-ad7b-2b5aa8a05f81 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:21.475458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ffbaa373-a0eb-40f5-ad7b-2b5aa8a05f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:21.483710 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1358/2725] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:21.488110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2322756-4ba2-4f39-87ea-ee633d4ba62f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:21.498803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2322756-4ba2-4f39-87ea-ee633d4ba62f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:21.504063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec96c09-0c1c-4b5b-83a8-50cc407019ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:21.504684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec96c09-0c1c-4b5b-83a8-50cc407019ec admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:21.505550 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec96c09-0c1c-4b5b-83a8-50cc407019ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:21.505826 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec96c09-0c1c-4b5b-83a8-50cc407019ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:21.506562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec96c09-0c1c-4b5b-83a8-50cc407019ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:38:21.506871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec96c09-0c1c-4b5b-83a8-50cc407019ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:21.508562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec96c09-0c1c-4b5b-83a8-50cc407019ec admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:21.524856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1368/2726] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:38:21.527059 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa373-a0eb-40f5-ad7b-2b5aa8a05f81 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:21.537054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa373-a0eb-40f5-ad7b-2b5aa8a05f81 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:21.541839 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd448d52-b678-4c43-936e-32a87695d0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:21.542487 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd448d52-b678-4c43-936e-32a87695d0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:21.542772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd448d52-b678-4c43-936e-32a87695d0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:21.543046 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd448d52-b678-4c43-936e-32a87695d0c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:21.543711 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd448d52-b678-4c43-936e-32a87695d0c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:21.545611 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd448d52-b678-4c43-936e-32a87695d0c8 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:21.576999 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1359/2727] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:38:21 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:38:21.581232 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec96c09-0c1c-4b5b-83a8-50cc407019ec admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:21.591739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec96c09-0c1c-4b5b-83a8-50cc407019ec admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:21.665449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da0200-9211-4cea-832a-d45d681ec70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:21.666479 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da0200-9211-4cea-832a-d45d681ec70f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:21.666896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da0200-9211-4cea-832a-d45d681ec70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:21.667236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da0200-9211-4cea-832a-d45d681ec70f admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:21.668030 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da0200-9211-4cea-832a-d45d681ec70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:21.670043 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da0200-9211-4cea-832a-d45d681ec70f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:21.699989 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1369/2728] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:38:21 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:38:21.701232 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd448d52-b678-4c43-936e-32a87695d0c8 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:21.713114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd448d52-b678-4c43-936e-32a87695d0c8 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:21.718832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fd536-89d2-4200-865e-a93d7182bf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:21.719586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fd536-89d2-4200-865e-a93d7182bf92 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:21.719958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fd536-89d2-4200-865e-a93d7182bf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:21.720740 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fd536-89d2-4200-865e-a93d7182bf92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:21.721073 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fd536-89d2-4200-865e-a93d7182bf92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:21.722785 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fd536-89d2-4200-865e-a93d7182bf92 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:21.745635 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1360/2729] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:21.750091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da0200-9211-4cea-832a-d45d681ec70f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:21.760705 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da0200-9211-4cea-832a-d45d681ec70f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:21.765779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df794ea-83b6-4249-b0ff-3095522f9f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:21.766439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df794ea-83b6-4249-b0ff-3095522f9f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:21.766761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df794ea-83b6-4249-b0ff-3095522f9f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:21.767017 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df794ea-83b6-4249-b0ff-3095522f9f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:21.767764 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df794ea-83b6-4249-b0ff-3095522f9f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:21.769424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df794ea-83b6-4249-b0ff-3095522f9f28 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:21.781098 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1370/2730] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:21.785390 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fd536-89d2-4200-865e-a93d7182bf92 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:21.795676 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fd536-89d2-4200-865e-a93d7182bf92 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:21.800323 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f14ac7-a4b6-4aaf-a679-994f26a224d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:21.800978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f14ac7-a4b6-4aaf-a679-994f26a224d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:21.801257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f14ac7-a4b6-4aaf-a679-994f26a224d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:21.801532 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f14ac7-a4b6-4aaf-a679-994f26a224d7 admin admin] PATH_INFO: `/v3/projects/bc5abb01770a4e8490352257f53ad112/users/d34a4fb54cc343928c69c8a32f43479d/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:21.816674 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f14ac7-a4b6-4aaf-a679-994f26a224d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5abb01770a4e8490352257f53ad112, user_id=d34a4fb54cc343928c69c8a32f43479d, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:21.819897 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f14ac7-a4b6-4aaf-a679-994f26a224d7 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:21.834351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1361/2731] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:38:21 2022] PUT /identity/v3/projects/bc5abb01770a4e8490352257f53ad112/users/d34a4fb54cc343928c69c8a32f43479d/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:38:21.845733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03385ae-bd30-4a97-bf97-de33c822fd18 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:21.846021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03385ae-bd30-4a97-bf97-de33c822fd18 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:21.846299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03385ae-bd30-4a97-bf97-de33c822fd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:21.876560 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d03385ae-bd30-4a97-bf97-de33c822fd18 None None] MFA Rules not processed for user `d34a4fb54cc343928c69c8a32f43479d`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:21.877772 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d03385ae-bd30-4a97-bf97-de33c822fd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:21.954920 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1371/2732] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:21.967792 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f14ac7-a4b6-4aaf-a679-994f26a224d7 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:21.969739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-61f14ac7-a4b6-4aaf-a679-994f26a224d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:22.019248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:22.051330 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f14ac7-a4b6-4aaf-a679-994f26a224d7 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:22.061095 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317012b-595a-4f9f-8a16-28eb02660026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:22.061731 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317012b-595a-4f9f-8a16-28eb02660026 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:22.062049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317012b-595a-4f9f-8a16-28eb02660026 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:22.062573 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317012b-595a-4f9f-8a16-28eb02660026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:22.072366 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317012b-595a-4f9f-8a16-28eb02660026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:22.074101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317012b-595a-4f9f-8a16-28eb02660026 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:22.084516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1362/2733] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:24.786667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03385ae-bd30-4a97-bf97-de33c822fd18 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:24.848131 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:24.861847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03385ae-bd30-4a97-bf97-de33c822fd18 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:24.866398 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b828ff-d84b-4fad-a397-c11ca30aecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:24.867151 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b828ff-d84b-4fad-a397-c11ca30aecb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:24.867437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b828ff-d84b-4fad-a397-c11ca30aecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:24.867711 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b828ff-d84b-4fad-a397-c11ca30aecb4 admin admin] PATH_INFO: `/v3/users/d34a4fb54cc343928c69c8a32f43479d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:24.868879 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b828ff-d84b-4fad-a397-c11ca30aecb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d34a4fb54cc343928c69c8a32f43479d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:24.870864 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b828ff-d84b-4fad-a397-c11ca30aecb4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:24.920892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d0b828ff-d84b-4fad-a397-c11ca30aecb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd34a4fb54cc343928c69c8a32f43479d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:24.929382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d0b828ff-d84b-4fad-a397-c11ca30aecb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd34a4fb54cc343928c69c8a32f43479d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:24.941948 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d0b828ff-d84b-4fad-a397-c11ca30aecb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd34a4fb54cc343928c69c8a32f43479d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:24.943126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d0b828ff-d84b-4fad-a397-c11ca30aecb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd34a4fb54cc343928c69c8a32f43479d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:24.950258 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d0b828ff-d84b-4fad-a397-c11ca30aecb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd34a4fb54cc343928c69c8a32f43479d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:24.956191 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1372/2734] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:38:24 2022] DELETE /identity/v3/users/d34a4fb54cc343928c69c8a32f43479d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:24.960779 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d00647-aa25-4ff1-88c6-830a2a9900d4 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:24.961276 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d00647-aa25-4ff1-88c6-830a2a9900d4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:24.961379 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d00647-aa25-4ff1-88c6-830a2a9900d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:24.980919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-52d00647-aa25-4ff1-88c6-830a2a9900d4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:24.982277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-52d00647-aa25-4ff1-88c6-830a2a9900d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:25.044394 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1363/2735] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:25.054470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b828ff-d84b-4fad-a397-c11ca30aecb4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:25.057250 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d0b828ff-d84b-4fad-a397-c11ca30aecb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:25.117021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b828ff-d84b-4fad-a397-c11ca30aecb4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:25.120796 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ceda7-88d3-40a1-845f-8adcfb81414e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:25.121415 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ceda7-88d3-40a1-845f-8adcfb81414e service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:25.121689 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ceda7-88d3-40a1-845f-8adcfb81414e service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:25.121956 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ceda7-88d3-40a1-845f-8adcfb81414e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:25.132728 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ceda7-88d3-40a1-845f-8adcfb81414e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:25.134158 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ceda7-88d3-40a1-845f-8adcfb81414e service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:25.144525 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1373/2736] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:25.454362 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d00647-aa25-4ff1-88c6-830a2a9900d4 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:25.455817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-52d00647-aa25-4ff1-88c6-830a2a9900d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:25.472136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d00647-aa25-4ff1-88c6-830a2a9900d4 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:25.478182 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5119b-6953-4ab9-aad1-b3043dc24f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:25.479044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5119b-6953-4ab9-aad1-b3043dc24f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:25.479400 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5119b-6953-4ab9-aad1-b3043dc24f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:25.479803 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5119b-6953-4ab9-aad1-b3043dc24f1e admin admin] PATH_INFO: `/v3/projects/bc5abb01770a4e8490352257f53ad112` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:25.481133 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5119b-6953-4ab9-aad1-b3043dc24f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5abb01770a4e8490352257f53ad112)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:25.483178 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5119b-6953-4ab9-aad1-b3043dc24f1e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:25.529711 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-bde5119b-6953-4ab9-aad1-b3043dc24f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5abb01770a4e8490352257f53ad112', 'request_id': 'req-bde5119b-6953-4ab9-aad1-b3043dc24f1e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:25.537046 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-bde5119b-6953-4ab9-aad1-b3043dc24f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5abb01770a4e8490352257f53ad112', 'request_id': 'req-bde5119b-6953-4ab9-aad1-b3043dc24f1e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:25.542823 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-bde5119b-6953-4ab9-aad1-b3043dc24f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5abb01770a4e8490352257f53ad112', 'request_id': 'req-bde5119b-6953-4ab9-aad1-b3043dc24f1e'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:25.554210 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-bde5119b-6953-4ab9-aad1-b3043dc24f1e admin admin] The token cache is being invalidate because project bc5abb01770a4e8490352257f53ad112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:38:25.554529 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-bde5119b-6953-4ab9-aad1-b3043dc24f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:25.555173 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-bde5119b-6953-4ab9-aad1-b3043dc24f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:25.556702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1364/2737] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:38:25 2022] DELETE /identity/v3/projects/bc5abb01770a4e8490352257f53ad112 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:25.561486 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3c6d6-b894-4b83-9238-cbe071f2d8dc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:25.561778 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3c6d6-b894-4b83-9238-cbe071f2d8dc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:25.562057 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3c6d6-b894-4b83-9238-cbe071f2d8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:25.581609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9fb3c6d6-b894-4b83-9238-cbe071f2d8dc None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:25.583200 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9fb3c6d6-b894-4b83-9238-cbe071f2d8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:25.640215 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1374/2738] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:25.648605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ae311-e754-4d55-81c2-63ca4e5aea31 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:25.648895 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ae311-e754-4d55-81c2-63ca4e5aea31 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:25.649172 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ae311-e754-4d55-81c2-63ca4e5aea31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:25.669047 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-de4ae311-e754-4d55-81c2-63ca4e5aea31 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:25.670256 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-de4ae311-e754-4d55-81c2-63ca4e5aea31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:25.678125 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1365/2739] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:25.682260 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3c6d6-b894-4b83-9238-cbe071f2d8dc None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:25.692437 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3c6d6-b894-4b83-9238-cbe071f2d8dc None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:25.697089 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c99b4-5936-4835-93f7-6ccf118e13b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:25.697704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c99b4-5936-4835-93f7-6ccf118e13b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:25.697990 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c99b4-5936-4835-93f7-6ccf118e13b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:25.698268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c99b4-5936-4835-93f7-6ccf118e13b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:25.698998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c99b4-5936-4835-93f7-6ccf118e13b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:38:25.699307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c99b4-5936-4835-93f7-6ccf118e13b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:25.700924 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c99b4-5936-4835-93f7-6ccf118e13b1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:25.710125 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:25.715544 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1375/2740] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 04 22:38:25.719589 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ae311-e754-4d55-81c2-63ca4e5aea31 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:25.729572 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ae311-e754-4d55-81c2-63ca4e5aea31 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:25.734248 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce464e95-f9eb-4ee2-82e0-3623fa8152b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:25.734912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce464e95-f9eb-4ee2-82e0-3623fa8152b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:25.735196 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce464e95-f9eb-4ee2-82e0-3623fa8152b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:25.735477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce464e95-f9eb-4ee2-82e0-3623fa8152b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:25.736159 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce464e95-f9eb-4ee2-82e0-3623fa8152b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:25.738050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce464e95-f9eb-4ee2-82e0-3623fa8152b9 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:25.765850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1366/2741] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:38:25 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:38:25.772408 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c99b4-5936-4835-93f7-6ccf118e13b1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:25.783647 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c99b4-5936-4835-93f7-6ccf118e13b1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:25.842984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601a64b-16b9-4d0c-9f72-9713b3108e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:25.843603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601a64b-16b9-4d0c-9f72-9713b3108e3d admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:25.843913 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601a64b-16b9-4d0c-9f72-9713b3108e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:25.844305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601a64b-16b9-4d0c-9f72-9713b3108e3d admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:25.845056 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601a64b-16b9-4d0c-9f72-9713b3108e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:25.847084 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601a64b-16b9-4d0c-9f72-9713b3108e3d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:25.869830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1376/2742] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:38:25 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:38:25.873906 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce464e95-f9eb-4ee2-82e0-3623fa8152b9 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:25.884115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce464e95-f9eb-4ee2-82e0-3623fa8152b9 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:25.888626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc974f-a600-4f59-821b-6edae6f4da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:25.889226 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc974f-a600-4f59-821b-6edae6f4da5c admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:25.889505 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc974f-a600-4f59-821b-6edae6f4da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:25.889775 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc974f-a600-4f59-821b-6edae6f4da5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:25.890494 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc974f-a600-4f59-821b-6edae6f4da5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:25.892056 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc974f-a600-4f59-821b-6edae6f4da5c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:25.902358 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1367/2743] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:25.906662 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601a64b-16b9-4d0c-9f72-9713b3108e3d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:25.917350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601a64b-16b9-4d0c-9f72-9713b3108e3d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:25.921933 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596b6e7-bf7b-4cbf-a254-0d07c38386b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:25.922572 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596b6e7-bf7b-4cbf-a254-0d07c38386b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:25.922859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596b6e7-bf7b-4cbf-a254-0d07c38386b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:25.923138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596b6e7-bf7b-4cbf-a254-0d07c38386b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:25.923825 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596b6e7-bf7b-4cbf-a254-0d07c38386b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:25.925424 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596b6e7-bf7b-4cbf-a254-0d07c38386b1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:25.936353 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1377/2744] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:25.940532 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc974f-a600-4f59-821b-6edae6f4da5c admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:25.951150 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc974f-a600-4f59-821b-6edae6f4da5c admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:25.956107 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaec73b-eacf-4392-994d-0f282a65cd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:25.956864 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec73b-eacf-4392-994d-0f282a65cd49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:25.957138 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec73b-eacf-4392-994d-0f282a65cd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:25.957553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec73b-eacf-4392-994d-0f282a65cd49 admin admin] PATH_INFO: `/v3/projects/42fecb4325fb48eaa0ad4762e32afab8/users/1684ae6d8d6043b9ae8c2885dce7dc3b/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:25.969562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:25.974339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaec73b-eacf-4392-994d-0f282a65cd49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42fecb4325fb48eaa0ad4762e32afab8, user_id=1684ae6d8d6043b9ae8c2885dce7dc3b, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:25.977392 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaec73b-eacf-4392-994d-0f282a65cd49 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:25.991549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1368/2745] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:38:25 2022] PUT /identity/v3/projects/42fecb4325fb48eaa0ad4762e32afab8/users/1684ae6d8d6043b9ae8c2885dce7dc3b/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:26.001570 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebdf9f-26d2-4721-8215-7f1da8ce3d89 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:26.001860 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebdf9f-26d2-4721-8215-7f1da8ce3d89 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:26.002138 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebdf9f-26d2-4721-8215-7f1da8ce3d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:26.029182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e0ebdf9f-26d2-4721-8215-7f1da8ce3d89 None None] MFA Rules not processed for user `1684ae6d8d6043b9ae8c2885dce7dc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:26.030385 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e0ebdf9f-26d2-4721-8215-7f1da8ce3d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:26.094251 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1378/2746] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:26.099263 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaec73b-eacf-4392-994d-0f282a65cd49 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:26.159086 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaec73b-eacf-4392-994d-0f282a65cd49 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:26.164163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967ed86-894d-45a1-b9f1-4033011dd132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:26.164770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967ed86-894d-45a1-b9f1-4033011dd132 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:26.165051 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967ed86-894d-45a1-b9f1-4033011dd132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:26.165324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967ed86-894d-45a1-b9f1-4033011dd132 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:26.165988 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967ed86-894d-45a1-b9f1-4033011dd132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:26.167886 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967ed86-894d-45a1-b9f1-4033011dd132 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:26.193924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1369/2747] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:38:26 2022] POST /identity/v3/projects => generated 401 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:38:26.198065 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebdf9f-26d2-4721-8215-7f1da8ce3d89 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:26.208669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebdf9f-26d2-4721-8215-7f1da8ce3d89 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:26.266643 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7ac9c-04fb-45ec-be36-4ed499730b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:26.267265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7ac9c-04fb-45ec-be36-4ed499730b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:26.267543 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7ac9c-04fb-45ec-be36-4ed499730b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:26.267818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7ac9c-04fb-45ec-be36-4ed499730b21 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:26.268478 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7ac9c-04fb-45ec-be36-4ed499730b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:26.270419 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7ac9c-04fb-45ec-be36-4ed499730b21 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:26.285252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:26.296839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1379/2748] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:38:26 2022] POST /identity/v3/users => generated 307 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:38:26.298132 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967ed86-894d-45a1-b9f1-4033011dd132 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:26.309043 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967ed86-894d-45a1-b9f1-4033011dd132 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:26.313905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6fdc9-b293-4c9f-ab90-bb0c71af0c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:26.314562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6fdc9-b293-4c9f-ab90-bb0c71af0c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:26.314850 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6fdc9-b293-4c9f-ab90-bb0c71af0c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:26.315265 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6fdc9-b293-4c9f-ab90-bb0c71af0c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:26.315994 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6fdc9-b293-4c9f-ab90-bb0c71af0c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:26.317628 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6fdc9-b293-4c9f-ab90-bb0c71af0c0e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:26.328465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1370/2749] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:26.332724 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7ac9c-04fb-45ec-be36-4ed499730b21 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:26.343795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7ac9c-04fb-45ec-be36-4ed499730b21 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:26.349228 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc88a65-108f-4418-9dd6-78b7b9bd69d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:26.349971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc88a65-108f-4418-9dd6-78b7b9bd69d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:26.350455 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc88a65-108f-4418-9dd6-78b7b9bd69d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:26.350814 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc88a65-108f-4418-9dd6-78b7b9bd69d1 admin admin] PATH_INFO: `/v3/projects/63e94a603f294ad3bc05464a4b0376f4/users/68ca065512df45399ac2a18cafe3cf41/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:26.366492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc88a65-108f-4418-9dd6-78b7b9bd69d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e94a603f294ad3bc05464a4b0376f4, user_id=68ca065512df45399ac2a18cafe3cf41, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:26.368953 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc88a65-108f-4418-9dd6-78b7b9bd69d1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:26.383393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1380/2750] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:38:26 2022] PUT /identity/v3/projects/63e94a603f294ad3bc05464a4b0376f4/users/68ca065512df45399ac2a18cafe3cf41/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:26.387581 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6fdc9-b293-4c9f-ab90-bb0c71af0c0e admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:26.400192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6fdc9-b293-4c9f-ab90-bb0c71af0c0e admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:26.459027 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71c647-05a4-4de4-9e99-8d08ba3d28ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:26.459786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71c647-05a4-4de4-9e99-8d08ba3d28ac admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:26.460070 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71c647-05a4-4de4-9e99-8d08ba3d28ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:26.460344 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71c647-05a4-4de4-9e99-8d08ba3d28ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:26.461038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71c647-05a4-4de4-9e99-8d08ba3d28ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:26.462645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71c647-05a4-4de4-9e99-8d08ba3d28ac admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:26.473568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1371/2751] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:26.478234 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc88a65-108f-4418-9dd6-78b7b9bd69d1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:26.488634 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc88a65-108f-4418-9dd6-78b7b9bd69d1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:26.493307 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0f81e-9856-4594-80e2-71d307bbf383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:26.493965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0f81e-9856-4594-80e2-71d307bbf383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:26.494243 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0f81e-9856-4594-80e2-71d307bbf383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:26.494547 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0f81e-9856-4594-80e2-71d307bbf383 admin admin] PATH_INFO: `/v3/projects/63e94a603f294ad3bc05464a4b0376f4/users/68ca065512df45399ac2a18cafe3cf41/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:26.496443 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0f81e-9856-4594-80e2-71d307bbf383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e94a603f294ad3bc05464a4b0376f4, user_id=68ca065512df45399ac2a18cafe3cf41, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:26.499273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0f81e-9856-4594-80e2-71d307bbf383 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:26.509257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1381/2752] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:38:26 2022] PUT /identity/v3/projects/63e94a603f294ad3bc05464a4b0376f4/users/68ca065512df45399ac2a18cafe3cf41/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:26.521338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd581c-706a-4fa2-9ac6-c58a50cfab60 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:26.521625 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd581c-706a-4fa2-9ac6-c58a50cfab60 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:26.521903 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd581c-706a-4fa2-9ac6-c58a50cfab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:26.549651 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-0ffd581c-706a-4fa2-9ac6-c58a50cfab60 None None] MFA Rules not processed for user `68ca065512df45399ac2a18cafe3cf41`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:26.550884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0ffd581c-706a-4fa2-9ac6-c58a50cfab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:26.596364 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:26.618952 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1372/2753] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:26 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:26.629838 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0f81e-9856-4594-80e2-71d307bbf383 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:26.631528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a7f0f81e-9856-4594-80e2-71d307bbf383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:26.688899 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0f81e-9856-4594-80e2-71d307bbf383 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:26.692527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256df7e-b5ff-4baf-b492-fd8fdf999da7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:26.693158 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256df7e-b5ff-4baf-b492-fd8fdf999da7 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:26.693446 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256df7e-b5ff-4baf-b492-fd8fdf999da7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:26.693716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256df7e-b5ff-4baf-b492-fd8fdf999da7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:26.702542 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256df7e-b5ff-4baf-b492-fd8fdf999da7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:26.703961 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256df7e-b5ff-4baf-b492-fd8fdf999da7 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:26.713682 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1382/2754] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:26 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:26.788411 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd581c-706a-4fa2-9ac6-c58a50cfab60 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:26.798013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd581c-706a-4fa2-9ac6-c58a50cfab60 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:26.801576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfa5d2-e991-4a04-a19e-cd2244d6439b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:26.802180 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfa5d2-e991-4a04-a19e-cd2244d6439b service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:26.802508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfa5d2-e991-4a04-a19e-cd2244d6439b service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:26.802783 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfa5d2-e991-4a04-a19e-cd2244d6439b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:26.858201 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfa5d2-e991-4a04-a19e-cd2244d6439b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:26.859665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfa5d2-e991-4a04-a19e-cd2244d6439b service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:26.869579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1373/2755] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:30.947484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256df7e-b5ff-4baf-b492-fd8fdf999da7 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:31.011602 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256df7e-b5ff-4baf-b492-fd8fdf999da7 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:31.016120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43875d-68c3-4d59-9a57-cfd5ec15137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:31.016789 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43875d-68c3-4d59-9a57-cfd5ec15137b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:31.017071 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43875d-68c3-4d59-9a57-cfd5ec15137b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:31.017342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43875d-68c3-4d59-9a57-cfd5ec15137b admin admin] PATH_INFO: `/v3/users/1684ae6d8d6043b9ae8c2885dce7dc3b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:31.018559 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43875d-68c3-4d59-9a57-cfd5ec15137b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1684ae6d8d6043b9ae8c2885dce7dc3b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:31.020541 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43875d-68c3-4d59-9a57-cfd5ec15137b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:31.070004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ba43875d-68c3-4d59-9a57-cfd5ec15137b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1684ae6d8d6043b9ae8c2885dce7dc3b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.078221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ba43875d-68c3-4d59-9a57-cfd5ec15137b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1684ae6d8d6043b9ae8c2885dce7dc3b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.086823 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:31.092779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ba43875d-68c3-4d59-9a57-cfd5ec15137b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1684ae6d8d6043b9ae8c2885dce7dc3b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.093465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ba43875d-68c3-4d59-9a57-cfd5ec15137b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1684ae6d8d6043b9ae8c2885dce7dc3b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.101082 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ba43875d-68c3-4d59-9a57-cfd5ec15137b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1684ae6d8d6043b9ae8c2885dce7dc3b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.107163 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1383/2756] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:38:30 2022] DELETE /identity/v3/users/1684ae6d8d6043b9ae8c2885dce7dc3b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:31.111894 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1b6d2-ab84-49de-a468-3d52d3b8b177 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:31.112388 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1b6d2-ab84-49de-a468-3d52d3b8b177 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:31.112508 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1b6d2-ab84-49de-a468-3d52d3b8b177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:31.132136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-cfc1b6d2-ab84-49de-a468-3d52d3b8b177 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:31.133334 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-cfc1b6d2-ab84-49de-a468-3d52d3b8b177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:31.189943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1374/2757] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:31.200196 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43875d-68c3-4d59-9a57-cfd5ec15137b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:31.201604 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ba43875d-68c3-4d59-9a57-cfd5ec15137b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:31.259773 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43875d-68c3-4d59-9a57-cfd5ec15137b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:31.263665 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a0202-547f-4576-bd22-0b00363255c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:31.264251 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a0202-547f-4576-bd22-0b00363255c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:31.264530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a0202-547f-4576-bd22-0b00363255c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:31.264803 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a0202-547f-4576-bd22-0b00363255c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:31.273964 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a0202-547f-4576-bd22-0b00363255c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:31.275417 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a0202-547f-4576-bd22-0b00363255c7 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:31.285078 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1384/2758] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:31.550271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1b6d2-ab84-49de-a468-3d52d3b8b177 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:31.552287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-cfc1b6d2-ab84-49de-a468-3d52d3b8b177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:31.564643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1b6d2-ab84-49de-a468-3d52d3b8b177 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:31.569225 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:31.569875 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:31.570164 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:31.570469 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] PATH_INFO: `/v3/projects/42fecb4325fb48eaa0ad4762e32afab8` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:31.571648 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42fecb4325fb48eaa0ad4762e32afab8)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:31.573582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:31.626760 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42fecb4325fb48eaa0ad4762e32afab8', 'request_id': 'req-d2627a9d-87a1-4336-a9e3-e509efb542c8'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.635087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42fecb4325fb48eaa0ad4762e32afab8', 'request_id': 'req-d2627a9d-87a1-4336-a9e3-e509efb542c8'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.644100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42fecb4325fb48eaa0ad4762e32afab8', 'request_id': 'req-d2627a9d-87a1-4336-a9e3-e509efb542c8'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.659114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] The token cache is being invalidate because project 42fecb4325fb48eaa0ad4762e32afab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:38:31.659474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.660063 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.665074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1375/2759] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:38:31 2022] DELETE /identity/v3/projects/42fecb4325fb48eaa0ad4762e32afab8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:31.666294 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a0202-547f-4576-bd22-0b00363255c7 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:31.676687 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a0202-547f-4576-bd22-0b00363255c7 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:31.735815 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9cbc7-8e23-4e7e-8538-f22bb2cddb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:31.736456 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9cbc7-8e23-4e7e-8538-f22bb2cddb70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:31.736739 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9cbc7-8e23-4e7e-8538-f22bb2cddb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:31.737021 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9cbc7-8e23-4e7e-8538-f22bb2cddb70 admin admin] PATH_INFO: `/v3/users/68ca065512df45399ac2a18cafe3cf41` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:31.738182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9cbc7-8e23-4e7e-8538-f22bb2cddb70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ca065512df45399ac2a18cafe3cf41)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:31.740216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9cbc7-8e23-4e7e-8538-f22bb2cddb70 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:31.789070 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cae9cbc7-8e23-4e7e-8538-f22bb2cddb70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ca065512df45399ac2a18cafe3cf41'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.796365 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cae9cbc7-8e23-4e7e-8538-f22bb2cddb70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ca065512df45399ac2a18cafe3cf41'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.809585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cae9cbc7-8e23-4e7e-8538-f22bb2cddb70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ca065512df45399ac2a18cafe3cf41'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.810243 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cae9cbc7-8e23-4e7e-8538-f22bb2cddb70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ca065512df45399ac2a18cafe3cf41'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.817609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cae9cbc7-8e23-4e7e-8538-f22bb2cddb70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ca065512df45399ac2a18cafe3cf41'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:31.823848 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1385/2760] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:38:31 2022] DELETE /identity/v3/users/68ca065512df45399ac2a18cafe3cf41 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:38:32.090892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:32.092536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:32.106310 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2627a9d-87a1-4336-a9e3-e509efb542c8 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:32.110114 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:32.179969 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:32.181024 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:32.181550 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:32.182041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5 admin admin] PATH_INFO: `/v3/projects/63e94a603f294ad3bc05464a4b0376f4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:32.183347 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e94a603f294ad3bc05464a4b0376f4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:32.185831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:32.247939 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e94a603f294ad3bc05464a4b0376f4', 'request_id': 'req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:32.258991 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e94a603f294ad3bc05464a4b0376f4', 'request_id': 'req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:32.266927 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e94a603f294ad3bc05464a4b0376f4', 'request_id': 'req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:32.280352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5 admin admin] The token cache is being invalidate because project 63e94a603f294ad3bc05464a4b0376f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:38:32.280651 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:32.281312 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-8992d85f-fd29-4ee3-ba41-2bd64d7a8bb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:32.283352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1376/2761] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:38:32 2022] DELETE /identity/v3/projects/63e94a603f294ad3bc05464a4b0376f4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:32.288832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fe28e-710a-4279-9f33-b225037cf9cc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:32.289284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fe28e-710a-4279-9f33-b225037cf9cc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:32.289388 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fe28e-710a-4279-9f33-b225037cf9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:32.298299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:32.311420 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c31fe28e-710a-4279-9f33-b225037cf9cc None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:32.312621 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c31fe28e-710a-4279-9f33-b225037cf9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:32.370813 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1386/2762] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:38:32.378862 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86302-7dcc-4442-a98d-bed6b5978fd2 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:32.379153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86302-7dcc-4442-a98d-bed6b5978fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:32.379433 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86302-7dcc-4442-a98d-bed6b5978fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:32.399106 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-66e86302-7dcc-4442-a98d-bed6b5978fd2 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:32.400327 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-66e86302-7dcc-4442-a98d-bed6b5978fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:32.408131 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1377/2763] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:32.413019 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fe28e-710a-4279-9f33-b225037cf9cc None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:32.422775 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fe28e-710a-4279-9f33-b225037cf9cc None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:32.427283 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bfb32-2a43-4314-ab41-b3903c1595ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:32.427888 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bfb32-2a43-4314-ab41-b3903c1595ea admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:32.428185 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bfb32-2a43-4314-ab41-b3903c1595ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:32.428454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bfb32-2a43-4314-ab41-b3903c1595ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:32.429141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bfb32-2a43-4314-ab41-b3903c1595ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:38:32.429449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bfb32-2a43-4314-ab41-b3903c1595ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:32.431081 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bfb32-2a43-4314-ab41-b3903c1595ea admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:32.443042 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1387/2764] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:38:32.447111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e86302-7dcc-4442-a98d-bed6b5978fd2 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:32.456374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e86302-7dcc-4442-a98d-bed6b5978fd2 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:32.461500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd663e-ae93-48b5-8125-43be46676f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:32.462109 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd663e-ae93-48b5-8125-43be46676f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:32.462390 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd663e-ae93-48b5-8125-43be46676f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:32.462696 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd663e-ae93-48b5-8125-43be46676f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:32.463372 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd663e-ae93-48b5-8125-43be46676f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:32.465906 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd663e-ae93-48b5-8125-43be46676f48 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:32.503304 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1378/2765] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:38:32 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:38:32.507603 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bfb32-2a43-4314-ab41-b3903c1595ea admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:32.517564 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bfb32-2a43-4314-ab41-b3903c1595ea admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:32.572428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f32b7-9851-4ade-abef-5075547f1957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:32.573036 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f32b7-9851-4ade-abef-5075547f1957 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:32.573316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f32b7-9851-4ade-abef-5075547f1957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:32.573590 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f32b7-9851-4ade-abef-5075547f1957 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:32.574255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f32b7-9851-4ade-abef-5075547f1957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:32.576197 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f32b7-9851-4ade-abef-5075547f1957 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:32.597137 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1388/2766] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:38:32 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:38:32.601920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd663e-ae93-48b5-8125-43be46676f48 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:32.612186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd663e-ae93-48b5-8125-43be46676f48 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:32.616736 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b4586-e896-41f7-81c3-ddb662d5507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:32.617344 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b4586-e896-41f7-81c3-ddb662d5507c admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:32.617632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b4586-e896-41f7-81c3-ddb662d5507c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:32.617911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b4586-e896-41f7-81c3-ddb662d5507c admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:32.618638 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b4586-e896-41f7-81c3-ddb662d5507c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:32.620231 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b4586-e896-41f7-81c3-ddb662d5507c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:32.630124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1379/2767] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:32.633993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f32b7-9851-4ade-abef-5075547f1957 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:32.643973 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f32b7-9851-4ade-abef-5075547f1957 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:32.649584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277ac47-bfe6-4837-b428-e74063628c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:32.650185 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277ac47-bfe6-4837-b428-e74063628c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:32.650505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277ac47-bfe6-4837-b428-e74063628c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:32.650807 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277ac47-bfe6-4837-b428-e74063628c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:32.651492 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277ac47-bfe6-4837-b428-e74063628c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:32.653140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277ac47-bfe6-4837-b428-e74063628c37 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:32.664072 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1389/2768] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:32.668049 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b4586-e896-41f7-81c3-ddb662d5507c admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:32.678019 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b4586-e896-41f7-81c3-ddb662d5507c admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:32.682853 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950f1d8-5a5a-4755-bd16-a255a50bfc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:32.683572 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950f1d8-5a5a-4755-bd16-a255a50bfc81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:32.683838 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950f1d8-5a5a-4755-bd16-a255a50bfc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:32.684249 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950f1d8-5a5a-4755-bd16-a255a50bfc81 admin admin] PATH_INFO: `/v3/projects/79709d93d56740f0b6f5aeaa9742d24a/users/2c4addfe4a794d98a17edd41f11925d8/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:32.700238 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950f1d8-5a5a-4755-bd16-a255a50bfc81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79709d93d56740f0b6f5aeaa9742d24a, user_id=2c4addfe4a794d98a17edd41f11925d8, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:32.702943 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950f1d8-5a5a-4755-bd16-a255a50bfc81 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:32.718694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1380/2769] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:38:32 2022] PUT /identity/v3/projects/79709d93d56740f0b6f5aeaa9742d24a/users/2c4addfe4a794d98a17edd41f11925d8/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:32.730828 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb6b27-fd30-4c87-a737-9fd97f2be48c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:32.731114 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb6b27-fd30-4c87-a737-9fd97f2be48c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:32.731896 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb6b27-fd30-4c87-a737-9fd97f2be48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:32.762126 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3fcb6b27-fd30-4c87-a737-9fd97f2be48c None None] MFA Rules not processed for user `2c4addfe4a794d98a17edd41f11925d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:32.763499 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3fcb6b27-fd30-4c87-a737-9fd97f2be48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:32.827268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:32.831103 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1390/2770] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:32.836524 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950f1d8-5a5a-4755-bd16-a255a50bfc81 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:32.875029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:32.905613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950f1d8-5a5a-4755-bd16-a255a50bfc81 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:32.910630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aeba0b-b441-48f1-91c1-7e1422e1caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:32.911409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeba0b-b441-48f1-91c1-7e1422e1caae admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:32.911811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeba0b-b441-48f1-91c1-7e1422e1caae admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:32.912036 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeba0b-b441-48f1-91c1-7e1422e1caae admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:32.912914 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aeba0b-b441-48f1-91c1-7e1422e1caae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:32.915050 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aeba0b-b441-48f1-91c1-7e1422e1caae admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:32.940947 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1381/2771] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:38:32 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:38:32.945419 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb6b27-fd30-4c87-a737-9fd97f2be48c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:32.955874 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb6b27-fd30-4c87-a737-9fd97f2be48c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:33.014493 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60803431-8c81-4d10-870f-3119ac107a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:33.015113 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803431-8c81-4d10-870f-3119ac107a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:33.015389 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803431-8c81-4d10-870f-3119ac107a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:33.015662 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803431-8c81-4d10-870f-3119ac107a78 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:33.016316 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60803431-8c81-4d10-870f-3119ac107a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:33.018219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60803431-8c81-4d10-870f-3119ac107a78 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:33.039368 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1391/2772] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:38:32 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:38:33.043643 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aeba0b-b441-48f1-91c1-7e1422e1caae admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:33.054021 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aeba0b-b441-48f1-91c1-7e1422e1caae admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:33.058663 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdcef7-7ae5-4a90-ad90-976b95953f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:33.059462 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdcef7-7ae5-4a90-ad90-976b95953f2f admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:33.059739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdcef7-7ae5-4a90-ad90-976b95953f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:33.060010 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdcef7-7ae5-4a90-ad90-976b95953f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:33.060701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdcef7-7ae5-4a90-ad90-976b95953f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:33.062271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fdcef7-7ae5-4a90-ad90-976b95953f2f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:33.073421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1382/2773] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:33.077833 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60803431-8c81-4d10-870f-3119ac107a78 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:33.088418 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60803431-8c81-4d10-870f-3119ac107a78 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:33.093746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e8b80-75fa-4d5d-9e78-b266af286fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:33.094429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e8b80-75fa-4d5d-9e78-b266af286fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:33.094721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e8b80-75fa-4d5d-9e78-b266af286fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:33.094992 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e8b80-75fa-4d5d-9e78-b266af286fb1 admin admin] PATH_INFO: `/v3/projects/e20a90e2b61d45e795ea6964990737ee/users/b9d9e9ba74e24c2f9574fd0f248f9335/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:33.110659 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e8b80-75fa-4d5d-9e78-b266af286fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20a90e2b61d45e795ea6964990737ee, user_id=b9d9e9ba74e24c2f9574fd0f248f9335, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:33.113321 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e8b80-75fa-4d5d-9e78-b266af286fb1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:33.127165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1392/2774] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:38:33 2022] PUT /identity/v3/projects/e20a90e2b61d45e795ea6964990737ee/users/b9d9e9ba74e24c2f9574fd0f248f9335/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:33.131488 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdcef7-7ae5-4a90-ad90-976b95953f2f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:33.142306 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fdcef7-7ae5-4a90-ad90-976b95953f2f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:33.201620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a01128-e4f9-420c-8a1c-cd076b360af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:33.202360 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a01128-e4f9-420c-8a1c-cd076b360af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:33.202668 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a01128-e4f9-420c-8a1c-cd076b360af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:33.202949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a01128-e4f9-420c-8a1c-cd076b360af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:33.203637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a01128-e4f9-420c-8a1c-cd076b360af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:33.205207 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a01128-e4f9-420c-8a1c-cd076b360af4 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:33.217302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1383/2775] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:38:33.221568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e8b80-75fa-4d5d-9e78-b266af286fb1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:33.232858 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e8b80-75fa-4d5d-9e78-b266af286fb1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:33.238095 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bab03-3abc-4b2f-a041-2a25abf5a76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:33.238779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bab03-3abc-4b2f-a041-2a25abf5a76d admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:33.239584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bab03-3abc-4b2f-a041-2a25abf5a76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:33.239853 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bab03-3abc-4b2f-a041-2a25abf5a76d admin admin] PATH_INFO: `/v3/projects/e20a90e2b61d45e795ea6964990737ee/users/b9d9e9ba74e24c2f9574fd0f248f9335/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:33.241784 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bab03-3abc-4b2f-a041-2a25abf5a76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20a90e2b61d45e795ea6964990737ee, user_id=b9d9e9ba74e24c2f9574fd0f248f9335, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:33.244481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bab03-3abc-4b2f-a041-2a25abf5a76d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:33.255704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1393/2776] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:38:33 2022] PUT /identity/v3/projects/e20a90e2b61d45e795ea6964990737ee/users/b9d9e9ba74e24c2f9574fd0f248f9335/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:33.266284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03d26a-d135-4dd8-99ff-a819eb7d90fe None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:33.266743 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03d26a-d135-4dd8-99ff-a819eb7d90fe None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:33.267029 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03d26a-d135-4dd8-99ff-a819eb7d90fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:33.298920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-2f03d26a-d135-4dd8-99ff-a819eb7d90fe None None] MFA Rules not processed for user `b9d9e9ba74e24c2f9574fd0f248f9335`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:33.300121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2f03d26a-d135-4dd8-99ff-a819eb7d90fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:33.342033 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf23e10-013f-4dde-81a3-51010929f231 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:33.344890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf23e10-013f-4dde-81a3-51010929f231 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:33.345255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf23e10-013f-4dde-81a3-51010929f231 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:33.348635 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1394/2777] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 4 22:38:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:38:33.356469 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c467a-84e8-4723-863b-fffc4c03ed51 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:33.356670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c467a-84e8-4723-863b-fffc4c03ed51 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:33.356836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c467a-84e8-4723-863b-fffc4c03ed51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:33.402704 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1384/2778] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:33.409998 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-df1c467a-84e8-4723-863b-fffc4c03ed51 None None] MFA Rules not processed for user `9ee0de72ba804ba491342a8ae82a44f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:33.411391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-df1c467a-84e8-4723-863b-fffc4c03ed51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:33.416383 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03d26a-d135-4dd8-99ff-a819eb7d90fe None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:33.417881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2f03d26a-d135-4dd8-99ff-a819eb7d90fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:33.481426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:33.485721 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1395/2779] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 4 22:38:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:38:33.507150 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c467a-84e8-4723-863b-fffc4c03ed51 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:33.508939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-df1c467a-84e8-4723-863b-fffc4c03ed51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:33.521868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c467a-84e8-4723-863b-fffc4c03ed51 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:33.522262 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03d26a-d135-4dd8-99ff-a819eb7d90fe None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:33.529784 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a6df5-56c2-49a0-a630-0f01fa5046ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:33.530958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a6df5-56c2-49a0-a630-0f01fa5046ec service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:33.531574 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a6df5-56c2-49a0-a630-0f01fa5046ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:33.532199 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a6df5-56c2-49a0-a630-0f01fa5046ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:33.539908 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e61f2c-7a21-45c4-a63a-4f76048f3ad2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:33.540552 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e61f2c-7a21-45c4-a63a-4f76048f3ad2 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:33.540836 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e61f2c-7a21-45c4-a63a-4f76048f3ad2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:33.541109 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e61f2c-7a21-45c4-a63a-4f76048f3ad2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:33.546048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a6df5-56c2-49a0-a630-0f01fa5046ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:33.548696 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a6df5-56c2-49a0-a630-0f01fa5046ec service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:33.559169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e61f2c-7a21-45c4-a63a-4f76048f3ad2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:33.560617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e61f2c-7a21-45c4-a63a-4f76048f3ad2 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:33.561645 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1396/2780] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:33.587265 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1385/2781] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:38:33.654070 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7ec74-a80a-4ce4-8e20-5bdb57862d74 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:33.654356 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7ec74-a80a-4ce4-8e20-5bdb57862d74 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:33.654658 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7ec74-a80a-4ce4-8e20-5bdb57862d74 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:33.656001 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1397/2782] 10.222.0.27 () {54 vars in 921 bytes} [Thu Aug 4 22:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 04 22:38:33.662961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c3fdc-08dd-460d-9357-efc6f0ec3467 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:33.663272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c3fdc-08dd-460d-9357-efc6f0ec3467 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:33.663553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c3fdc-08dd-460d-9357-efc6f0ec3467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:33.704773 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-8a9c3fdc-08dd-460d-9357-efc6f0ec3467 None None] MFA Rules not processed for user `04899781f67746e193a05bdc004804cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:33.705937 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8a9c3fdc-08dd-460d-9357-efc6f0ec3467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:33.780620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1386/2783] 10.222.0.27 () {58 vars in 1018 bytes} [Thu Aug 4 22:38:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:33.789818 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7ec74-a80a-4ce4-8e20-5bdb57862d74 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:33.801141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7ec74-a80a-4ce4-8e20-5bdb57862d74 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:33.806141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff1cb3-3836-4f80-ba59-024993148716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:33.806707 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff1cb3-3836-4f80-ba59-024993148716 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:33.806994 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff1cb3-3836-4f80-ba59-024993148716 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:33.807270 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff1cb3-3836-4f80-ba59-024993148716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:33.818088 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff1cb3-3836-4f80-ba59-024993148716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:33.819598 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff1cb3-3836-4f80-ba59-024993148716 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:33.831219 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1398/2784] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:33.976528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c3fdc-08dd-460d-9357-efc6f0ec3467 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:34.047959 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c3fdc-08dd-460d-9357-efc6f0ec3467 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:34.066003 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d4276-0a84-43cd-8b51-43fa3c886c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:34.066713 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d4276-0a84-43cd-8b51-43fa3c886c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:34.067035 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d4276-0a84-43cd-8b51-43fa3c886c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:34.067319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d4276-0a84-43cd-8b51-43fa3c886c89 admin admin] PATH_INFO: `/v3/users/2c4addfe4a794d98a17edd41f11925d8` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:34.069193 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d4276-0a84-43cd-8b51-43fa3c886c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4addfe4a794d98a17edd41f11925d8)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:34.071406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d4276-0a84-43cd-8b51-43fa3c886c89 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:34.171976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-671d4276-0a84-43cd-8b51-43fa3c886c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4addfe4a794d98a17edd41f11925d8'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:34.177378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:34.182007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-671d4276-0a84-43cd-8b51-43fa3c886c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4addfe4a794d98a17edd41f11925d8'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:34.192935 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-671d4276-0a84-43cd-8b51-43fa3c886c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4addfe4a794d98a17edd41f11925d8'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:34.194472 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-671d4276-0a84-43cd-8b51-43fa3c886c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4addfe4a794d98a17edd41f11925d8'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:34.212156 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-671d4276-0a84-43cd-8b51-43fa3c886c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4addfe4a794d98a17edd41f11925d8'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:34.219549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1387/2785] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:38:33 2022] DELETE /identity/v3/users/2c4addfe4a794d98a17edd41f11925d8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:34.225279 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ccfc6-cb43-4cf2-85c9-16d4f28ab0e0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:34.225794 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ccfc6-cb43-4cf2-85c9-16d4f28ab0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:34.226285 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ccfc6-cb43-4cf2-85c9-16d4f28ab0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:34.247529 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a53ccfc6-cb43-4cf2-85c9-16d4f28ab0e0 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:34.248755 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a53ccfc6-cb43-4cf2-85c9-16d4f28ab0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:34.268429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:34.313797 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1399/2786] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:34.324246 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d4276-0a84-43cd-8b51-43fa3c886c89 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:34.325686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-671d4276-0a84-43cd-8b51-43fa3c886c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:34.389831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d4276-0a84-43cd-8b51-43fa3c886c89 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:34.394819 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae990c-6f46-4a59-8885-f89f482d6569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:34.396610 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae990c-6f46-4a59-8885-f89f482d6569 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:34.396892 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae990c-6f46-4a59-8885-f89f482d6569 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:34.397419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae990c-6f46-4a59-8885-f89f482d6569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:34.409705 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae990c-6f46-4a59-8885-f89f482d6569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:34.411735 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae990c-6f46-4a59-8885-f89f482d6569 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:34.421685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1388/2787] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:34.759287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ccfc6-cb43-4cf2-85c9-16d4f28ab0e0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:34.760939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a53ccfc6-cb43-4cf2-85c9-16d4f28ab0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:34.801735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ccfc6-cb43-4cf2-85c9-16d4f28ab0e0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:34.807105 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:34.808075 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:34.808361 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:34.808776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] PATH_INFO: `/v3/projects/79709d93d56740f0b6f5aeaa9742d24a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:34.810074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=79709d93d56740f0b6f5aeaa9742d24a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:34.813302 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:34.868133 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79709d93d56740f0b6f5aeaa9742d24a', 'request_id': 'req-86490243-c86d-42fb-b42d-f35a8b58fa5f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:34.874782 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79709d93d56740f0b6f5aeaa9742d24a', 'request_id': 'req-86490243-c86d-42fb-b42d-f35a8b58fa5f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:34.882688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79709d93d56740f0b6f5aeaa9742d24a', 'request_id': 'req-86490243-c86d-42fb-b42d-f35a8b58fa5f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:34.894156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] The token cache is being invalidate because project 79709d93d56740f0b6f5aeaa9742d24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:38:34.894530 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:34.895746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:34.897278 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1400/2788] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:38:34 2022] DELETE /identity/v3/projects/79709d93d56740f0b6f5aeaa9742d24a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:34.901352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae990c-6f46-4a59-8885-f89f482d6569 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:34.913503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae990c-6f46-4a59-8885-f89f482d6569 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:34.970624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa959c-8686-49cf-9d0e-1050c01e402e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:34.971358 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa959c-8686-49cf-9d0e-1050c01e402e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:34.971644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa959c-8686-49cf-9d0e-1050c01e402e admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:34.971923 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa959c-8686-49cf-9d0e-1050c01e402e admin admin] PATH_INFO: `/v3/users/b9d9e9ba74e24c2f9574fd0f248f9335` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:34.973099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa959c-8686-49cf-9d0e-1050c01e402e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d9e9ba74e24c2f9574fd0f248f9335)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:34.975101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa959c-8686-49cf-9d0e-1050c01e402e admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:35.028963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3dfa959c-8686-49cf-9d0e-1050c01e402e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d9e9ba74e24c2f9574fd0f248f9335'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:35.037569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3dfa959c-8686-49cf-9d0e-1050c01e402e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d9e9ba74e24c2f9574fd0f248f9335'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:35.045463 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3dfa959c-8686-49cf-9d0e-1050c01e402e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d9e9ba74e24c2f9574fd0f248f9335'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:35.046279 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3dfa959c-8686-49cf-9d0e-1050c01e402e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d9e9ba74e24c2f9574fd0f248f9335'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:35.056313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:35.064016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-3dfa959c-8686-49cf-9d0e-1050c01e402e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d9e9ba74e24c2f9574fd0f248f9335'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:35.074283 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1389/2789] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:38:34 2022] DELETE /identity/v3/users/b9d9e9ba74e24c2f9574fd0f248f9335 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:38:35.360794 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:35.362484 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:35.387205 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86490243-c86d-42fb-b42d-f35a8b58fa5f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:35.469570 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a79e1c-8320-4309-9dbb-58f4d21ab98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:35.470477 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a79e1c-8320-4309-9dbb-58f4d21ab98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:35.470914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a79e1c-8320-4309-9dbb-58f4d21ab98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:35.471628 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a79e1c-8320-4309-9dbb-58f4d21ab98c admin admin] PATH_INFO: `/v3/projects/e20a90e2b61d45e795ea6964990737ee` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:35.472784 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a79e1c-8320-4309-9dbb-58f4d21ab98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20a90e2b61d45e795ea6964990737ee)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:35.475389 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a79e1c-8320-4309-9dbb-58f4d21ab98c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:35.525831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:35.526980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-17a79e1c-8320-4309-9dbb-58f4d21ab98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20a90e2b61d45e795ea6964990737ee', 'request_id': 'req-17a79e1c-8320-4309-9dbb-58f4d21ab98c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:35.534149 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-17a79e1c-8320-4309-9dbb-58f4d21ab98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20a90e2b61d45e795ea6964990737ee', 'request_id': 'req-17a79e1c-8320-4309-9dbb-58f4d21ab98c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:35.542923 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-17a79e1c-8320-4309-9dbb-58f4d21ab98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20a90e2b61d45e795ea6964990737ee', 'request_id': 'req-17a79e1c-8320-4309-9dbb-58f4d21ab98c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:35.553787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-17a79e1c-8320-4309-9dbb-58f4d21ab98c admin admin] The token cache is being invalidate because project e20a90e2b61d45e795ea6964990737ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:38:35.554023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-17a79e1c-8320-4309-9dbb-58f4d21ab98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:35.554697 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-17a79e1c-8320-4309-9dbb-58f4d21ab98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:35.556290 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1401/2790] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:38:35 2022] DELETE /identity/v3/projects/e20a90e2b61d45e795ea6964990737ee => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:35.561787 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1589d-7f3b-4c94-99f7-7878281aae06 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:35.562227 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1589d-7f3b-4c94-99f7-7878281aae06 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:35.562365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1589d-7f3b-4c94-99f7-7878281aae06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:35.581574 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-e4a1589d-7f3b-4c94-99f7-7878281aae06 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:35.583351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-e4a1589d-7f3b-4c94-99f7-7878281aae06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:35.641117 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1390/2791] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:35.649239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6dec8-2778-4ebd-acfe-baba787be9bc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:35.649561 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6dec8-2778-4ebd-acfe-baba787be9bc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:35.649841 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6dec8-2778-4ebd-acfe-baba787be9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:35.669611 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c6b6dec8-2778-4ebd-acfe-baba787be9bc None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:35.670842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c6b6dec8-2778-4ebd-acfe-baba787be9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:35.678971 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1402/2792] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:35.683130 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1589d-7f3b-4c94-99f7-7878281aae06 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:35.692709 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1589d-7f3b-4c94-99f7-7878281aae06 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:35.697224 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b17640-9afb-4849-aacf-5981e5640d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:35.697830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b17640-9afb-4849-aacf-5981e5640d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:35.698112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b17640-9afb-4849-aacf-5981e5640d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:35.698386 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b17640-9afb-4849-aacf-5981e5640d8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:35.699135 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b17640-9afb-4849-aacf-5981e5640d8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:38:35.699447 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b17640-9afb-4849-aacf-5981e5640d8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:35.701025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b17640-9afb-4849-aacf-5981e5640d8c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:35.712885 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1391/2793] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:38:35.717305 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6dec8-2778-4ebd-acfe-baba787be9bc None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:35.727198 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6dec8-2778-4ebd-acfe-baba787be9bc None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:35.731866 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f8bb1-48b9-4757-9e96-219a787f974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:35.732475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f8bb1-48b9-4757-9e96-219a787f974c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:35.732753 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f8bb1-48b9-4757-9e96-219a787f974c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:35.733020 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f8bb1-48b9-4757-9e96-219a787f974c admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:35.733700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f8bb1-48b9-4757-9e96-219a787f974c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:35.735641 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f8bb1-48b9-4757-9e96-219a787f974c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:35.762252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1403/2794] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:38:35 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:38:35.766440 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b17640-9afb-4849-aacf-5981e5640d8c admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:35.776804 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b17640-9afb-4849-aacf-5981e5640d8c admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:35.830865 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93236c6-42ff-4444-9497-da0ec3290afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:35.831481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93236c6-42ff-4444-9497-da0ec3290afc admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:35.831764 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93236c6-42ff-4444-9497-da0ec3290afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:35.832035 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93236c6-42ff-4444-9497-da0ec3290afc admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:35.833302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93236c6-42ff-4444-9497-da0ec3290afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:35.835251 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93236c6-42ff-4444-9497-da0ec3290afc admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:35.857468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1392/2795] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:38:35 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:38:35.862615 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f8bb1-48b9-4757-9e96-219a787f974c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:35.873015 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f8bb1-48b9-4757-9e96-219a787f974c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:35.877672 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf89726-898f-4303-95f7-2e6f838fc28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:35.878289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf89726-898f-4303-95f7-2e6f838fc28e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:35.878607 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf89726-898f-4303-95f7-2e6f838fc28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:35.878886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf89726-898f-4303-95f7-2e6f838fc28e admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:35.880118 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf89726-898f-4303-95f7-2e6f838fc28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:35.881717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf89726-898f-4303-95f7-2e6f838fc28e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:35.895213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1404/2796] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:35.896934 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93236c6-42ff-4444-9497-da0ec3290afc admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:35.906856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93236c6-42ff-4444-9497-da0ec3290afc admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:35.911673 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197f4ef-6cd2-4cef-8a88-735241dfd2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:35.912537 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197f4ef-6cd2-4cef-8a88-735241dfd2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:35.912825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197f4ef-6cd2-4cef-8a88-735241dfd2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:35.913100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197f4ef-6cd2-4cef-8a88-735241dfd2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:35.913805 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197f4ef-6cd2-4cef-8a88-735241dfd2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:35.915460 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197f4ef-6cd2-4cef-8a88-735241dfd2b1 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:35.927214 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1393/2797] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:35.931396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf89726-898f-4303-95f7-2e6f838fc28e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:35.941870 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf89726-898f-4303-95f7-2e6f838fc28e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:35.947235 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9767e82-98f9-454b-954b-2fdd5c201a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:35.947904 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9767e82-98f9-454b-954b-2fdd5c201a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:35.948244 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9767e82-98f9-454b-954b-2fdd5c201a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:35.948462 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9767e82-98f9-454b-954b-2fdd5c201a93 admin admin] PATH_INFO: `/v3/projects/de6418dd5ef64df280ed0859d1cbc55d/users/9df5a13ee993428fb72cfc74103874c6/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:35.970733 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9767e82-98f9-454b-954b-2fdd5c201a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6418dd5ef64df280ed0859d1cbc55d, user_id=9df5a13ee993428fb72cfc74103874c6, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:35.973400 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9767e82-98f9-454b-954b-2fdd5c201a93 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:35.986943 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1405/2798] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:38:35 2022] PUT /identity/v3/projects/de6418dd5ef64df280ed0859d1cbc55d/users/9df5a13ee993428fb72cfc74103874c6/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:35.998359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab09c9b-6bcc-4283-bb5f-c6d08713fe9d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:35.998671 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab09c9b-6bcc-4283-bb5f-c6d08713fe9d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:35.998954 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab09c9b-6bcc-4283-bb5f-c6d08713fe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:36.027150 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-bab09c9b-6bcc-4283-bb5f-c6d08713fe9d None None] MFA Rules not processed for user `9df5a13ee993428fb72cfc74103874c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:36.028350 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-bab09c9b-6bcc-4283-bb5f-c6d08713fe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:36.071176 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:36.091983 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1394/2799] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:38:36.096470 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9767e82-98f9-454b-954b-2fdd5c201a93 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:36.158281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9767e82-98f9-454b-954b-2fdd5c201a93 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:36.162911 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7eab5-9a94-4002-91bb-42a6b3cb54c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:36.163519 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7eab5-9a94-4002-91bb-42a6b3cb54c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:36.163800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7eab5-9a94-4002-91bb-42a6b3cb54c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:36.164073 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7eab5-9a94-4002-91bb-42a6b3cb54c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:36.164725 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7eab5-9a94-4002-91bb-42a6b3cb54c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:36.166632 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7eab5-9a94-4002-91bb-42a6b3cb54c8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:36.194299 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1406/2800] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:38:36 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:38:36.198289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab09c9b-6bcc-4283-bb5f-c6d08713fe9d None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:36.208746 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab09c9b-6bcc-4283-bb5f-c6d08713fe9d None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:36.265911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab2f8c-db15-421a-8018-177c517edcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:36.266477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2f8c-db15-421a-8018-177c517edcf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:36.266761 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2f8c-db15-421a-8018-177c517edcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:36.267037 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2f8c-db15-421a-8018-177c517edcf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:36.267707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab2f8c-db15-421a-8018-177c517edcf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:36.269613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab2f8c-db15-421a-8018-177c517edcf5 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:36.289654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1395/2801] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:38:36 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:38:36.293636 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7eab5-9a94-4002-91bb-42a6b3cb54c8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:36.304438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7eab5-9a94-4002-91bb-42a6b3cb54c8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:36.309209 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a59f8-6203-45ca-9239-853aa0e4b424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:36.309819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a59f8-6203-45ca-9239-853aa0e4b424 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:36.310102 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a59f8-6203-45ca-9239-853aa0e4b424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:36.310377 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a59f8-6203-45ca-9239-853aa0e4b424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:36.311134 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a59f8-6203-45ca-9239-853aa0e4b424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:36.312726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a59f8-6203-45ca-9239-853aa0e4b424 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:36.323879 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1407/2802] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:36.327852 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab2f8c-db15-421a-8018-177c517edcf5 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:36.337825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab2f8c-db15-421a-8018-177c517edcf5 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:36.342709 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006560d2-f5d2-4309-9e6a-db32923024fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:36.343357 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006560d2-f5d2-4309-9e6a-db32923024fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:36.343636 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006560d2-f5d2-4309-9e6a-db32923024fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:36.343912 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006560d2-f5d2-4309-9e6a-db32923024fd admin admin] PATH_INFO: `/v3/projects/fff1d30792bd419aa530bcdafaa6f36e/users/b63af1015006462bbc4c4c38446c6173/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:36.358231 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006560d2-f5d2-4309-9e6a-db32923024fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff1d30792bd419aa530bcdafaa6f36e, user_id=b63af1015006462bbc4c4c38446c6173, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:36.360913 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006560d2-f5d2-4309-9e6a-db32923024fd admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:36.374022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1396/2803] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:38:36 2022] PUT /identity/v3/projects/fff1d30792bd419aa530bcdafaa6f36e/users/b63af1015006462bbc4c4c38446c6173/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:38:36.377950 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a59f8-6203-45ca-9239-853aa0e4b424 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:36.388585 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a59f8-6203-45ca-9239-853aa0e4b424 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:36.434122 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:36.450799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c36ec-c65e-4e6a-b62a-aebbcd765685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:36.451433 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c36ec-c65e-4e6a-b62a-aebbcd765685 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:36.451716 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c36ec-c65e-4e6a-b62a-aebbcd765685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:36.451993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c36ec-c65e-4e6a-b62a-aebbcd765685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:36.452692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c36ec-c65e-4e6a-b62a-aebbcd765685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:36.454289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c36ec-c65e-4e6a-b62a-aebbcd765685 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:36.464371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1408/2804] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:38:36.468868 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006560d2-f5d2-4309-9e6a-db32923024fd admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:36.479500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006560d2-f5d2-4309-9e6a-db32923024fd admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:36.484118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745c416-8364-4f58-89c9-95990c04e772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:36.484777 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745c416-8364-4f58-89c9-95990c04e772 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:36.485062 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745c416-8364-4f58-89c9-95990c04e772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:36.485338 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745c416-8364-4f58-89c9-95990c04e772 admin admin] PATH_INFO: `/v3/projects/fff1d30792bd419aa530bcdafaa6f36e/users/b63af1015006462bbc4c4c38446c6173/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:36.487313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745c416-8364-4f58-89c9-95990c04e772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff1d30792bd419aa530bcdafaa6f36e, user_id=b63af1015006462bbc4c4c38446c6173, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:36.490493 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745c416-8364-4f58-89c9-95990c04e772 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:36.500506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1397/2805] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:38:36 2022] PUT /identity/v3/projects/fff1d30792bd419aa530bcdafaa6f36e/users/b63af1015006462bbc4c4c38446c6173/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:36.515713 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda500c1-b462-4d41-85f5-f71d0b0824d5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:36.516054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda500c1-b462-4d41-85f5-f71d0b0824d5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:36.516275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda500c1-b462-4d41-85f5-f71d0b0824d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:36.544473 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-dda500c1-b462-4d41-85f5-f71d0b0824d5 None None] MFA Rules not processed for user `b63af1015006462bbc4c4c38446c6173`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:36.545694 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dda500c1-b462-4d41-85f5-f71d0b0824d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:36.614970 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1409/2806] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:36.625904 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745c416-8364-4f58-89c9-95990c04e772 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:36.627691 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5745c416-8364-4f58-89c9-95990c04e772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:36.686217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745c416-8364-4f58-89c9-95990c04e772 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:36.689976 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba5936-257b-4c61-9cea-4257d7e05650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:36.690633 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba5936-257b-4c61-9cea-4257d7e05650 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:36.690920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba5936-257b-4c61-9cea-4257d7e05650 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:36.691199 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba5936-257b-4c61-9cea-4257d7e05650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:36.745250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:36.749940 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba5936-257b-4c61-9cea-4257d7e05650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:36.751815 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba5936-257b-4c61-9cea-4257d7e05650 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:36.761328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1398/2807] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:41.022746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda500c1-b462-4d41-85f5-f71d0b0824d5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:41.024130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dda500c1-b462-4d41-85f5-f71d0b0824d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:41.036016 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda500c1-b462-4d41-85f5-f71d0b0824d5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:41.039576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cb125-b1f0-4f6b-b27e-613f3eed31a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:41.040182 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cb125-b1f0-4f6b-b27e-613f3eed31a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:41.040467 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cb125-b1f0-4f6b-b27e-613f3eed31a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:41.040743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cb125-b1f0-4f6b-b27e-613f3eed31a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:41.049619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cb125-b1f0-4f6b-b27e-613f3eed31a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:41.051097 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cb125-b1f0-4f6b-b27e-613f3eed31a8 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:41.060495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1410/2808] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:42.468080 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ace5c3-2b75-4146-91e8-663962924645 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:42.468623 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ace5c3-2b75-4146-91e8-663962924645 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:42.468623 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ace5c3-2b75-4146-91e8-663962924645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:42.490605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c2ace5c3-2b75-4146-91e8-663962924645 None None] MFA Rules not processed for user `41a0adc34c7645028ec506e9437b07f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:42.491742 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c2ace5c3-2b75-4146-91e8-663962924645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:42.561073 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1399/2809] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:42.826281 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cb125-b1f0-4f6b-b27e-613f3eed31a8 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:42.827812 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-da2cb125-b1f0-4f6b-b27e-613f3eed31a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:42.901679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cb125-b1f0-4f6b-b27e-613f3eed31a8 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:42.905257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e2ce4-32ab-4403-818a-bcef6597f662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:42.905871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e2ce4-32ab-4403-818a-bcef6597f662 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:42.906181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e2ce4-32ab-4403-818a-bcef6597f662 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:42.906599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e2ce4-32ab-4403-818a-bcef6597f662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:42.908431 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-189e2ce4-32ab-4403-818a-bcef6597f662 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:42.920571 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e2ce4-32ab-4403-818a-bcef6597f662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:42.922042 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e2ce4-32ab-4403-818a-bcef6597f662 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:42.931441 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1411/2810] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:46.012692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ace5c3-2b75-4146-91e8-663962924645 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:46.081632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ace5c3-2b75-4146-91e8-663962924645 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:46.086789 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b703a55-215f-4f39-a0fc-6548abd41c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:46.087439 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b703a55-215f-4f39-a0fc-6548abd41c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:46.087720 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b703a55-215f-4f39-a0fc-6548abd41c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:46.087995 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b703a55-215f-4f39-a0fc-6548abd41c81 admin admin] PATH_INFO: `/v3/users/9df5a13ee993428fb72cfc74103874c6` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:46.089181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b703a55-215f-4f39-a0fc-6548abd41c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df5a13ee993428fb72cfc74103874c6)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:46.091399 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b703a55-215f-4f39-a0fc-6548abd41c81 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:46.139256 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7b703a55-215f-4f39-a0fc-6548abd41c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df5a13ee993428fb72cfc74103874c6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:46.147289 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7b703a55-215f-4f39-a0fc-6548abd41c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df5a13ee993428fb72cfc74103874c6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:46.154624 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7b703a55-215f-4f39-a0fc-6548abd41c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df5a13ee993428fb72cfc74103874c6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:46.155272 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7b703a55-215f-4f39-a0fc-6548abd41c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df5a13ee993428fb72cfc74103874c6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:46.168099 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-7b703a55-215f-4f39-a0fc-6548abd41c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df5a13ee993428fb72cfc74103874c6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:46.174006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1400/2811] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:38:46 2022] DELETE /identity/v3/users/9df5a13ee993428fb72cfc74103874c6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:38:46.178829 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726039a-55c1-43de-b88e-1da526b22228 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:46.179336 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726039a-55c1-43de-b88e-1da526b22228 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:46.179438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726039a-55c1-43de-b88e-1da526b22228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:46.200549 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1726039a-55c1-43de-b88e-1da526b22228 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:46.201773 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1726039a-55c1-43de-b88e-1da526b22228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:46.263644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:46.273732 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1412/2812] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:46.283520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b703a55-215f-4f39-a0fc-6548abd41c81 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:46.284918 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-7b703a55-215f-4f39-a0fc-6548abd41c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:46.305241 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:46.345829 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b703a55-215f-4f39-a0fc-6548abd41c81 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:46.349471 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec82bd-37f4-4674-8efb-5a888b9ca679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:46.350089 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec82bd-37f4-4674-8efb-5a888b9ca679 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:46.350376 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec82bd-37f4-4674-8efb-5a888b9ca679 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:46.350681 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec82bd-37f4-4674-8efb-5a888b9ca679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:46.359764 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec82bd-37f4-4674-8efb-5a888b9ca679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:46.361187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec82bd-37f4-4674-8efb-5a888b9ca679 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:46.370737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1401/2813] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:46.841890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726039a-55c1-43de-b88e-1da526b22228 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:46.843404 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1726039a-55c1-43de-b88e-1da526b22228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:46.859979 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726039a-55c1-43de-b88e-1da526b22228 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:46.864748 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:46.865425 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:46.865709 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:46.865986 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] PATH_INFO: `/v3/projects/de6418dd5ef64df280ed0859d1cbc55d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:46.867181 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=de6418dd5ef64df280ed0859d1cbc55d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:46.869087 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:46.916679 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de6418dd5ef64df280ed0859d1cbc55d', 'request_id': 'req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:46.922882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de6418dd5ef64df280ed0859d1cbc55d', 'request_id': 'req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:46.930160 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de6418dd5ef64df280ed0859d1cbc55d', 'request_id': 'req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:46.940480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] The token cache is being invalidate because project de6418dd5ef64df280ed0859d1cbc55d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:38:46.940795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:46.941429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:46.942993 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1413/2814] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:38:46 2022] DELETE /identity/v3/projects/de6418dd5ef64df280ed0859d1cbc55d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:46.947134 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec82bd-37f4-4674-8efb-5a888b9ca679 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:46.957134 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec82bd-37f4-4674-8efb-5a888b9ca679 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:47.014326 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c3dc6-409a-4a1f-b780-d8d7314dd3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:47.015025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c3dc6-409a-4a1f-b780-d8d7314dd3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:47.015298 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c3dc6-409a-4a1f-b780-d8d7314dd3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:47.015599 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c3dc6-409a-4a1f-b780-d8d7314dd3f8 admin admin] PATH_INFO: `/v3/users/b63af1015006462bbc4c4c38446c6173` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:47.016762 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c3dc6-409a-4a1f-b780-d8d7314dd3f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63af1015006462bbc4c4c38446c6173)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:47.018702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c3dc6-409a-4a1f-b780-d8d7314dd3f8 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:47.063863 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5e3c3dc6-409a-4a1f-b780-d8d7314dd3f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63af1015006462bbc4c4c38446c6173'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:47.071763 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5e3c3dc6-409a-4a1f-b780-d8d7314dd3f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63af1015006462bbc4c4c38446c6173'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:47.079057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5e3c3dc6-409a-4a1f-b780-d8d7314dd3f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63af1015006462bbc4c4c38446c6173'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:47.079692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5e3c3dc6-409a-4a1f-b780-d8d7314dd3f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63af1015006462bbc4c4c38446c6173'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:47.092684 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-5e3c3dc6-409a-4a1f-b780-d8d7314dd3f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63af1015006462bbc4c4c38446c6173'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:47.098697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1402/2815] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:38:46 2022] DELETE /identity/v3/users/b63af1015006462bbc4c4c38446c6173 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:47.373464 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:47.374966 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:47.388713 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8d1ed-98b5-4e5f-b89f-0a3accd1e36a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:47.477145 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbd486-ddb3-4932-8a10-d8f32a26da18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:47.477880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbd486-ddb3-4932-8a10-d8f32a26da18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:47.478161 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbd486-ddb3-4932-8a10-d8f32a26da18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:47.478465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbd486-ddb3-4932-8a10-d8f32a26da18 admin admin] PATH_INFO: `/v3/projects/fff1d30792bd419aa530bcdafaa6f36e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:47.479798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbd486-ddb3-4932-8a10-d8f32a26da18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff1d30792bd419aa530bcdafaa6f36e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:47.481684 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbd486-ddb3-4932-8a10-d8f32a26da18 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:47.532130 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-14dbd486-ddb3-4932-8a10-d8f32a26da18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff1d30792bd419aa530bcdafaa6f36e', 'request_id': 'req-14dbd486-ddb3-4932-8a10-d8f32a26da18'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:47.538875 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-14dbd486-ddb3-4932-8a10-d8f32a26da18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff1d30792bd419aa530bcdafaa6f36e', 'request_id': 'req-14dbd486-ddb3-4932-8a10-d8f32a26da18'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:47.546723 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-14dbd486-ddb3-4932-8a10-d8f32a26da18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff1d30792bd419aa530bcdafaa6f36e', 'request_id': 'req-14dbd486-ddb3-4932-8a10-d8f32a26da18'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:47.557129 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-14dbd486-ddb3-4932-8a10-d8f32a26da18 admin admin] The token cache is being invalidate because project fff1d30792bd419aa530bcdafaa6f36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:38:47.557422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-14dbd486-ddb3-4932-8a10-d8f32a26da18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:47.558050 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-14dbd486-ddb3-4932-8a10-d8f32a26da18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:38:47.559569 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1414/2816] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:38:47 2022] DELETE /identity/v3/projects/fff1d30792bd419aa530bcdafaa6f36e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:47.565429 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7630f-09be-4c66-b5e4-bc783a64b6e9 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:47.565768 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7630f-09be-4c66-b5e4-bc783a64b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:47.566080 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7630f-09be-4c66-b5e4-bc783a64b6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:47.586389 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b3f7630f-09be-4c66-b5e4-bc783a64b6e9 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:47.587626 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b3f7630f-09be-4c66-b5e4-bc783a64b6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:47.623548 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:47.650615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1403/2817] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:47.660194 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ffe3c-f827-4a63-b05c-f03ba7d32509 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:47.660570 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ffe3c-f827-4a63-b05c-f03ba7d32509 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:47.660980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ffe3c-f827-4a63-b05c-f03ba7d32509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:47.680902 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-263ffe3c-f827-4a63-b05c-f03ba7d32509 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:47.682112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-263ffe3c-f827-4a63-b05c-f03ba7d32509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:47.689968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1415/2818] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:47.694346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7630f-09be-4c66-b5e4-bc783a64b6e9 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:47.704080 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7630f-09be-4c66-b5e4-bc783a64b6e9 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:47.709267 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d594a8-e3d5-4a42-9231-41f412a560d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:47.709879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d594a8-e3d5-4a42-9231-41f412a560d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:47.710163 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d594a8-e3d5-4a42-9231-41f412a560d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:47.710465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d594a8-e3d5-4a42-9231-41f412a560d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:47.711167 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d594a8-e3d5-4a42-9231-41f412a560d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80284) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:38:47.711479 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d594a8-e3d5-4a42-9231-41f412a560d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:47.713074 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d594a8-e3d5-4a42-9231-41f412a560d1 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:47.725395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1404/2819] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:38:47.729832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ffe3c-f827-4a63-b05c-f03ba7d32509 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:47.735353 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:47.739727 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ffe3c-f827-4a63-b05c-f03ba7d32509 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:47.745984 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13419c79-c5ba-4680-9c6e-693142c22714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:47.746616 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13419c79-c5ba-4680-9c6e-693142c22714 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:47.746903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13419c79-c5ba-4680-9c6e-693142c22714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:47.747179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13419c79-c5ba-4680-9c6e-693142c22714 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:47.747831 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13419c79-c5ba-4680-9c6e-693142c22714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:47.749726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13419c79-c5ba-4680-9c6e-693142c22714 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:47.778106 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1416/2820] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:38:47 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:38:47.782305 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d594a8-e3d5-4a42-9231-41f412a560d1 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:47.792467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d594a8-e3d5-4a42-9231-41f412a560d1 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:47.848679 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132b83a-3669-43a4-97f4-4932da9a0140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:47.849302 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132b83a-3669-43a4-97f4-4932da9a0140 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:47.849582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132b83a-3669-43a4-97f4-4932da9a0140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:47.849856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132b83a-3669-43a4-97f4-4932da9a0140 admin admin] PATH_INFO: `/v3/users` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:47.850549 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132b83a-3669-43a4-97f4-4932da9a0140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:47.852443 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132b83a-3669-43a4-97f4-4932da9a0140 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:47.876808 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1405/2821] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:38:47 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:38:47.881066 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13419c79-c5ba-4680-9c6e-693142c22714 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:47.892770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13419c79-c5ba-4680-9c6e-693142c22714 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:47.907273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc186d8b-2daf-4cc3-8ee4-97ccea12ceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:47.908409 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc186d8b-2daf-4cc3-8ee4-97ccea12ceaf admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:47.908692 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc186d8b-2daf-4cc3-8ee4-97ccea12ceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:47.908964 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc186d8b-2daf-4cc3-8ee4-97ccea12ceaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:47.909710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc186d8b-2daf-4cc3-8ee4-97ccea12ceaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:47.911421 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc186d8b-2daf-4cc3-8ee4-97ccea12ceaf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:47.926023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1417/2822] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:38:47.927239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132b83a-3669-43a4-97f4-4932da9a0140 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:47.937881 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132b83a-3669-43a4-97f4-4932da9a0140 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:47.943112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dce98f-59cf-4b78-bc35-8571968ffd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:47.943734 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dce98f-59cf-4b78-bc35-8571968ffd57 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:47.944012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dce98f-59cf-4b78-bc35-8571968ffd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:47.944285 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dce98f-59cf-4b78-bc35-8571968ffd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:47.944973 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dce98f-59cf-4b78-bc35-8571968ffd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:47.946591 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dce98f-59cf-4b78-bc35-8571968ffd57 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:47.959001 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1406/2823] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 04 22:38:47.962627 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc186d8b-2daf-4cc3-8ee4-97ccea12ceaf admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:47.973028 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc186d8b-2daf-4cc3-8ee4-97ccea12ceaf admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:47.978428 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c1cd5-21ef-46da-b8c8-88ab96dc05d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:47.979429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c1cd5-21ef-46da-b8c8-88ab96dc05d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:47.979771 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c1cd5-21ef-46da-b8c8-88ab96dc05d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:47.980112 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c1cd5-21ef-46da-b8c8-88ab96dc05d2 admin admin] PATH_INFO: `/v3/projects/7d4831795c514e3facc6f7f9fc12cda3/users/d8832832650b49588d4994a74347dcb7/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:47.996945 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c1cd5-21ef-46da-b8c8-88ab96dc05d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4831795c514e3facc6f7f9fc12cda3, user_id=d8832832650b49588d4994a74347dcb7, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:47.999865 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c1cd5-21ef-46da-b8c8-88ab96dc05d2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:48.015000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1418/2824] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:38:47 2022] PUT /identity/v3/projects/7d4831795c514e3facc6f7f9fc12cda3/users/d8832832650b49588d4994a74347dcb7/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:38:48.020811 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97344be2-c1e4-4b01-941c-aad6cb6ce7b4 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:48.021255 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97344be2-c1e4-4b01-941c-aad6cb6ce7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:48.021365 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97344be2-c1e4-4b01-941c-aad6cb6ce7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:48.039967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-97344be2-c1e4-4b01-941c-aad6cb6ce7b4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:48.041147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-97344be2-c1e4-4b01-941c-aad6cb6ce7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:48.098963 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1407/2825] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 04 22:38:48.108622 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c1cd5-21ef-46da-b8c8-88ab96dc05d2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:48.110273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-367c1cd5-21ef-46da-b8c8-88ab96dc05d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:48.166855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c1cd5-21ef-46da-b8c8-88ab96dc05d2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:48.170436 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2761170-2489-4ee1-91de-dfa1bf352fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:48.171041 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2761170-2489-4ee1-91de-dfa1bf352fbf service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:48.171318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2761170-2489-4ee1-91de-dfa1bf352fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:48.171592 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2761170-2489-4ee1-91de-dfa1bf352fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:48.180927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2761170-2489-4ee1-91de-dfa1bf352fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:48.182340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2761170-2489-4ee1-91de-dfa1bf352fbf service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:48.191610 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1419/2826] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:48.861569 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189fa7b-4fd9-44ce-aaf9-295bf92872b8 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:48.861997 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189fa7b-4fd9-44ce-aaf9-295bf92872b8 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:48.862348 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189fa7b-4fd9-44ce-aaf9-295bf92872b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:48.891013 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-f189fa7b-4fd9-44ce-aaf9-295bf92872b8 None None] MFA Rules not processed for user `d8832832650b49588d4994a74347dcb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:48.892769 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f189fa7b-4fd9-44ce-aaf9-295bf92872b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:48.928459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:38:48.963457 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1408/2827] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:48.975375 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2761170-2489-4ee1-91de-dfa1bf352fbf service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:38:48.976778 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f2761170-2489-4ee1-91de-dfa1bf352fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:49.049839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2761170-2489-4ee1-91de-dfa1bf352fbf service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:38:49.054014 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cda50-6af0-40f2-a3d1-aa56068c095b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:38:49.054749 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cda50-6af0-40f2-a3d1-aa56068c095b service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:49.055099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cda50-6af0-40f2-a3d1-aa56068c095b service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:49.055447 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cda50-6af0-40f2-a3d1-aa56068c095b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:49.064395 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cda50-6af0-40f2-a3d1-aa56068c095b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:38:49.065972 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cda50-6af0-40f2-a3d1-aa56068c095b service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:38:49.075444 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1420/2828] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:38:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:38:50.436014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9649172-a977-45b9-b0b2-881b137dac65 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:38:50.436511 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9649172-a977-45b9-b0b2-881b137dac65 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:38:50.436807 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9649172-a977-45b9-b0b2-881b137dac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:38:50.456359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-f9649172-a977-45b9-b0b2-881b137dac65 None None] MFA Rules not processed for user `d8832832650b49588d4994a74347dcb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:38:50.457519 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f9649172-a977-45b9-b0b2-881b137dac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:38:50.464584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1409/2829] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:38:59.071167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=74,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:00.451523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=14 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:09.705247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252f913-6ab7-4670-ae76-c1b949002498 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:09.705746 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252f913-6ab7-4670-ae76-c1b949002498 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:09.705847 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252f913-6ab7-4670-ae76-c1b949002498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:09.727909 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9252f913-6ab7-4670-ae76-c1b949002498 None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:09.729175 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9252f913-6ab7-4670-ae76-c1b949002498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:09.784003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1421/2830] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:39:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:09.831681 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9649172-a977-45b9-b0b2-881b137dac65 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:09.833132 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f9649172-a977-45b9-b0b2-881b137dac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:09.902145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9649172-a977-45b9-b0b2-881b137dac65 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:09.907467 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509458e-a3b0-46f8-a767-8b2aaa47869d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:09.908111 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509458e-a3b0-46f8-a767-8b2aaa47869d service swift] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:09.908406 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509458e-a3b0-46f8-a767-8b2aaa47869d service swift] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:09.908695 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509458e-a3b0-46f8-a767-8b2aaa47869d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:09.918928 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509458e-a3b0-46f8-a767-8b2aaa47869d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:09.921057 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509458e-a3b0-46f8-a767-8b2aaa47869d service swift] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:09.931630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1410/2831] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:39:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:39:19.777293 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=25 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:19.927258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=32 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:27.966074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252f913-6ab7-4670-ae76-c1b949002498 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:27.968267 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9252f913-6ab7-4670-ae76-c1b949002498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:28.050493 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252f913-6ab7-4670-ae76-c1b949002498 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:28.057247 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da606a28-c630-48d0-943d-89442b7afeb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2448489cc4ad1a6fd3096ebd3f746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:28.058109 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da606a28-c630-48d0-943d-89442b7afeb3 service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:28.058391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da606a28-c630-48d0-943d-89442b7afeb3 service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:28.059429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da606a28-c630-48d0-943d-89442b7afeb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:28.062385 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-da606a28-c630-48d0-943d-89442b7afeb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:28.078446 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da606a28-c630-48d0-943d-89442b7afeb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:28.080025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da606a28-c630-48d0-943d-89442b7afeb3 service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:28.091521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1422/2832] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:39:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:39:37.255906 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa507ef3-0d4e-494b-9503-f3459e8032cd None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:37.256351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa507ef3-0d4e-494b-9503-f3459e8032cd None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:37.256483 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa507ef3-0d4e-494b-9503-f3459e8032cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:37.276101 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-aa507ef3-0d4e-494b-9503-f3459e8032cd None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:37.277306 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-aa507ef3-0d4e-494b-9503-f3459e8032cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:37.285352 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1411/2833] 10.222.0.27 () {58 vars in 967 bytes} [Thu Aug 4 22:39:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:37.297658 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da606a28-c630-48d0-943d-89442b7afeb3 service placement] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:37.308796 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da606a28-c630-48d0-943d-89442b7afeb3 service placement] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:37.313947 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dade6fa-0f7d-432c-88a5-110acd5a94dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:37.314682 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dade6fa-0f7d-432c-88a5-110acd5a94dd service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:37.315051 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dade6fa-0f7d-432c-88a5-110acd5a94dd service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:37.315382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dade6fa-0f7d-432c-88a5-110acd5a94dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:37.323868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dade6fa-0f7d-432c-88a5-110acd5a94dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:37.325524 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dade6fa-0f7d-432c-88a5-110acd5a94dd service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:37.334890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1423/2834] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:39:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:39:39.222485 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa507ef3-0d4e-494b-9503-f3459e8032cd None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:39.223972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-aa507ef3-0d4e-494b-9503-f3459e8032cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:39.240012 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa507ef3-0d4e-494b-9503-f3459e8032cd None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:39.245136 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc3718-0595-48e3-9e4c-21f86102d5cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2448489cc4ad1a6fd3096ebd3f746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:39.245699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc3718-0595-48e3-9e4c-21f86102d5cc service placement] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:39.245987 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc3718-0595-48e3-9e4c-21f86102d5cc service placement] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:39.246267 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc3718-0595-48e3-9e4c-21f86102d5cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:39.248087 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-8adc3718-0595-48e3-9e4c-21f86102d5cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:39.262147 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc3718-0595-48e3-9e4c-21f86102d5cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:39.263911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc3718-0595-48e3-9e4c-21f86102d5cc service placement] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:39.277860 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1412/2835] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:39:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:39:39.279653 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dade6fa-0f7d-432c-88a5-110acd5a94dd service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:39.281489 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1dade6fa-0f7d-432c-88a5-110acd5a94dd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:39.298951 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dade6fa-0f7d-432c-88a5-110acd5a94dd service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:39.303793 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9e178-1cdd-44b4-9303-aeac50a192ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:39.304438 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9e178-1cdd-44b4-9303-aeac50a192ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:39.304720 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9e178-1cdd-44b4-9303-aeac50a192ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:39.304997 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9e178-1cdd-44b4-9303-aeac50a192ce admin admin] PATH_INFO: `/v3/users/41a0adc34c7645028ec506e9437b07f1` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:39.306189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9e178-1cdd-44b4-9303-aeac50a192ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a0adc34c7645028ec506e9437b07f1)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:39.308165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9e178-1cdd-44b4-9303-aeac50a192ce admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:39.356058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-40a9e178-1cdd-44b4-9303-aeac50a192ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a0adc34c7645028ec506e9437b07f1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:39.363743 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-40a9e178-1cdd-44b4-9303-aeac50a192ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a0adc34c7645028ec506e9437b07f1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:39.376392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-40a9e178-1cdd-44b4-9303-aeac50a192ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a0adc34c7645028ec506e9437b07f1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:39.377832 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-40a9e178-1cdd-44b4-9303-aeac50a192ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a0adc34c7645028ec506e9437b07f1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:39.385195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-40a9e178-1cdd-44b4-9303-aeac50a192ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a0adc34c7645028ec506e9437b07f1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:39.391882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1424/2836] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:39:39 2022] DELETE /identity/v3/users/41a0adc34c7645028ec506e9437b07f1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:39:39.587461 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc3718-0595-48e3-9e4c-21f86102d5cc service placement] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:39.610837 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc3718-0595-48e3-9e4c-21f86102d5cc service placement] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:39.668555 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be225b-f783-4d97-8550-19e20baf8810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:39.669206 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be225b-f783-4d97-8550-19e20baf8810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:39.669490 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be225b-f783-4d97-8550-19e20baf8810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:39.669768 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be225b-f783-4d97-8550-19e20baf8810 admin admin] PATH_INFO: `/v3/projects/d7a5cbade94b4e6f972efd3b12298fd8` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:39.670961 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be225b-f783-4d97-8550-19e20baf8810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a5cbade94b4e6f972efd3b12298fd8)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:39.673468 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be225b-f783-4d97-8550-19e20baf8810 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:39.718491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c6be225b-f783-4d97-8550-19e20baf8810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a5cbade94b4e6f972efd3b12298fd8', 'request_id': 'req-c6be225b-f783-4d97-8550-19e20baf8810'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:39.726007 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c6be225b-f783-4d97-8550-19e20baf8810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a5cbade94b4e6f972efd3b12298fd8', 'request_id': 'req-c6be225b-f783-4d97-8550-19e20baf8810'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:39.731746 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c6be225b-f783-4d97-8550-19e20baf8810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a5cbade94b4e6f972efd3b12298fd8', 'request_id': 'req-c6be225b-f783-4d97-8550-19e20baf8810'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:39.743506 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c6be225b-f783-4d97-8550-19e20baf8810 admin admin] The token cache is being invalidate because project d7a5cbade94b4e6f972efd3b12298fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:39:39.743735 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c6be225b-f783-4d97-8550-19e20baf8810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:39.744376 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-c6be225b-f783-4d97-8550-19e20baf8810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:39.745880 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1413/2837] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:39:39 2022] DELETE /identity/v3/projects/d7a5cbade94b4e6f972efd3b12298fd8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:39:39.750715 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c7ccc-419d-4e57-9026-604d8e3cf93a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:39.751023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c7ccc-419d-4e57-9026-604d8e3cf93a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:39.751301 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c7ccc-419d-4e57-9026-604d8e3cf93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:39.771341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-df7c7ccc-419d-4e57-9026-604d8e3cf93a None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:39.773074 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-df7c7ccc-419d-4e57-9026-604d8e3cf93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:39.818775 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:39.836942 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1425/2838] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:39.845178 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3430-fca1-498a-aadc-53752784ba6b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:39.845481 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3430-fca1-498a-aadc-53752784ba6b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:39.845738 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e3430-fca1-498a-aadc-53752784ba6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:39.866076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-b64e3430-fca1-498a-aadc-53752784ba6b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:39.867384 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b64e3430-fca1-498a-aadc-53752784ba6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:39.876738 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1414/2839] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:39.880817 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c7ccc-419d-4e57-9026-604d8e3cf93a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:39.890342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c7ccc-419d-4e57-9026-604d8e3cf93a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:39.895155 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44903cba-1cda-495b-8436-e1434fe7e33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:39.895677 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903cba-1cda-495b-8436-e1434fe7e33e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:39.895949 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903cba-1cda-495b-8436-e1434fe7e33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:39.896229 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903cba-1cda-495b-8436-e1434fe7e33e admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:39.896919 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44903cba-1cda-495b-8436-e1434fe7e33e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:39:39.897225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44903cba-1cda-495b-8436-e1434fe7e33e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:39.898854 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44903cba-1cda-495b-8436-e1434fe7e33e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:39.911121 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1426/2840] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:39:39.916314 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e3430-fca1-498a-aadc-53752784ba6b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:39.926812 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e3430-fca1-498a-aadc-53752784ba6b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:39.931479 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b5d62-f034-4b7d-a994-156b578f0a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:39.932091 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5d62-f034-4b7d-a994-156b578f0a21 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:39.932373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5d62-f034-4b7d-a994-156b578f0a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:39.932647 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5d62-f034-4b7d-a994-156b578f0a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:39.933308 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b5d62-f034-4b7d-a994-156b578f0a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:39.935260 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b5d62-f034-4b7d-a994-156b578f0a21 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:39.967076 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1415/2841] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:39:39 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:39:39.971837 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44903cba-1cda-495b-8436-e1434fe7e33e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:39.983907 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44903cba-1cda-495b-8436-e1434fe7e33e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:40.053609 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733336cb-ad7a-4194-8eb6-299bb164151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:40.054046 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733336cb-ad7a-4194-8eb6-299bb164151e admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:40.054432 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733336cb-ad7a-4194-8eb6-299bb164151e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:40.054781 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733336cb-ad7a-4194-8eb6-299bb164151e admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:40.055527 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733336cb-ad7a-4194-8eb6-299bb164151e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:40.057506 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733336cb-ad7a-4194-8eb6-299bb164151e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:40.079969 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1427/2842] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:39:39 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:39:40.084754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b5d62-f034-4b7d-a994-156b578f0a21 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:40.098754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b5d62-f034-4b7d-a994-156b578f0a21 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:40.103374 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab46d40-fc0c-4887-bc95-035e3906424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:40.104041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab46d40-fc0c-4887-bc95-035e3906424f admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:40.104324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab46d40-fc0c-4887-bc95-035e3906424f admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:40.104598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab46d40-fc0c-4887-bc95-035e3906424f admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:40.105307 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab46d40-fc0c-4887-bc95-035e3906424f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:40.106941 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab46d40-fc0c-4887-bc95-035e3906424f admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:40.117005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1416/2843] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:39:40.121004 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733336cb-ad7a-4194-8eb6-299bb164151e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:40.131271 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733336cb-ad7a-4194-8eb6-299bb164151e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:40.135865 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b993b03-58fe-49b6-97cc-b980697f0553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:40.136471 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b993b03-58fe-49b6-97cc-b980697f0553 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:40.136751 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b993b03-58fe-49b6-97cc-b980697f0553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:40.137023 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b993b03-58fe-49b6-97cc-b980697f0553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:40.137708 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b993b03-58fe-49b6-97cc-b980697f0553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:40.139327 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b993b03-58fe-49b6-97cc-b980697f0553 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:40.150843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1428/2844] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:39:40.154982 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab46d40-fc0c-4887-bc95-035e3906424f admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:40.165605 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab46d40-fc0c-4887-bc95-035e3906424f admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:40.170945 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3f68c-1cdd-4809-977e-0a49157317d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:40.171637 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3f68c-1cdd-4809-977e-0a49157317d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:40.171917 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3f68c-1cdd-4809-977e-0a49157317d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:40.172216 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3f68c-1cdd-4809-977e-0a49157317d9 admin admin] PATH_INFO: `/v3/projects/6e5772fb4fa6444285d15042b4a45154/users/63989ad3e00d4ff5a362984fffd72f51/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:40.190044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3f68c-1cdd-4809-977e-0a49157317d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5772fb4fa6444285d15042b4a45154, user_id=63989ad3e00d4ff5a362984fffd72f51, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:40.192704 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d3f68c-1cdd-4809-977e-0a49157317d9 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:40.205452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1417/2845] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:39:40 2022] PUT /identity/v3/projects/6e5772fb4fa6444285d15042b4a45154/users/63989ad3e00d4ff5a362984fffd72f51/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:39:40.215381 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f28ca-9014-4bc7-861f-063a699efbec None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:40.215932 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f28ca-9014-4bc7-861f-063a699efbec None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:40.216207 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f28ca-9014-4bc7-861f-063a699efbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:40.244903 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b90f28ca-9014-4bc7-861f-063a699efbec None None] MFA Rules not processed for user `63989ad3e00d4ff5a362984fffd72f51`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:40.246101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b90f28ca-9014-4bc7-861f-063a699efbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:40.308661 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1429/2846] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:39:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:40.320102 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3f68c-1cdd-4809-977e-0a49157317d9 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:40.321824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f5d3f68c-1cdd-4809-977e-0a49157317d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:40.332255 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:40.381616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d3f68c-1cdd-4809-977e-0a49157317d9 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:40.385268 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d4af5-0ae7-4ec8-91c0-d4b8549494e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:40.385884 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d4af5-0ae7-4ec8-91c0-d4b8549494e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:40.386169 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d4af5-0ae7-4ec8-91c0-d4b8549494e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:40.386476 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d4af5-0ae7-4ec8-91c0-d4b8549494e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:40.395315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d4af5-0ae7-4ec8-91c0-d4b8549494e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:40.396727 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d4af5-0ae7-4ec8-91c0-d4b8549494e9 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:40.405424 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1418/2847] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:39:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:39:40.447960 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19176220-6256-4905-8054-14b8b64648f3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:40.448259 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19176220-6256-4905-8054-14b8b64648f3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:40.448529 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19176220-6256-4905-8054-14b8b64648f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:40.472002 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-19176220-6256-4905-8054-14b8b64648f3 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:40.473223 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-19176220-6256-4905-8054-14b8b64648f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:40.514193 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:40.533882 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1430/2848] 10.222.0.110 () {58 vars in 1017 bytes} [Thu Aug 4 22:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:40.565685 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d4af5-0ae7-4ec8-91c0-d4b8549494e9 service cinder] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:40.567470 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-160d4af5-0ae7-4ec8-91c0-d4b8549494e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:40.651743 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d4af5-0ae7-4ec8-91c0-d4b8549494e9 service cinder] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:40.658929 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86eb7ea-1025-48d7-b59c-2aba47e8a5b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:40.659576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb7ea-1025-48d7-b59c-2aba47e8a5b7 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:40.659871 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb7ea-1025-48d7-b59c-2aba47e8a5b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:40.660148 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86eb7ea-1025-48d7-b59c-2aba47e8a5b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:40.669545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eb7ea-1025-48d7-b59c-2aba47e8a5b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:40.671250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86eb7ea-1025-48d7-b59c-2aba47e8a5b7 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:40.681249 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1419/2849] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:39:44.014497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19176220-6256-4905-8054-14b8b64648f3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:44.025143 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19176220-6256-4905-8054-14b8b64648f3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:44.030189 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe6ef0-d9a9-4604-aff7-540de51490b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:44.030799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe6ef0-d9a9-4604-aff7-540de51490b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:44.031079 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe6ef0-d9a9-4604-aff7-540de51490b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:44.031355 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe6ef0-d9a9-4604-aff7-540de51490b8 admin admin] PATH_INFO: `/v3/users/63989ad3e00d4ff5a362984fffd72f51` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:44.032539 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe6ef0-d9a9-4604-aff7-540de51490b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63989ad3e00d4ff5a362984fffd72f51)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:44.034545 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe6ef0-d9a9-4604-aff7-540de51490b8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:44.087707 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbfe6ef0-d9a9-4604-aff7-540de51490b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63989ad3e00d4ff5a362984fffd72f51'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:44.096110 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbfe6ef0-d9a9-4604-aff7-540de51490b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63989ad3e00d4ff5a362984fffd72f51'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:44.108079 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbfe6ef0-d9a9-4604-aff7-540de51490b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63989ad3e00d4ff5a362984fffd72f51'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:44.108717 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbfe6ef0-d9a9-4604-aff7-540de51490b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63989ad3e00d4ff5a362984fffd72f51'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:44.116172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dbfe6ef0-d9a9-4604-aff7-540de51490b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63989ad3e00d4ff5a362984fffd72f51'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:44.121927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1431/2850] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:39:44 2022] DELETE /identity/v3/users/63989ad3e00d4ff5a362984fffd72f51 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:39:44.126452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f67fd-f522-4468-b466-7d41d10ce94f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:44.126948 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f67fd-f522-4468-b466-7d41d10ce94f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:44.127048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f67fd-f522-4468-b466-7d41d10ce94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:44.145346 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-f25f67fd-f522-4468-b466-7d41d10ce94f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:44.146586 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-f25f67fd-f522-4468-b466-7d41d10ce94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:44.207391 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1420/2851] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:44.217391 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe6ef0-d9a9-4604-aff7-540de51490b8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:44.219426 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dbfe6ef0-d9a9-4604-aff7-540de51490b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:44.298172 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe6ef0-d9a9-4604-aff7-540de51490b8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:44.302620 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f76575-3a29-4e61-8661-1b78bdbe9eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:44.303249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f76575-3a29-4e61-8661-1b78bdbe9eff service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:44.303544 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f76575-3a29-4e61-8661-1b78bdbe9eff service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:44.303809 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f76575-3a29-4e61-8661-1b78bdbe9eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:44.316662 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f76575-3a29-4e61-8661-1b78bdbe9eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:44.318581 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f76575-3a29-4e61-8661-1b78bdbe9eff service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:44.330871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1432/2852] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:39:44.527137 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853c84-5e79-478b-a943-75887d53fabb None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:44.527450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853c84-5e79-478b-a943-75887d53fabb None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:44.527774 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d853c84-5e79-478b-a943-75887d53fabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:44.551996 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-4d853c84-5e79-478b-a943-75887d53fabb None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:44.553178 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4d853c84-5e79-478b-a943-75887d53fabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:44.561395 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1421/2853] 10.222.0.110 () {58 vars in 1017 bytes} [Thu Aug 4 22:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:44.586614 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f76575-3a29-4e61-8661-1b78bdbe9eff service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:44.588062 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f4f76575-3a29-4e61-8661-1b78bdbe9eff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:44.640203 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d853c84-5e79-478b-a943-75887d53fabb None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:44.642384 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-4d853c84-5e79-478b-a943-75887d53fabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:44.654968 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:44.658580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d853c84-5e79-478b-a943-75887d53fabb None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:44.663450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:44.664142 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:44.664426 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:44.664702 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d admin admin] PATH_INFO: `/v3/projects/6e5772fb4fa6444285d15042b4a45154` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:44.665904 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5772fb4fa6444285d15042b4a45154)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:44.669075 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:44.689109 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f76575-3a29-4e61-8661-1b78bdbe9eff service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:44.698859 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5d93b-5a06-4882-9fd8-d0aae5497353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:44.699486 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5d93b-5a06-4882-9fd8-d0aae5497353 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:44.699854 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5d93b-5a06-4882-9fd8-d0aae5497353 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:44.700124 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5d93b-5a06-4882-9fd8-d0aae5497353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:44.708233 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:44.711619 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5d93b-5a06-4882-9fd8-d0aae5497353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:44.713558 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5d93b-5a06-4882-9fd8-d0aae5497353 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:44.724844 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1433/2854] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:39:44.736240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5772fb4fa6444285d15042b4a45154', 'request_id': 'req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:44.744800 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5772fb4fa6444285d15042b4a45154', 'request_id': 'req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:44.750953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5772fb4fa6444285d15042b4a45154', 'request_id': 'req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:44.763519 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d admin admin] The token cache is being invalidate because project 6e5772fb4fa6444285d15042b4a45154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:39:44.763814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:44.764491 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f2ae2c0b-9c49-4d9b-a4d7-dde3736e3c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:39:44.766665 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1422/2855] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:39:44 2022] DELETE /identity/v3/projects/6e5772fb4fa6444285d15042b4a45154 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:39:44.771985 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a26a7c-1851-4f62-afc6-637d8716a2f3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:44.772341 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a26a7c-1851-4f62-afc6-637d8716a2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:44.772686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a26a7c-1851-4f62-afc6-637d8716a2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:44.794773 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b7a26a7c-1851-4f62-afc6-637d8716a2f3 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:44.796115 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b7a26a7c-1851-4f62-afc6-637d8716a2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:44.867675 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1434/2856] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:44.878218 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c3432-b2fa-4794-96ff-1489da1a34b6 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:44.878545 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c3432-b2fa-4794-96ff-1489da1a34b6 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:44.878830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c3432-b2fa-4794-96ff-1489da1a34b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:44.900353 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-617c3432-b2fa-4794-96ff-1489da1a34b6 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:44.901568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-617c3432-b2fa-4794-96ff-1489da1a34b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:44.910354 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1423/2857] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:44.915206 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a26a7c-1851-4f62-afc6-637d8716a2f3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:44.925487 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a26a7c-1851-4f62-afc6-637d8716a2f3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:44.930376 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83465905-229e-4aa4-9697-1700d7befcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:44.931048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83465905-229e-4aa4-9697-1700d7befcfb admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:44.931382 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83465905-229e-4aa4-9697-1700d7befcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:44.931670 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83465905-229e-4aa4-9697-1700d7befcfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:44.932880 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83465905-229e-4aa4-9697-1700d7befcfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:39:44.933412 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83465905-229e-4aa4-9697-1700d7befcfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:44.935063 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83465905-229e-4aa4-9697-1700d7befcfb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:44.948348 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1435/2858] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:39:44.952701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c3432-b2fa-4794-96ff-1489da1a34b6 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:44.963337 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c3432-b2fa-4794-96ff-1489da1a34b6 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:44.968351 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5db88-5f00-4fc4-981d-3a543a020810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:44.969041 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5db88-5f00-4fc4-981d-3a543a020810 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:44.969324 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5db88-5f00-4fc4-981d-3a543a020810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:44.969601 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5db88-5f00-4fc4-981d-3a543a020810 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:44.970277 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5db88-5f00-4fc4-981d-3a543a020810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:44.972421 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5db88-5f00-4fc4-981d-3a543a020810 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:45.007356 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1424/2859] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:39:44 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:39:45.011669 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83465905-229e-4aa4-9697-1700d7befcfb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:45.022597 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83465905-229e-4aa4-9697-1700d7befcfb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:45.083798 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439371ac-0da9-45e8-abed-0bb853c44b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:45.084478 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439371ac-0da9-45e8-abed-0bb853c44b1c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:45.084761 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439371ac-0da9-45e8-abed-0bb853c44b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:45.085037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439371ac-0da9-45e8-abed-0bb853c44b1c admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:45.085702 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439371ac-0da9-45e8-abed-0bb853c44b1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:45.087641 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439371ac-0da9-45e8-abed-0bb853c44b1c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:45.110995 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1436/2860] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:39:45 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:39:45.115103 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5db88-5f00-4fc4-981d-3a543a020810 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:45.127178 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5db88-5f00-4fc4-981d-3a543a020810 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:45.135584 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb9546-6386-4c8c-81b5-1770343e2e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:45.136209 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb9546-6386-4c8c-81b5-1770343e2e2b admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:45.136492 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb9546-6386-4c8c-81b5-1770343e2e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:45.136770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb9546-6386-4c8c-81b5-1770343e2e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:45.137466 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb9546-6386-4c8c-81b5-1770343e2e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:45.139158 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb9546-6386-4c8c-81b5-1770343e2e2b admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:45.156257 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1425/2861] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:39:45.157331 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439371ac-0da9-45e8-abed-0bb853c44b1c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:45.168058 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439371ac-0da9-45e8-abed-0bb853c44b1c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:45.172931 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d4c98-d60a-4082-9a45-b4992fc40043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:45.173545 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d4c98-d60a-4082-9a45-b4992fc40043 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:45.173829 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d4c98-d60a-4082-9a45-b4992fc40043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:45.174103 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d4c98-d60a-4082-9a45-b4992fc40043 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:45.174850 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d4c98-d60a-4082-9a45-b4992fc40043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:45.176444 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d4c98-d60a-4082-9a45-b4992fc40043 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:45.188086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1437/2862] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:39:45.192502 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb9546-6386-4c8c-81b5-1770343e2e2b admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:45.202631 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb9546-6386-4c8c-81b5-1770343e2e2b admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:45.208922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fd56a-c760-4b96-b1ae-fe26b9a60f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:45.209594 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fd56a-c760-4b96-b1ae-fe26b9a60f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:45.209877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fd56a-c760-4b96-b1ae-fe26b9a60f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:45.210153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fd56a-c760-4b96-b1ae-fe26b9a60f72 admin admin] PATH_INFO: `/v3/projects/897872752f7c4ec5a275c7c7b916b8c8/users/cab51dd37f0e4c649b2b2126fe3bdda1/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:45.229828 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fd56a-c760-4b96-b1ae-fe26b9a60f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=897872752f7c4ec5a275c7c7b916b8c8, user_id=cab51dd37f0e4c649b2b2126fe3bdda1, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:45.232516 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fd56a-c760-4b96-b1ae-fe26b9a60f72 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:45.245962 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1426/2863] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:39:45 2022] PUT /identity/v3/projects/897872752f7c4ec5a275c7c7b916b8c8/users/cab51dd37f0e4c649b2b2126fe3bdda1/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:39:45.251085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2b931-baf1-42c4-bd1b-b9d9b58ebfc2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:45.251375 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2b931-baf1-42c4-bd1b-b9d9b58ebfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:45.251651 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2b931-baf1-42c4-bd1b-b9d9b58ebfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:45.271194 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5cd2b931-baf1-42c4-bd1b-b9d9b58ebfc2 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:45.272535 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5cd2b931-baf1-42c4-bd1b-b9d9b58ebfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:45.322872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:45.338445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1438/2864] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:45.348284 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fd56a-c760-4b96-b1ae-fe26b9a60f72 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:45.349967 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2c9fd56a-c760-4b96-b1ae-fe26b9a60f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:45.407830 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fd56a-c760-4b96-b1ae-fe26b9a60f72 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:45.411436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802de18c-2031-424b-aba8-a91a98fcd556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:45.412054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802de18c-2031-424b-aba8-a91a98fcd556 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:45.412335 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802de18c-2031-424b-aba8-a91a98fcd556 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:45.412610 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802de18c-2031-424b-aba8-a91a98fcd556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:45.421450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802de18c-2031-424b-aba8-a91a98fcd556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:45.423436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802de18c-2031-424b-aba8-a91a98fcd556 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:45.432766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1427/2865] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:39:48.934633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66e685-8cf4-4fff-847a-85ef02e40af4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:48.935152 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66e685-8cf4-4fff-847a-85ef02e40af4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:48.935284 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66e685-8cf4-4fff-847a-85ef02e40af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:48.958905 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-fd66e685-8cf4-4fff-847a-85ef02e40af4 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:48.960856 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fd66e685-8cf4-4fff-847a-85ef02e40af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:48.977892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1439/2866] 10.222.0.110 () {58 vars in 1017 bytes} [Thu Aug 4 22:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:48.998321 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802de18c-2031-424b-aba8-a91a98fcd556 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:49.001488 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-802de18c-2031-424b-aba8-a91a98fcd556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:49.097559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:49.123124 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802de18c-2031-424b-aba8-a91a98fcd556 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:49.130333 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fceb6b-ca51-4629-96ef-565710d78a9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:49.131139 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fceb6b-ca51-4629-96ef-565710d78a9a service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:49.131542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fceb6b-ca51-4629-96ef-565710d78a9a service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:49.131893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fceb6b-ca51-4629-96ef-565710d78a9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:49.143005 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fceb6b-ca51-4629-96ef-565710d78a9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:49.144620 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fceb6b-ca51-4629-96ef-565710d78a9a service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:49.155737 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1428/2867] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:39:49.538168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa540c-ee74-4113-a8bd-75b4c727ea2a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:49.538497 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa540c-ee74-4113-a8bd-75b4c727ea2a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:49.538796 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa540c-ee74-4113-a8bd-75b4c727ea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:49.569498 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f7aa540c-ee74-4113-a8bd-75b4c727ea2a None None] MFA Rules not processed for user `cab51dd37f0e4c649b2b2126fe3bdda1`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:49.570779 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f7aa540c-ee74-4113-a8bd-75b4c727ea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:49.651273 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1440/2868] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:39:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:49.655810 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fceb6b-ca51-4629-96ef-565710d78a9a service nova] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:49.666266 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fceb6b-ca51-4629-96ef-565710d78a9a service nova] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:49.671192 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac75f70-b2e6-4efa-a598-eb9c0e2ef93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:49.671953 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac75f70-b2e6-4efa-a598-eb9c0e2ef93c admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:49.672294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac75f70-b2e6-4efa-a598-eb9c0e2ef93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:49.672641 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac75f70-b2e6-4efa-a598-eb9c0e2ef93c admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:49.673384 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac75f70-b2e6-4efa-a598-eb9c0e2ef93c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:49.675422 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac75f70-b2e6-4efa-a598-eb9c0e2ef93c admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:49.704582 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1429/2869] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:39:49 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 04 22:39:49.708687 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa540c-ee74-4113-a8bd-75b4c727ea2a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:49.723193 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa540c-ee74-4113-a8bd-75b4c727ea2a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:49.793983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d35db0-ca85-41af-846c-5f611447bd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:49.794647 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d35db0-ca85-41af-846c-5f611447bd30 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:49.794934 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d35db0-ca85-41af-846c-5f611447bd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:49.795213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d35db0-ca85-41af-846c-5f611447bd30 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:49.795980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d35db0-ca85-41af-846c-5f611447bd30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:49.797936 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d35db0-ca85-41af-846c-5f611447bd30 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:49.820000 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1441/2870] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:39:49 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:39:49.823795 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac75f70-b2e6-4efa-a598-eb9c0e2ef93c admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:49.834686 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac75f70-b2e6-4efa-a598-eb9c0e2ef93c admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:49.839515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7da754-7e77-451f-830b-d27e937d1614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:49.840139 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7da754-7e77-451f-830b-d27e937d1614 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:49.840422 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7da754-7e77-451f-830b-d27e937d1614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:49.841066 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7da754-7e77-451f-830b-d27e937d1614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:49.841766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7da754-7e77-451f-830b-d27e937d1614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:49.843949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7da754-7e77-451f-830b-d27e937d1614 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:49.854890 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1430/2871] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:39:49.859061 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d35db0-ca85-41af-846c-5f611447bd30 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:49.869102 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d35db0-ca85-41af-846c-5f611447bd30 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:49.873983 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86335c05-14b3-42c5-ae4b-49f9292cc5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:49.875279 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86335c05-14b3-42c5-ae4b-49f9292cc5ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:49.875557 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86335c05-14b3-42c5-ae4b-49f9292cc5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:49.875830 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86335c05-14b3-42c5-ae4b-49f9292cc5ee admin admin] PATH_INFO: `/v3/projects/12abec5893144ab680076645bfc6dc04/users/1e6c848070924c5d80e7b48a83865d74/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:49.892008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86335c05-14b3-42c5-ae4b-49f9292cc5ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=12abec5893144ab680076645bfc6dc04, user_id=1e6c848070924c5d80e7b48a83865d74, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:49.894614 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86335c05-14b3-42c5-ae4b-49f9292cc5ee admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:49.908085 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1442/2872] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:39:49 2022] PUT /identity/v3/projects/12abec5893144ab680076645bfc6dc04/users/1e6c848070924c5d80e7b48a83865d74/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:39:49.912380 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7da754-7e77-451f-830b-d27e937d1614 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:49.922699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7da754-7e77-451f-830b-d27e937d1614 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:49.986065 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6bea9-e429-4163-8c4b-f9da5e102936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:49.986731 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6bea9-e429-4163-8c4b-f9da5e102936 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:49.987016 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6bea9-e429-4163-8c4b-f9da5e102936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:49.987294 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6bea9-e429-4163-8c4b-f9da5e102936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:49.987986 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6bea9-e429-4163-8c4b-f9da5e102936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:49.989568 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6bea9-e429-4163-8c4b-f9da5e102936 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:50.000359 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1431/2873] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:39:50.004593 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86335c05-14b3-42c5-ae4b-49f9292cc5ee admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:50.016434 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86335c05-14b3-42c5-ae4b-49f9292cc5ee admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:50.022577 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c97d-0bfa-4b9c-b24d-3d32f41b9b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:50.023631 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c97d-0bfa-4b9c-b24d-3d32f41b9b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:50.023912 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c97d-0bfa-4b9c-b24d-3d32f41b9b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:50.024383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c97d-0bfa-4b9c-b24d-3d32f41b9b83 admin admin] PATH_INFO: `/v3/projects/12abec5893144ab680076645bfc6dc04/users/1e6c848070924c5d80e7b48a83865d74/roles/0053c24ce06147938dbb61657a531c94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:50.026601 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9c97d-0bfa-4b9c-b24d-3d32f41b9b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12abec5893144ab680076645bfc6dc04, user_id=1e6c848070924c5d80e7b48a83865d74, role_id=0053c24ce06147938dbb61657a531c94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:50.029452 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9c97d-0bfa-4b9c-b24d-3d32f41b9b83 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:50.041505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1443/2874] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:39:50 2022] PUT /identity/v3/projects/12abec5893144ab680076645bfc6dc04/users/1e6c848070924c5d80e7b48a83865d74/roles/0053c24ce06147938dbb61657a531c94 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:39:53.057758 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abaa3e-803d-44c3-8fa8-8a3c53ccb43c None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:53.058191 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abaa3e-803d-44c3-8fa8-8a3c53ccb43c None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:53.058474 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abaa3e-803d-44c3-8fa8-8a3c53ccb43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:53.090716 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-a4abaa3e-803d-44c3-8fa8-8a3c53ccb43c None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:53.092694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-a4abaa3e-803d-44c3-8fa8-8a3c53ccb43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:53.197588 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1432/2875] 10.222.0.110 () {58 vars in 1017 bytes} [Thu Aug 4 22:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:53.232430 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c97d-0bfa-4b9c-b24d-3d32f41b9b83 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:53.235516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-69f9c97d-0bfa-4b9c-b24d-3d32f41b9b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:53.294170 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:53.367300 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c97d-0bfa-4b9c-b24d-3d32f41b9b83 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:53.386006 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad4474-46de-4cab-ae82-e97f7c4c3f78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:53.386770 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad4474-46de-4cab-ae82-e97f7c4c3f78 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:53.387060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad4474-46de-4cab-ae82-e97f7c4c3f78 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:53.387429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad4474-46de-4cab-ae82-e97f7c4c3f78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:53.407300 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad4474-46de-4cab-ae82-e97f7c4c3f78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:53.409693 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad4474-46de-4cab-ae82-e97f7c4c3f78 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:53.446921 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1444/2876] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:39:54.679608 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c4e4d-0f6f-4d50-b370-028cbc9bfca6 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:54.680129 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c4e4d-0f6f-4d50-b370-028cbc9bfca6 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:54.680230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c4e4d-0f6f-4d50-b370-028cbc9bfca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:54.713654 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-854c4e4d-0f6f-4d50-b370-028cbc9bfca6 None None] MFA Rules not processed for user `1e6c848070924c5d80e7b48a83865d74`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:54.714935 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-854c4e4d-0f6f-4d50-b370-028cbc9bfca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:54.748137 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:54.788244 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1433/2877] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:39:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:54.800888 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad4474-46de-4cab-ae82-e97f7c4c3f78 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:54.802454 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-10ad4474-46de-4cab-ae82-e97f7c4c3f78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:54.891787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad4474-46de-4cab-ae82-e97f7c4c3f78 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:54.895415 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979c4ff-ff35-4327-927e-1f590fddefcb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce7db16c4904fb1b75ac7910f4470f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:54.896026 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979c4ff-ff35-4327-927e-1f590fddefcb service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:54.896298 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979c4ff-ff35-4327-927e-1f590fddefcb service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:54.896570 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979c4ff-ff35-4327-927e-1f590fddefcb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:54.954735 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979c4ff-ff35-4327-927e-1f590fddefcb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:54.956176 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979c4ff-ff35-4327-927e-1f590fddefcb service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:54.964955 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1445/2878] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:39:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:39:55.088344 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ae3ec-168a-4209-b3e9-e14431ed14c2 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:55.088651 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ae3ec-168a-4209-b3e9-e14431ed14c2 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:55.088919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ae3ec-168a-4209-b3e9-e14431ed14c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:55.108567 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-1b9ae3ec-168a-4209-b3e9-e14431ed14c2 None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:55.110625 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-1b9ae3ec-168a-4209-b3e9-e14431ed14c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:55.172378 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1434/2879] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:39:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:55.184397 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979c4ff-ff35-4327-927e-1f590fddefcb service glance] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:55.185775 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4979c4ff-ff35-4327-927e-1f590fddefcb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:55.234006 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:39:55.255566 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979c4ff-ff35-4327-927e-1f590fddefcb service glance] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:55.260512 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b5d79-fd4a-4be8-a363-e137d4409d04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:55.261120 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b5d79-fd4a-4be8-a363-e137d4409d04 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:55.261403 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b5d79-fd4a-4be8-a363-e137d4409d04 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:55.261703 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b5d79-fd4a-4be8-a363-e137d4409d04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:55.269886 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b5d79-fd4a-4be8-a363-e137d4409d04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:55.271488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b5d79-fd4a-4be8-a363-e137d4409d04 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:55.281487 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1446/2880] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:39:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:39:57.366014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a598abf-c04f-450c-8c77-137b11bb2215 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:57.367038 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a598abf-c04f-450c-8c77-137b11bb2215 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:57.367401 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a598abf-c04f-450c-8c77-137b11bb2215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:57.397565 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-0a598abf-c04f-450c-8c77-137b11bb2215 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:39:57.399024 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-0a598abf-c04f-450c-8c77-137b11bb2215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:39:57.407959 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1435/2881] 10.222.0.110 () {58 vars in 1017 bytes} [Thu Aug 4 22:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:39:57.437980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b5d79-fd4a-4be8-a363-e137d4409d04 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:39:57.460081 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b5d79-fd4a-4be8-a363-e137d4409d04 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:39:57.472396 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c823dc2-bd39-4e1e-8f9c-20bf89fc1b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:39:57.473037 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c823dc2-bd39-4e1e-8f9c-20bf89fc1b2d service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:39:57.473317 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c823dc2-bd39-4e1e-8f9c-20bf89fc1b2d service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:39:57.473591 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c823dc2-bd39-4e1e-8f9c-20bf89fc1b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:39:57.482876 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c823dc2-bd39-4e1e-8f9c-20bf89fc1b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:39:57.484704 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c823dc2-bd39-4e1e-8f9c-20bf89fc1b2d service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:39:57.499049 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1447/2882] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:40:01.583905 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4a2f6-6501-4557-af8c-02790512887f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:40:01.584450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4a2f6-6501-4557-af8c-02790512887f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:40:01.584450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4a2f6-6501-4557-af8c-02790512887f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:40:01.606526 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-97d4a2f6-6501-4557-af8c-02790512887f None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:40:01.607857 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-97d4a2f6-6501-4557-af8c-02790512887f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:40:01.619020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1436/2883] 10.222.0.110 () {58 vars in 1017 bytes} [Thu Aug 4 22:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:40:01.661364 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c823dc2-bd39-4e1e-8f9c-20bf89fc1b2d service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:40:01.673554 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c823dc2-bd39-4e1e-8f9c-20bf89fc1b2d service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:40:01.679345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7af6d-9621-45a5-8e6c-92d910b69b3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:40:01.680094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7af6d-9621-45a5-8e6c-92d910b69b3a service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:40:01.680458 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7af6d-9621-45a5-8e6c-92d910b69b3a service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:40:01.680872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7af6d-9621-45a5-8e6c-92d910b69b3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:40:01.697974 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7af6d-9621-45a5-8e6c-92d910b69b3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:40:01.699996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7af6d-9621-45a5-8e6c-92d910b69b3a service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:40:01.714039 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1448/2884] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:40:03.836606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd29bc7-4b79-4f22-aa08-862c584a22e5 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:40:03.837146 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd29bc7-4b79-4f22-aa08-862c584a22e5 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:40:03.837146 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd29bc7-4b79-4f22-aa08-862c584a22e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:40:03.855824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-fbd29bc7-4b79-4f22-aa08-862c584a22e5 None None] MFA Rules not processed for user `cab51dd37f0e4c649b2b2126fe3bdda1`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:40:03.857000 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-fbd29bc7-4b79-4f22-aa08-862c584a22e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:40:03.864204 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1437/2885] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:40:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:40:06.036586 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e60121-5c4a-49a6-8ed5-769e0038fdab None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:40:06.037067 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e60121-5c4a-49a6-8ed5-769e0038fdab None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:40:06.037178 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e60121-5c4a-49a6-8ed5-769e0038fdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:40:06.058644 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-80e60121-5c4a-49a6-8ed5-769e0038fdab None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:40:06.059961 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-80e60121-5c4a-49a6-8ed5-769e0038fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:40:06.068249 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1449/2886] 10.222.0.27 () {58 vars in 1009 bytes} [Thu Aug 4 22:40:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:40:06.083298 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd29bc7-4b79-4f22-aa08-862c584a22e5 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:40:06.097576 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd29bc7-4b79-4f22-aa08-862c584a22e5 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:40:06.102824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6e0f1-03ab-4237-ad6b-24b6f478f4f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:40:06.103459 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6e0f1-03ab-4237-ad6b-24b6f478f4f3 service swift] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:40:06.103744 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6e0f1-03ab-4237-ad6b-24b6f478f4f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:40:06.104020 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc6e0f1-03ab-4237-ad6b-24b6f478f4f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:40:06.113772 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6e0f1-03ab-4237-ad6b-24b6f478f4f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:40:06.115416 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc6e0f1-03ab-4237-ad6b-24b6f478f4f3 service swift] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:40:06.125313 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1438/2887] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:40:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:40:16.052870 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=26 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:40:16.121580 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=56 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:40:40.594131 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe0047-d234-40a3-9d3b-939e8c019319 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:40:40.594730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe0047-d234-40a3-9d3b-939e8c019319 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:40:40.594730 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe0047-d234-40a3-9d3b-939e8c019319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:40:40.621871 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-86fe0047-d234-40a3-9d3b-939e8c019319 None None] MFA Rules not processed for user `d8832832650b49588d4994a74347dcb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:40:40.623278 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-86fe0047-d234-40a3-9d3b-939e8c019319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:40:40.689807 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1450/2888] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:40:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:40:40.729924 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6e0f1-03ab-4237-ad6b-24b6f478f4f3 service swift] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:40:40.739217 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc6e0f1-03ab-4237-ad6b-24b6f478f4f3 service swift] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:40:40.742773 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee91d23-45a6-4765-8a74-0e788fb41062 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce7db16c4904fb1b75ac7910f4470f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:40:40.743373 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee91d23-45a6-4765-8a74-0e788fb41062 service glance] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:40:40.743656 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee91d23-45a6-4765-8a74-0e788fb41062 service glance] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:40:40.743922 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee91d23-45a6-4765-8a74-0e788fb41062 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:40:40.745617 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-5ee91d23-45a6-4765-8a74-0e788fb41062 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:40:40.759048 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee91d23-45a6-4765-8a74-0e788fb41062 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:40:40.760450 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee91d23-45a6-4765-8a74-0e788fb41062 service glance] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:40:40.771959 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1439/2889] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:40:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:40:41.281265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe0047-d234-40a3-9d3b-939e8c019319 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:40:41.283055 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-86fe0047-d234-40a3-9d3b-939e8c019319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:40:41.350567 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe0047-d234-40a3-9d3b-939e8c019319 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:40:41.354982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c686ab2-d637-42fa-a1f1-1a01a4ce81bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:40:41.355599 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c686ab2-d637-42fa-a1f1-1a01a4ce81bb service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:40:41.355878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c686ab2-d637-42fa-a1f1-1a01a4ce81bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:40:41.356151 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c686ab2-d637-42fa-a1f1-1a01a4ce81bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:40:41.365551 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c686ab2-d637-42fa-a1f1-1a01a4ce81bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:40:41.367025 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c686ab2-d637-42fa-a1f1-1a01a4ce81bb service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:40:41.376681 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1451/2890] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:40:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:40:43.311965 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee91d23-45a6-4765-8a74-0e788fb41062 service glance] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:40:43.325520 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee91d23-45a6-4765-8a74-0e788fb41062 service glance] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:40:43.332249 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c388a-668e-4831-a953-3e2d0e535944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:40:43.332877 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c388a-668e-4831-a953-3e2d0e535944 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:40:43.333157 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c388a-668e-4831-a953-3e2d0e535944 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:40:43.333428 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c388a-668e-4831-a953-3e2d0e535944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:40:43.335425 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-451c388a-668e-4831-a953-3e2d0e535944 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:40:43.353181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c388a-668e-4831-a953-3e2d0e535944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:40:43.355181 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c388a-668e-4831-a953-3e2d0e535944 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:40:43.368732 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1440/2891] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:40:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:40:44.742145 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c686ab2-d637-42fa-a1f1-1a01a4ce81bb service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:40:44.751878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c686ab2-d637-42fa-a1f1-1a01a4ce81bb service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:40:44.755568 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664dd4e-0613-4841-8a62-5bca254646a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:40:44.756184 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664dd4e-0613-4841-8a62-5bca254646a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:40:44.756465 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664dd4e-0613-4841-8a62-5bca254646a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:40:44.756737 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664dd4e-0613-4841-8a62-5bca254646a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:40:44.758526 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2664dd4e-0613-4841-8a62-5bca254646a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:40:44.772935 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664dd4e-0613-4841-8a62-5bca254646a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:40:44.774353 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664dd4e-0613-4841-8a62-5bca254646a1 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:40:44.786514 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1452/2892] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:40:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:40:53.362919 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=12 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:40:54.781101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=57 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:40:58.301220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a006-d000-4564-9809-8beb563e3fd2 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:40:58.301764 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a006-d000-4564-9809-8beb563e3fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:40:58.301764 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a006-d000-4564-9809-8beb563e3fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:40:58.321189 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-bb50a006-d000-4564-9809-8beb563e3fd2 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:40:58.322366 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-bb50a006-d000-4564-9809-8beb563e3fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:40:58.330527 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1441/2893] 10.222.0.110 () {58 vars in 1017 bytes} [Thu Aug 4 22:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:40:58.356965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664dd4e-0613-4841-8a62-5bca254646a1 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:40:58.368508 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664dd4e-0613-4841-8a62-5bca254646a1 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:40:58.374286 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b922e-5d1d-4080-99ee-447d179d2f41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:40:58.374932 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b922e-5d1d-4080-99ee-447d179d2f41 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:40:58.375216 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b922e-5d1d-4080-99ee-447d179d2f41 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:40:58.375745 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b922e-5d1d-4080-99ee-447d179d2f41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:40:58.384688 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b922e-5d1d-4080-99ee-447d179d2f41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:40:58.386252 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b922e-5d1d-4080-99ee-447d179d2f41 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:40:58.395523 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1453/2894] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:40:59.296250 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50a006-d000-4564-9809-8beb563e3fd2 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:40:59.306525 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50a006-d000-4564-9809-8beb563e3fd2 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:40:59.310068 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadb681-cc55-404d-bb1c-ff5f0cf82f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:40:59.310721 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadb681-cc55-404d-bb1c-ff5f0cf82f35 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:40:59.311004 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadb681-cc55-404d-bb1c-ff5f0cf82f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:40:59.311280 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadb681-cc55-404d-bb1c-ff5f0cf82f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:40:59.313025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-3fadb681-cc55-404d-bb1c-ff5f0cf82f35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:40:59.371149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadb681-cc55-404d-bb1c-ff5f0cf82f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:40:59.372598 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadb681-cc55-404d-bb1c-ff5f0cf82f35 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:40:59.382194 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1442/2895] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:40:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:41:05.749476 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb05d4a-8594-4b46-8b09-d9f76cebe35d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:05.750008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb05d4a-8594-4b46-8b09-d9f76cebe35d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:05.750008 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb05d4a-8594-4b46-8b09-d9f76cebe35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:05.770032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-abb05d4a-8594-4b46-8b09-d9f76cebe35d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:41:05.771256 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-abb05d4a-8594-4b46-8b09-d9f76cebe35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:05.779342 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1454/2896] 10.222.0.110 () {58 vars in 1017 bytes} [Thu Aug 4 22:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:41:05.828771 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadb681-cc55-404d-bb1c-ff5f0cf82f35 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:05.841339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadb681-cc55-404d-bb1c-ff5f0cf82f35 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:05.847145 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234e140-6803-4a53-a49f-a1a930ea4852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:05.847754 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e140-6803-4a53-a49f-a1a930ea4852 service nova] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:05.848040 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e140-6803-4a53-a49f-a1a930ea4852 service nova] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:05.848322 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e140-6803-4a53-a49f-a1a930ea4852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:05.857125 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234e140-6803-4a53-a49f-a1a930ea4852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:05.858739 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234e140-6803-4a53-a49f-a1a930ea4852 service nova] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:05.868723 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1443/2897] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:41:07.537800 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb05d4a-8594-4b46-8b09-d9f76cebe35d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:07.548318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb05d4a-8594-4b46-8b09-d9f76cebe35d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:07.551868 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e290a5-4beb-4f7f-b5a0-1b79d0b976ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:07.552680 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e290a5-4beb-4f7f-b5a0-1b79d0b976ad service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:07.553070 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e290a5-4beb-4f7f-b5a0-1b79d0b976ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:07.553350 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e290a5-4beb-4f7f-b5a0-1b79d0b976ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:07.555084 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-01e290a5-4beb-4f7f-b5a0-1b79d0b976ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:07.567225 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e290a5-4beb-4f7f-b5a0-1b79d0b976ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:07.568633 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e290a5-4beb-4f7f-b5a0-1b79d0b976ad service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:07.578371 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1455/2898] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:41:09.798328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca6fe-e0ac-4dcf-bfce-db2b0f98eafe None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:09.798843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca6fe-e0ac-4dcf-bfce-db2b0f98eafe None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:09.799022 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ca6fe-e0ac-4dcf-bfce-db2b0f98eafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:09.825778 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-dc7ca6fe-e0ac-4dcf-bfce-db2b0f98eafe None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:41:09.827149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-dc7ca6fe-e0ac-4dcf-bfce-db2b0f98eafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:09.836404 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1444/2899] 10.222.0.110 () {58 vars in 1017 bytes} [Thu Aug 4 22:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:41:09.869315 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e290a5-4beb-4f7f-b5a0-1b79d0b976ad service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:09.882287 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e290a5-4beb-4f7f-b5a0-1b79d0b976ad service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:09.888863 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0277f09-0d9c-467c-b011-83c1bc75fffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:09.889475 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277f09-0d9c-467c-b011-83c1bc75fffd service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:09.889926 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277f09-0d9c-467c-b011-83c1bc75fffd service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:09.890383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0277f09-0d9c-467c-b011-83c1bc75fffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:09.899892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0277f09-0d9c-467c-b011-83c1bc75fffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:09.901480 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0277f09-0d9c-467c-b011-83c1bc75fffd service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:09.912220 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1456/2900] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:41:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:41:13.681700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca6fe-e0ac-4dcf-bfce-db2b0f98eafe None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:13.683230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-dc7ca6fe-e0ac-4dcf-bfce-db2b0f98eafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:13.699526 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ca6fe-e0ac-4dcf-bfce-db2b0f98eafe None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:13.704770 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf8cbe-b786-4d9a-ad58-d98b12bec5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:13.705452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf8cbe-b786-4d9a-ad58-d98b12bec5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:13.705752 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf8cbe-b786-4d9a-ad58-d98b12bec5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:13.706026 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf8cbe-b786-4d9a-ad58-d98b12bec5b5 admin admin] PATH_INFO: `/v3/users/edab125fd6ea4d2391ccae33e4e732ef` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:13.707230 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf8cbe-b786-4d9a-ad58-d98b12bec5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edab125fd6ea4d2391ccae33e4e732ef)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:13.709187 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf8cbe-b786-4d9a-ad58-d98b12bec5b5 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:13.759920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b0cf8cbe-b786-4d9a-ad58-d98b12bec5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edab125fd6ea4d2391ccae33e4e732ef'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:13.768006 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b0cf8cbe-b786-4d9a-ad58-d98b12bec5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edab125fd6ea4d2391ccae33e4e732ef'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:13.775692 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b0cf8cbe-b786-4d9a-ad58-d98b12bec5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edab125fd6ea4d2391ccae33e4e732ef'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:13.776368 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b0cf8cbe-b786-4d9a-ad58-d98b12bec5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edab125fd6ea4d2391ccae33e4e732ef'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:13.788829 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b0cf8cbe-b786-4d9a-ad58-d98b12bec5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edab125fd6ea4d2391ccae33e4e732ef'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:13.794701 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1445/2901] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:41:13 2022] DELETE /identity/v3/users/edab125fd6ea4d2391ccae33e4e732ef => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:41:13.961840 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf803538-1718-47ea-b9e5-f66be178e32a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:13.962528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf803538-1718-47ea-b9e5-f66be178e32a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:13.962528 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf803538-1718-47ea-b9e5-f66be178e32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:13.981668 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf8cbe-b786-4d9a-ad58-d98b12bec5b5 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:13.983203 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-b0cf8cbe-b786-4d9a-ad58-d98b12bec5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:13.989951 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cf803538-1718-47ea-b9e5-f66be178e32a None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:41:13.991254 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cf803538-1718-47ea-b9e5-f66be178e32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:14.051616 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:41:14.053449 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1457/2902] 10.222.0.110 () {58 vars in 1017 bytes} [Thu Aug 4 22:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:41:14.071964 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf8cbe-b786-4d9a-ad58-d98b12bec5b5 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:14.076632 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:14.077274 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:14.077553 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:14.077824 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] PATH_INFO: `/v3/projects/f2bf768cef8849d3b2960a532462d1a0` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:14.079015 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2bf768cef8849d3b2960a532462d1a0)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:14.080914 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf803538-1718-47ea-b9e5-f66be178e32a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:14.081458 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:14.082511 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cf803538-1718-47ea-b9e5-f66be178e32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:14.139220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2bf768cef8849d3b2960a532462d1a0', 'request_id': 'req-ed4ab1d4-11f9-4988-a7b6-980cf5701096'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.148021 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2bf768cef8849d3b2960a532462d1a0', 'request_id': 'req-ed4ab1d4-11f9-4988-a7b6-980cf5701096'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.153606 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2bf768cef8849d3b2960a532462d1a0', 'request_id': 'req-ed4ab1d4-11f9-4988-a7b6-980cf5701096'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.165315 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] The token cache is being invalidate because project f2bf768cef8849d3b2960a532462d1a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:41:14.165608 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.166240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.168025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1446/2903] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:41:13 2022] DELETE /identity/v3/projects/f2bf768cef8849d3b2960a532462d1a0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:41:14.170958 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf803538-1718-47ea-b9e5-f66be178e32a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:14.171841 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:14.173186 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:14.228742 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:41:14.244319 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ab1d4-11f9-4988-a7b6-980cf5701096 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:14.249445 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249633e0-898c-4414-8579-3279483e5c61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:14.249645 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798675aa-07aa-423d-891e-f818f1360741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:14.250136 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249633e0-898c-4414-8579-3279483e5c61 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:14.250328 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798675aa-07aa-423d-891e-f818f1360741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:14.250481 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249633e0-898c-4414-8579-3279483e5c61 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:14.250799 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249633e0-898c-4414-8579-3279483e5c61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:14.251349 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798675aa-07aa-423d-891e-f818f1360741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:14.251653 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798675aa-07aa-423d-891e-f818f1360741 admin admin] PATH_INFO: `/v3/users/f6e212008fbe4eb9a41049dfab81c5a6` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:14.252883 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798675aa-07aa-423d-891e-f818f1360741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e212008fbe4eb9a41049dfab81c5a6)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:14.253032 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-249633e0-898c-4414-8579-3279483e5c61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:14.254833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798675aa-07aa-423d-891e-f818f1360741 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:14.264927 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249633e0-898c-4414-8579-3279483e5c61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:14.266625 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249633e0-898c-4414-8579-3279483e5c61 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:14.276873 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1458/2904] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:41:14.303523 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-798675aa-07aa-423d-891e-f818f1360741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e212008fbe4eb9a41049dfab81c5a6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.311436 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-798675aa-07aa-423d-891e-f818f1360741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e212008fbe4eb9a41049dfab81c5a6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.318618 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-798675aa-07aa-423d-891e-f818f1360741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e212008fbe4eb9a41049dfab81c5a6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.319297 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-798675aa-07aa-423d-891e-f818f1360741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e212008fbe4eb9a41049dfab81c5a6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.329287 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:41:14.332127 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-798675aa-07aa-423d-891e-f818f1360741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e212008fbe4eb9a41049dfab81c5a6'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.339449 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1447/2905] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:41:14 2022] DELETE /identity/v3/users/f6e212008fbe4eb9a41049dfab81c5a6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:41:14.518996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249633e0-898c-4414-8579-3279483e5c61 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:14.532268 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249633e0-898c-4414-8579-3279483e5c61 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:14.590700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:14.591338 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:14.591869 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:14.592141 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] PATH_INFO: `/v3/projects/a64e7657f80144a1974586e9e7f1f533` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:14.593280 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] RBAC: Authorizing `identity:delete_project(project_id=a64e7657f80144a1974586e9e7f1f533)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:14.595202 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:14.639248 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a64e7657f80144a1974586e9e7f1f533', 'request_id': 'req-04533112-5e13-4417-bf82-bbb87036cfae'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.646094 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a64e7657f80144a1974586e9e7f1f533', 'request_id': 'req-04533112-5e13-4417-bf82-bbb87036cfae'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.653444 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a64e7657f80144a1974586e9e7f1f533', 'request_id': 'req-04533112-5e13-4417-bf82-bbb87036cfae'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.663771 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] The token cache is being invalidate because project a64e7657f80144a1974586e9e7f1f533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:41:14.664060 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.664677 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:14.666190 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1459/2906] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:41:14 2022] DELETE /identity/v3/projects/a64e7657f80144a1974586e9e7f1f533 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:41:18.138989 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f522fc-b774-4ad9-a90d-e1ab8174800d None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:18.139528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f522fc-b774-4ad9-a90d-e1ab8174800d None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:18.139528 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f522fc-b774-4ad9-a90d-e1ab8174800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:18.167832 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-19f522fc-b774-4ad9-a90d-e1ab8174800d None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:41:18.169054 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-19f522fc-b774-4ad9-a90d-e1ab8174800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:18.234579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1448/2907] 10.222.0.110 () {58 vars in 1017 bytes} [Thu Aug 4 22:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:41:18.273213 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:18.275022 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:18.348429 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533112-5e13-4417-bf82-bbb87036cfae admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:18.353939 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f8fbe-5d75-4e6c-bc37-a4cb517336d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:18.354591 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f8fbe-5d75-4e6c-bc37-a4cb517336d3 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:18.354878 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f8fbe-5d75-4e6c-bc37-a4cb517336d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:18.355156 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f8fbe-5d75-4e6c-bc37-a4cb517336d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:18.360178 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:41:18.365188 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f8fbe-5d75-4e6c-bc37-a4cb517336d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:18.367801 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f8fbe-5d75-4e6c-bc37-a4cb517336d3 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:18.378501 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1460/2908] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 04 22:41:28.226697 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:DELETE=1,keystone:SELECT=29 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:41:28.373643 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:41:36.431452 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f522fc-b774-4ad9-a90d-e1ab8174800d None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:36.432949 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-19f522fc-b774-4ad9-a90d-e1ab8174800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:36.490766 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f522fc-b774-4ad9-a90d-e1ab8174800d None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:36.494314 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062d7fb-6896-484f-a3bc-f951e0f4f783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:36.494958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d7fb-6896-484f-a3bc-f951e0f4f783 service neutron] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:36.495240 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d7fb-6896-484f-a3bc-f951e0f4f783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:36.495515 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d7fb-6896-484f-a3bc-f951e0f4f783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:36.497258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-9062d7fb-6896-484f-a3bc-f951e0f4f783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:36.506615 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062d7fb-6896-484f-a3bc-f951e0f4f783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:36.508025 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062d7fb-6896-484f-a3bc-f951e0f4f783 service neutron] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:36.515972 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1449/2909] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:41:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:41:46.512503 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=26 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:41:53.674962 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f8fbe-5d75-4e6c-bc37-a4cb517336d3 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:53.676693 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-481f8fbe-5d75-4e6c-bc37-a4cb517336d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:53.692091 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f8fbe-5d75-4e6c-bc37-a4cb517336d3 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:53.697193 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e430399-b229-4bde-9429-2b07fca994bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:53.697834 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e430399-b229-4bde-9429-2b07fca994bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:53.698119 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e430399-b229-4bde-9429-2b07fca994bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:53.698398 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e430399-b229-4bde-9429-2b07fca994bf admin admin] PATH_INFO: `/v3/users/d8832832650b49588d4994a74347dcb7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:53.699584 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e430399-b229-4bde-9429-2b07fca994bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8832832650b49588d4994a74347dcb7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:53.701495 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e430399-b229-4bde-9429-2b07fca994bf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:53.748166 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5e430399-b229-4bde-9429-2b07fca994bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8832832650b49588d4994a74347dcb7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:53.755086 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5e430399-b229-4bde-9429-2b07fca994bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8832832650b49588d4994a74347dcb7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:53.766668 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5e430399-b229-4bde-9429-2b07fca994bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8832832650b49588d4994a74347dcb7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:53.767289 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5e430399-b229-4bde-9429-2b07fca994bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8832832650b49588d4994a74347dcb7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:53.774594 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-5e430399-b229-4bde-9429-2b07fca994bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8832832650b49588d4994a74347dcb7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:53.780365 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1461/2910] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:41:53 2022] DELETE /identity/v3/users/d8832832650b49588d4994a74347dcb7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:41:53.952799 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062d7fb-6896-484f-a3bc-f951e0f4f783 service neutron] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:53.965345 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062d7fb-6896-484f-a3bc-f951e0f4f783 service neutron] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:54.022044 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5173ce4-ce23-44f6-b7d9-21763c875bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:54.023271 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5173ce4-ce23-44f6-b7d9-21763c875bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:54.023557 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5173ce4-ce23-44f6-b7d9-21763c875bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:54.023833 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5173ce4-ce23-44f6-b7d9-21763c875bcc admin admin] PATH_INFO: `/v3/projects/7d4831795c514e3facc6f7f9fc12cda3` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:54.025003 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5173ce4-ce23-44f6-b7d9-21763c875bcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d4831795c514e3facc6f7f9fc12cda3)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:54.026936 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5173ce4-ce23-44f6-b7d9-21763c875bcc admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:54.071662 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b5173ce4-ce23-44f6-b7d9-21763c875bcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4831795c514e3facc6f7f9fc12cda3', 'request_id': 'req-b5173ce4-ce23-44f6-b7d9-21763c875bcc'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:54.078683 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b5173ce4-ce23-44f6-b7d9-21763c875bcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4831795c514e3facc6f7f9fc12cda3', 'request_id': 'req-b5173ce4-ce23-44f6-b7d9-21763c875bcc'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:54.084122 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b5173ce4-ce23-44f6-b7d9-21763c875bcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4831795c514e3facc6f7f9fc12cda3', 'request_id': 'req-b5173ce4-ce23-44f6-b7d9-21763c875bcc'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:54.095536 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b5173ce4-ce23-44f6-b7d9-21763c875bcc admin admin] The token cache is being invalidate because project 7d4831795c514e3facc6f7f9fc12cda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:41:54.095825 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b5173ce4-ce23-44f6-b7d9-21763c875bcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:54.096465 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-b5173ce4-ce23-44f6-b7d9-21763c875bcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:41:54.097958 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1450/2911] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:41:53 2022] DELETE /identity/v3/projects/7d4831795c514e3facc6f7f9fc12cda3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 04 22:41:54.102872 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7da294-7bfc-43be-a47c-601868ebb712 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:54.103165 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7da294-7bfc-43be-a47c-601868ebb712 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:54.103447 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7da294-7bfc-43be-a47c-601868ebb712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:54.124048 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bb7da294-7bfc-43be-a47c-601868ebb712 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:41:54.125239 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bb7da294-7bfc-43be-a47c-601868ebb712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:54.182375 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1462/2912] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:41:54.190166 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0583-14d6-44d0-be00-313a4cece3a9 None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:54.190604 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0583-14d6-44d0-be00-313a4cece3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:54.190955 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b0583-14d6-44d0-be00-313a4cece3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:54.211419 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-910b0583-14d6-44d0-be00-313a4cece3a9 None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:41:54.212704 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-910b0583-14d6-44d0-be00-313a4cece3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:54.220843 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1451/2913] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:41:54.224975 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7da294-7bfc-43be-a47c-601868ebb712 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:54.234698 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7da294-7bfc-43be-a47c-601868ebb712 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:54.239179 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d189b4-db69-49fc-b1e2-4608f798296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:54.239776 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d189b4-db69-49fc-b1e2-4608f798296e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:54.240053 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d189b4-db69-49fc-b1e2-4608f798296e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:54.240320 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d189b4-db69-49fc-b1e2-4608f798296e admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:54.240996 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d189b4-db69-49fc-b1e2-4608f798296e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 04 22:41:54.241295 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d189b4-db69-49fc-b1e2-4608f798296e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:54.242905 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d189b4-db69-49fc-b1e2-4608f798296e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:54.254473 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1463/2914] 10.222.0.27 () {58 vars in 1153 bytes} [Thu Aug 4 22:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 04 22:41:54.259921 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b0583-14d6-44d0-be00-313a4cece3a9 None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:54.269559 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b0583-14d6-44d0-be00-313a4cece3a9 None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:54.274786 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f95e8-4169-4808-bd28-9aa7db55cdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:54.275331 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f95e8-4169-4808-bd28-9aa7db55cdc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:54.275609 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f95e8-4169-4808-bd28-9aa7db55cdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:54.275876 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f95e8-4169-4808-bd28-9aa7db55cdc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:54.276527 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f95e8-4169-4808-bd28-9aa7db55cdc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:54.278418 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f95e8-4169-4808-bd28-9aa7db55cdc1 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:54.304282 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1452/2915] 10.222.0.27 () {60 vars in 1153 bytes} [Thu Aug 4 22:41:54 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:41:54.308666 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d189b4-db69-49fc-b1e2-4608f798296e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:54.318562 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d189b4-db69-49fc-b1e2-4608f798296e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:54.374257 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce5767-8f87-499b-8a1b-29caebef25a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:54.374892 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce5767-8f87-499b-8a1b-29caebef25a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:54.375167 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce5767-8f87-499b-8a1b-29caebef25a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:54.375435 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce5767-8f87-499b-8a1b-29caebef25a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:54.376093 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce5767-8f87-499b-8a1b-29caebef25a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:54.377980 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce5767-8f87-499b-8a1b-29caebef25a7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:54.386230 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:41:54.400140 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1464/2916] 10.222.0.27 () {60 vars in 1144 bytes} [Thu Aug 4 22:41:54 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 04 22:41:54.404733 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f95e8-4169-4808-bd28-9aa7db55cdc1 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:54.417110 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f95e8-4169-4808-bd28-9aa7db55cdc1 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:54.423583 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af1b67-410a-419c-a113-54b1e772d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:54.424213 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af1b67-410a-419c-a113-54b1e772d5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:54.424500 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af1b67-410a-419c-a113-54b1e772d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:54.424780 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af1b67-410a-419c-a113-54b1e772d5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:54.425478 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af1b67-410a-419c-a113-54b1e772d5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:54.427118 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af1b67-410a-419c-a113-54b1e772d5b9 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:54.445551 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1453/2917] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:41:54.449756 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce5767-8f87-499b-8a1b-29caebef25a7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:54.460013 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce5767-8f87-499b-8a1b-29caebef25a7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:54.464793 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514defca-e8c7-4f40-bf35-724bd959efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:54.465422 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514defca-e8c7-4f40-bf35-724bd959efa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:54.465690 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514defca-e8c7-4f40-bf35-724bd959efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:54.465965 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514defca-e8c7-4f40-bf35-724bd959efa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:54.466710 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514defca-e8c7-4f40-bf35-724bd959efa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:54.468576 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514defca-e8c7-4f40-bf35-724bd959efa0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:54.479399 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1465/2918] 10.222.0.27 () {58 vars in 1122 bytes} [Thu Aug 4 22:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 04 22:41:54.483652 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af1b67-410a-419c-a113-54b1e772d5b9 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:54.494299 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af1b67-410a-419c-a113-54b1e772d5b9 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:54.499036 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9756e3-6723-4f5f-9bb7-b16840c861aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:54.499694 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9756e3-6723-4f5f-9bb7-b16840c861aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:54.499981 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9756e3-6723-4f5f-9bb7-b16840c861aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:54.500258 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9756e3-6723-4f5f-9bb7-b16840c861aa admin admin] PATH_INFO: `/v3/projects/da67c6e07ccc4d7baa737519814d6e62/users/62d62c68733f46ee804047f60d7306c5/roles/d295e312e144479ca8f748650ac995a4` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:54.516301 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9756e3-6723-4f5f-9bb7-b16840c861aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=da67c6e07ccc4d7baa737519814d6e62, user_id=62d62c68733f46ee804047f60d7306c5, role_id=d295e312e144479ca8f748650ac995a4)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:54.519014 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9756e3-6723-4f5f-9bb7-b16840c861aa admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:54.531871 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1454/2919] 10.222.0.27 () {60 vars in 1483 bytes} [Thu Aug 4 22:41:54 2022] PUT /identity/v3/projects/da67c6e07ccc4d7baa737519814d6e62/users/62d62c68733f46ee804047f60d7306c5/roles/d295e312e144479ca8f748650ac995a4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:41:54.542952 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf56d8-1647-45e3-a7ee-f0fbe4937ad2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:54.543242 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf56d8-1647-45e3-a7ee-f0fbe4937ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:54.543521 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf56d8-1647-45e3-a7ee-f0fbe4937ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:54.571079 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a1bf56d8-1647-45e3-a7ee-f0fbe4937ad2 None None] MFA Rules not processed for user `62d62c68733f46ee804047f60d7306c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:41:54.572279 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a1bf56d8-1647-45e3-a7ee-f0fbe4937ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:54.635283 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1466/2920] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:41:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:41:54.646134 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9756e3-6723-4f5f-9bb7-b16840c861aa admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:41:54.647991 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-fe9756e3-6723-4f5f-9bb7-b16840c861aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:41:54.677879 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:41:54.710644 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9756e3-6723-4f5f-9bb7-b16840c861aa admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:41:54.714280 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b051dba-c25c-4243-85a0-066c56a88f53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3b29a204dff42c399f0d143b3d0189f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:41:54.714920 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b051dba-c25c-4243-85a0-066c56a88f53 service cinder] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:41:54.715200 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b051dba-c25c-4243-85a0-066c56a88f53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:41:54.715470 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b051dba-c25c-4243-85a0-066c56a88f53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:41:54.723840 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b051dba-c25c-4243-85a0-066c56a88f53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:41:54.725253 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b051dba-c25c-4243-85a0-066c56a88f53 service cinder] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:41:54.734343 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1455/2921] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:41:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:42:04.632246 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:42:04.730489 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=14 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:42:05.767326 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf56d8-1647-45e3-a7ee-f0fbe4937ad2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:42:05.828613 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf56d8-1647-45e3-a7ee-f0fbe4937ad2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:42:05.833054 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2299a-0568-4d45-9fa6-8ff51dc7b614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:42:05.833678 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2299a-0568-4d45-9fa6-8ff51dc7b614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:42:05.833954 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2299a-0568-4d45-9fa6-8ff51dc7b614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:42:05.834223 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2299a-0568-4d45-9fa6-8ff51dc7b614 admin admin] PATH_INFO: `/v3/users/62d62c68733f46ee804047f60d7306c5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:42:05.835890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2299a-0568-4d45-9fa6-8ff51dc7b614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d62c68733f46ee804047f60d7306c5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:42:05.837819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2299a-0568-4d45-9fa6-8ff51dc7b614 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:42:05.883052 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2c2299a-0568-4d45-9fa6-8ff51dc7b614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d62c68733f46ee804047f60d7306c5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:42:05.889862 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2c2299a-0568-4d45-9fa6-8ff51dc7b614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d62c68733f46ee804047f60d7306c5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:42:05.902168 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2c2299a-0568-4d45-9fa6-8ff51dc7b614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d62c68733f46ee804047f60d7306c5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:42:05.902836 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2c2299a-0568-4d45-9fa6-8ff51dc7b614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d62c68733f46ee804047f60d7306c5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:42:05.909686 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c2c2299a-0568-4d45-9fa6-8ff51dc7b614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d62c68733f46ee804047f60d7306c5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:42:05.916214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1467/2922] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:42:05 2022] DELETE /identity/v3/users/62d62c68733f46ee804047f60d7306c5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:42:05.920821 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55812ce-7f87-46dd-86fa-1b2b29a5bd3b None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:42:05.921309 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55812ce-7f87-46dd-86fa-1b2b29a5bd3b None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:42:05.921424 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55812ce-7f87-46dd-86fa-1b2b29a5bd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:42:05.939978 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c55812ce-7f87-46dd-86fa-1b2b29a5bd3b None None] MFA Rules not processed for user `8c0fa3378af3402089d42ceacf7a26b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:42:05.941179 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c55812ce-7f87-46dd-86fa-1b2b29a5bd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:42:06.000699 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1456/2923] 10.222.0.27 () {58 vars in 958 bytes} [Thu Aug 4 22:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:42:06.011330 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2299a-0568-4d45-9fa6-8ff51dc7b614 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:42:06.012839 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c2c2299a-0568-4d45-9fa6-8ff51dc7b614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:42:06.069881 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2299a-0568-4d45-9fa6-8ff51dc7b614 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:42:06.073472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb47a02-a10b-48a0-9855-f49cf531b610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ee0de72ba804ba491342a8ae82a44f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:42:06.074109 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb47a02-a10b-48a0-9855-f49cf531b610 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:42:06.074392 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb47a02-a10b-48a0-9855-f49cf531b610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:42:06.074765 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb47a02-a10b-48a0-9855-f49cf531b610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:42:06.083668 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb47a02-a10b-48a0-9855-f49cf531b610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:42:06.085649 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb47a02-a10b-48a0-9855-f49cf531b610 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:42:06.095393 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1468/2924] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:42:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:42:06.359564 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55812ce-7f87-46dd-86fa-1b2b29a5bd3b None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:42:06.361011 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c55812ce-7f87-46dd-86fa-1b2b29a5bd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:42:06.376704 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55812ce-7f87-46dd-86fa-1b2b29a5bd3b None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:42:06.381893 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f924e-12b2-4285-9a8e-c71f0859cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:42:06.382298 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f924e-12b2-4285-9a8e-c71f0859cd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:42:06.382613 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f924e-12b2-4285-9a8e-c71f0859cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:42:06.382891 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f924e-12b2-4285-9a8e-c71f0859cd44 admin admin] PATH_INFO: `/v3/projects/da67c6e07ccc4d7baa737519814d6e62` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:42:06.384081 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f924e-12b2-4285-9a8e-c71f0859cd44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da67c6e07ccc4d7baa737519814d6e62)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:42:06.385988 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f924e-12b2-4285-9a8e-c71f0859cd44 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:42:06.433339 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f60f924e-12b2-4285-9a8e-c71f0859cd44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da67c6e07ccc4d7baa737519814d6e62', 'request_id': 'req-f60f924e-12b2-4285-9a8e-c71f0859cd44'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:42:06.440482 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f60f924e-12b2-4285-9a8e-c71f0859cd44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da67c6e07ccc4d7baa737519814d6e62', 'request_id': 'req-f60f924e-12b2-4285-9a8e-c71f0859cd44'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:42:06.446744 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f60f924e-12b2-4285-9a8e-c71f0859cd44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da67c6e07ccc4d7baa737519814d6e62', 'request_id': 'req-f60f924e-12b2-4285-9a8e-c71f0859cd44'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:42:06.457948 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f60f924e-12b2-4285-9a8e-c71f0859cd44 admin admin] The token cache is being invalidate because project da67c6e07ccc4d7baa737519814d6e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80284) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:42:06.458242 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f60f924e-12b2-4285-9a8e-c71f0859cd44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:42:06.458935 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-f60f924e-12b2-4285-9a8e-c71f0859cd44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:42:06.460477 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1457/2925] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:42:06 2022] DELETE /identity/v3/projects/da67c6e07ccc4d7baa737519814d6e62 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:42:16.091319 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:42:16.454911 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:43:36.106890 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb47a02-a10b-48a0-9855-f49cf531b610 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:43:36.108365 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-edb47a02-a10b-48a0-9855-f49cf531b610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:43:36.258657 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb47a02-a10b-48a0-9855-f49cf531b610 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:43:36.345700 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab619d9-480d-4916-bc02-cca4e8a98593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04899781f67746e193a05bdc004804cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:43:36.346340 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab619d9-480d-4916-bc02-cca4e8a98593 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:43:36.346659 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab619d9-480d-4916-bc02-cca4e8a98593 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:43:36.346938 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab619d9-480d-4916-bc02-cca4e8a98593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:43:36.348787 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5ab619d9-480d-4916-bc02-cca4e8a98593 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:43:36.363982 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab619d9-480d-4916-bc02-cca4e8a98593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:43:36.365598 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab619d9-480d-4916-bc02-cca4e8a98593 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:43:36.385003 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1469/2926] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:43:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:43:46.297630 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d165e-7271-4e61-8df4-2a0f61e3db0f None None] REQUEST_METHOD: `POST` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:43:46.298115 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d165e-7271-4e61-8df4-2a0f61e3db0f None None] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:43:46.298220 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d165e-7271-4e61-8df4-2a0f61e3db0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:43:46.317707 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.auth.core [None req-c55d165e-7271-4e61-8df4-2a0f61e3db0f None None] MFA Rules not processed for user `42a5e67e8b854faa8689654156c994d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80284) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 04 22:43:46.318970 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c55d165e-7271-4e61-8df4-2a0f61e3db0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:43:46.378102 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=80 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:43:46.395570 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1458/2927] 10.222.0.27 () {58 vars in 967 bytes} [Thu Aug 4 22:43:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 04 22:43:46.438999 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab619d9-480d-4916-bc02-cca4e8a98593 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:43:46.440439 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5ab619d9-480d-4916-bc02-cca4e8a98593 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:43:46.522345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab619d9-480d-4916-bc02-cca4e8a98593 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:43:46.527908 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b4b58-1c33-44de-bd77-ef7c4cfc7027 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa5bf773ed3a4f1e916671a22c65f031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:43:46.528515 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b4b58-1c33-44de-bd77-ef7c4cfc7027 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:43:46.528795 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b4b58-1c33-44de-bd77-ef7c4cfc7027 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:43:46.529099 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b4b58-1c33-44de-bd77-ef7c4cfc7027 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:43:46.541264 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b4b58-1c33-44de-bd77-ef7c4cfc7027 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:43:46.543262 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b4b58-1c33-44de-bd77-ef7c4cfc7027 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:43:46.556064 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1470/2928] 10.222.0.27 () {60 vars in 1384 bytes} [Thu Aug 4 22:43:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 04 22:43:53.189153 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d165e-7271-4e61-8df4-2a0f61e3db0f None None] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:43:53.190696 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-c55d165e-7271-4e61-8df4-2a0f61e3db0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:43:53.290139 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d165e-7271-4e61-8df4-2a0f61e3db0f None None] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:43:53.295179 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e033f07-5592-404b-9724-9316cc637640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:43:53.295817 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e033f07-5592-404b-9724-9316cc637640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:43:53.296100 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e033f07-5592-404b-9724-9316cc637640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:43:53.296377 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e033f07-5592-404b-9724-9316cc637640 admin admin] PATH_INFO: `/v3/users/cab51dd37f0e4c649b2b2126fe3bdda1` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:43:53.297542 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e033f07-5592-404b-9724-9316cc637640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab51dd37f0e4c649b2b2126fe3bdda1)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:43:53.299533 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e033f07-5592-404b-9724-9316cc637640 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:43:53.345314 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2e033f07-5592-404b-9724-9316cc637640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab51dd37f0e4c649b2b2126fe3bdda1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.354281 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2e033f07-5592-404b-9724-9316cc637640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab51dd37f0e4c649b2b2126fe3bdda1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.361788 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2e033f07-5592-404b-9724-9316cc637640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab51dd37f0e4c649b2b2126fe3bdda1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.362427 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2e033f07-5592-404b-9724-9316cc637640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab51dd37f0e4c649b2b2126fe3bdda1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.363562 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:43:53.377245 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-2e033f07-5592-404b-9724-9316cc637640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab51dd37f0e4c649b2b2126fe3bdda1'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.383028 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1459/2929] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:43:53 2022] DELETE /identity/v3/users/cab51dd37f0e4c649b2b2126fe3bdda1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:43:53.558667 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b4b58-1c33-44de-bd77-ef7c4cfc7027 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:43:53.569223 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b4b58-1c33-44de-bd77-ef7c4cfc7027 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:43:53.627040 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:43:53.627674 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:43:53.627951 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:43:53.628221 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] PATH_INFO: `/v3/projects/897872752f7c4ec5a275c7c7b916b8c8` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:43:53.629357 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=897872752f7c4ec5a275c7c7b916b8c8)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:43:53.631383 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:43:53.676819 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897872752f7c4ec5a275c7c7b916b8c8', 'request_id': 'req-b143cd1b-9cd2-49d6-b29d-8550d878ed70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.682952 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897872752f7c4ec5a275c7c7b916b8c8', 'request_id': 'req-b143cd1b-9cd2-49d6-b29d-8550d878ed70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.692275 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897872752f7c4ec5a275c7c7b916b8c8', 'request_id': 'req-b143cd1b-9cd2-49d6-b29d-8550d878ed70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.703904 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] The token cache is being invalidate because project 897872752f7c4ec5a275c7c7b916b8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:43:53.704195 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.704842 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.706345 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1471/2930] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:43:53 2022] DELETE /identity/v3/projects/897872752f7c4ec5a275c7c7b916b8c8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:43:53.710397 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e033f07-5592-404b-9724-9316cc637640 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:43:53.711856 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-2e033f07-5592-404b-9724-9316cc637640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:43:53.726526 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e033f07-5592-404b-9724-9316cc637640 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:43:53.787532 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54522be0-3592-4289-b8e8-7038bebe3330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:43:53.788290 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54522be0-3592-4289-b8e8-7038bebe3330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:43:53.788579 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54522be0-3592-4289-b8e8-7038bebe3330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:43:53.788903 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54522be0-3592-4289-b8e8-7038bebe3330 admin admin] PATH_INFO: `/v3/users/1e6c848070924c5d80e7b48a83865d74` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:43:53.790149 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54522be0-3592-4289-b8e8-7038bebe3330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e6c848070924c5d80e7b48a83865d74)` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:43:53.792269 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54522be0-3592-4289-b8e8-7038bebe3330 admin admin] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:43:53.841121 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-54522be0-3592-4289-b8e8-7038bebe3330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e6c848070924c5d80e7b48a83865d74'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.849239 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-54522be0-3592-4289-b8e8-7038bebe3330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e6c848070924c5d80e7b48a83865d74'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.856190 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-54522be0-3592-4289-b8e8-7038bebe3330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e6c848070924c5d80e7b48a83865d74'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.856831 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-54522be0-3592-4289-b8e8-7038bebe3330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e6c848070924c5d80e7b48a83865d74'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.868700 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.notifications [None req-54522be0-3592-4289-b8e8-7038bebe3330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e6c848070924c5d80e7b48a83865d74'} {{(pid=80284) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:53.874650 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1460/2931] 10.222.0.27 () {58 vars in 1224 bytes} [Thu Aug 4 22:43:53 2022] DELETE /identity/v3/users/1e6c848070924c5d80e7b48a83865d74 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:43:54.046291 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:43:54.047843 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:43:54.061663 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143cd1b-9cd2-49d6-b29d-8550d878ed70 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:43:54.069516 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:43:54.119265 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c0fa3378af3402089d42ceacf7a26b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bdfa7558ab048ecad90e7cc85494da9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:43:54.119959 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:43:54.120236 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:43:54.120505 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] PATH_INFO: `/v3/projects/12abec5893144ab680076645bfc6dc04` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:43:54.121673 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12abec5893144ab680076645bfc6dc04)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:43:54.124214 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:43:54.168441 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12abec5893144ab680076645bfc6dc04', 'request_id': 'req-1936b7ed-d5f6-4d62-af11-b79613ec6701'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:54.175101 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12abec5893144ab680076645bfc6dc04', 'request_id': 'req-1936b7ed-d5f6-4d62-af11-b79613ec6701'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:54.182173 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12abec5893144ab680076645bfc6dc04', 'request_id': 'req-1936b7ed-d5f6-4d62-af11-b79613ec6701'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:54.192070 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] The token cache is being invalidate because project 12abec5893144ab680076645bfc6dc04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 04 22:43:54.192352 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:54.192981 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 04 22:43:54.194472 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1472/2932] 10.222.0.27 () {58 vars in 1233 bytes} [Thu Aug 4 22:43:54 2022] DELETE /identity/v3/projects/12abec5893144ab680076645bfc6dc04 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 04 22:44:03.871120 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=60,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:44:04.189142 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:44:32.792409 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54522be0-3592-4289-b8e8-7038bebe3330 admin admin] Authenticating user token {{(pid=80284) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:44:32.793814 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-54522be0-3592-4289-b8e8-7038bebe3330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:44:32.884160 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54522be0-3592-4289-b8e8-7038bebe3330 admin admin] Validating token access rules against request {{(pid=80284) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:44:32.950788 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b0467-7a51-4662-95bd-5172f2cdf314 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2448489cc4ad1a6fd3096ebd3f746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80284) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:44:32.951402 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b0467-7a51-4662-95bd-5172f2cdf314 service placement] REQUEST_METHOD: `GET` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:44:32.951679 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b0467-7a51-4662-95bd-5172f2cdf314 service placement] SCRIPT_NAME: `/identity` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:44:32.951950 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b0467-7a51-4662-95bd-5172f2cdf314 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80284) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:44:32.953677 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.fernet_utils [None req-613b0467-7a51-4662-95bd-5172f2cdf314 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80284) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:44:32.965522 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b0467-7a51-4662-95bd-5172f2cdf314 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:44:32.967112 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b0467-7a51-4662-95bd-5172f2cdf314 service placement] RBAC: Authorization granted {{(pid=80284) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:44:32.977113 dv-cinder-852211-1-smb devstack@keystone.service[80284]: [pid: 80284|app: 0|req: 1461/2933] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:44:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:44:42.972870 dv-cinder-852211-1-smb devstack@keystone.service[80284]: DEBUG dbcounter [-] [80284] Writing DB stats keystone:SELECT=67 {{(pid=80284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 22:49:39.781552 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 04 22:49:39.783010 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 04 22:49:39.798318 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936b7ed-d5f6-4d62-af11-b79613ec6701 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 04 22:49:39.803255 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980cd69-13db-43ea-b948-cf0cc295aa04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b2448489cc4ad1a6fd3096ebd3f746', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebe696ab97a143959fa7e33cda768cfc', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 04 22:49:39.803855 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980cd69-13db-43ea-b948-cf0cc295aa04 service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 04 22:49:39.804131 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980cd69-13db-43ea-b948-cf0cc295aa04 service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 04 22:49:39.804399 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980cd69-13db-43ea-b948-cf0cc295aa04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 04 22:49:39.813412 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980cd69-13db-43ea-b948-cf0cc295aa04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 04 22:49:39.815006 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980cd69-13db-43ea-b948-cf0cc295aa04 service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 04 22:49:39.824726 dv-cinder-852211-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1473/2934] 10.222.0.27 () {60 vars in 1365 bytes} [Thu Aug 4 22:49:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 04 22:49:49.820488 dv-cinder-852211-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}